Sep 11 03:49:54.012912 ip-10-0-140-70 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 03:49:54.438896 ip-10-0-140-70 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 03:49:54.438896 ip-10-0-140-70 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 03:49:54.438896 ip-10-0-140-70 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 03:49:54.438896 ip-10-0-140-70 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 03:49:54.438896 ip-10-0-140-70 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 03:49:54.439985 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.439894    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 03:49:54.446695 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446673    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:49:54.446695 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446691    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:49:54.446695 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446697    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:49:54.446695 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446702    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446705    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446709    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446713    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446716    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446719    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446722    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446724    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446727    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446730    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446732    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446735    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446737    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446740    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446743    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446746    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446748    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446751    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446753    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:49:54.446864 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446756    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446759    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446763    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446767    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446769    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446772    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446774    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446777    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446780    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446782    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446785    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446787    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446790    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446793    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446795    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446799    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446801    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446804    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446806    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446809    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:49:54.447312 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446812    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446814    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446817    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446819    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446822    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446824    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446827    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446829    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446832    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446837    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446840    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446843    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446846    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446849    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446852    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446854    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446857    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446860    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446862    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446865    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:49:54.447858 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446868    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446870    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446873    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446876    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446879    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446881    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446884    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446888    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446891    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446893    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446896    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446898    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446900    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446903    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446906    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446908    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446910    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446913    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446915    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446918    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:49:54.448425 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446922    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446925    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446927    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446930    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446932    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446935    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446937    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446940    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446943    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446945    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446948    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446950    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446953    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446955    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446958    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446961    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.446964    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447700    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447707    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447711    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:49:54.448929 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447714    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447716    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447719    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447722    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447725    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447727    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447730    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447732    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447735    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447737    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447740    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447742    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447745    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447747    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447750    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447753    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447756    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447758    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447761    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447764    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:49:54.449407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447766    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447769    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447771    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447774    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447777    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447779    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447782    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447784    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447788    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447790    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447793    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447796    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447798    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447801    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447803    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447806    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447810    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447815    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447818    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447820    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:49:54.449916 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447823    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447826    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447830    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447833    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447836    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447839    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447842    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447845    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447849    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447852    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447854    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447857    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447860    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447862    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447866    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447868    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447871    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447874    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447876    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:49:54.450414 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447880    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447884    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447886    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447889    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447892    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447894    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447897    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447900    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447902    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447905    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447907    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447910    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447912    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447917    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447919    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447922    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447924    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447927    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447929    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:49:54.450932 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447932    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447934    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447937    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447940    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447943    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447946    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447948    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447951    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447954    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447956    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447959    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447961    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447964    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447967    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447969    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447972    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447974    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.447977    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448365    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448369    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:49:54.451407 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448372    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448375    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448377    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448380    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448383    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448385    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448388    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448391    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448394    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448396    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448399    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448401    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448404    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448409    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448412    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448415    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448417    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448420    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448422    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:49:54.451909 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448425    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448428    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448431    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448433    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448436    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448439    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448441    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448444    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448447    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448449    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448452    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448454    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448457    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448460    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448463    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448465    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448468    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448470    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448473    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448475    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:49:54.452370 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448478    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448480    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448483    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448485    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448488    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448490    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448494    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448496    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448500    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448502    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448505    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448507    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448509    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448512    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448515    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448518    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448521    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448524    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448526    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448529    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:49:54.452866 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448531    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448534    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448537    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448540    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448542    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448545    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448548    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448550    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448553    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448555    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448558    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448561    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448564    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448568    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448572    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448575    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448578    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448581    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448585    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:49:54.453343 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448589    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448593    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448613    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448617    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448620    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448623    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448627    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448630    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448633    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448636    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448639    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448642    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448645    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448648    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448651    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448653    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448656    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448658    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.448661    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:49:54.453832 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448736    2575 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448777    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448783    2575 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448788    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448792    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448795    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448799    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448803    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448807    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448811    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448814    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448817    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448822    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448825    2575 flags.go:64] FLAG: --cgroup-root=""
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448827    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448830    2575 flags.go:64] FLAG: --client-ca-file=""
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448840    2575 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448843    2575 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448847    2575 flags.go:64] FLAG: --cluster-domain=""
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448850    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448853    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448857    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448860    2575 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448869    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 03:49:54.454294 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448872    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448875    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448878    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448881    2575 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448884    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448888    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448891    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448894    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448898    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448901    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448904    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448906    2575 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448909    2575 flags.go:64] FLAG: --enable-server="true"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448912    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448916    2575 flags.go:64] FLAG: --event-burst="100"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448919    2575 flags.go:64] FLAG: --event-qps="50"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448923    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448926    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448929    2575 flags.go:64] FLAG: --eviction-hard=""
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448933    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448937    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448941    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448944    2575 flags.go:64] FLAG: --eviction-soft=""
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448947    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448950    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 03:49:54.454894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448953    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448956    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448959    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448962    2575 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448965    2575 flags.go:64] FLAG: --feature-gates=""
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448969    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448971    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448974    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448977    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448980    2575 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448983    2575 flags.go:64] FLAG: --help="false"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448986    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448989    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448992    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448994    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.448997    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449001    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449003    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449006    2575 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449009    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449012    2575 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449015    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449018    2575 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449022    2575 flags.go:64] FLAG: --kube-reserved=""
Sep 11 03:49:54.455516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449024    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449027    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449030    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449034    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449036    2575 flags.go:64] FLAG: --lock-file=""
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449039    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449042    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449045    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449050    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449053    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449056    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449058    2575 flags.go:64] FLAG: --logging-format="text"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449061    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449065    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449067    2575 flags.go:64] FLAG: --manifest-url=""
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449070    2575 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449074    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449077    2575 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449081    2575 flags.go:64] FLAG: --max-pods="110"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449084    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449087    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449089    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449092    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449095    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449098    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 03:49:54.456125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449101    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449108    2575 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449111    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449115    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449118    2575 flags.go:64] FLAG: --pod-cidr=""
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449121    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449127    2575 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449131    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449134    2575 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449137    2575 flags.go:64] FLAG: --port="10250"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449140    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449143    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0af54998ace8f05f2"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449146    2575 flags.go:64] FLAG: --qos-reserved=""
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449148    2575 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449151    2575 flags.go:64] FLAG: --register-node="true"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449154    2575 flags.go:64] FLAG: --register-with-taints=""
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449157    2575 flags.go:64] FLAG: --registry-burst="10"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449162    2575 flags.go:64] FLAG: --registry-qps="5"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449165    2575 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449168    2575 flags.go:64] FLAG: --reserved-memory=""
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449171    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449174    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449177    2575 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449180    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449183    2575 flags.go:64] FLAG: --runonce="false"
Sep 11 03:49:54.456756 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449186    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449189    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449192    2575 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449195    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449197    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449200    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449203    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449206    2575 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449209    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449212    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449216    2575 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449218    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449221    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449224    2575 flags.go:64] FLAG: --system-cgroups=""
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449228    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449233    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449236    2575 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449239    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449243    2575 flags.go:64] FLAG: --tls-min-version=""
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449246    2575 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449249    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449251    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449254    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449257    2575 flags.go:64] FLAG: --v="2"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449261    2575 flags.go:64] FLAG: --version="false"
Sep 11 03:49:54.457779 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449265    2575 flags.go:64] FLAG: --vmodule=""
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449269    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.449272    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449401    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449404    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449408    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449411    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449414    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449416    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449419    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449422    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449424    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449427    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449430    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449432    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449435    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449437    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449440    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449442    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449445    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449447    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:49:54.458849 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449452    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449454    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449457    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449460    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449463    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449466    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449468    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449471    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449473    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449476    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449478    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449481    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449487    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449490    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449492    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449495    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449499    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449502    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449505    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449508    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:49:54.459774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449511    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449514    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449517    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449519    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449521    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449524    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449527    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449531    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449534    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449536    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449539    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449542    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449545    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449549    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449553    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449556    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449558    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449561    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449564    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:49:54.460655 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449567    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449569    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449572    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449575    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449577    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449580    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449583    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449586    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449589    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449592    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449594    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449612    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449615    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449617    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449620    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449622    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449625    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449628    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449630    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:49:54.461320 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449633    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449637    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449641    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449645    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449648    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449651    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449655    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449657    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449660    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449663    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449665    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449668    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449670    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449673    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449675    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449678    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449681    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449683    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449686    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:49:54.462060 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449689    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449692    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449695    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.449698    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.450423    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.459483    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.459502    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.459530    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.459538    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459640    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459648    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459653    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459659    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459663    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459669    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:49:54.462876 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459673    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459678    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459682    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459686    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459690    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459695    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459699    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459703    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459707    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459711    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459715    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459721    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459725    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459729    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459733    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459738    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459742    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459746    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459750    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459754    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:49:54.463401 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459758    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459762    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459766    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459772    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459776    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459779    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459783    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459787    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459792    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459796    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459800    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459804    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459810    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459817    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459822    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459828    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459834    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459840    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459845    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:49:54.463955 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459850    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459855    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459860    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459864    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459871    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459877    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459882    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459887    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459892    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459897    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459901    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459905    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459910    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459914    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459918    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459923    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459928    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459933    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459937    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:49:54.464537 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459942    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459946    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459950    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459955    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459959    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459963    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459967    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459971    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459975    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459980    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459984    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459988    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459993    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.459997    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460001    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460005    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460009    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460013    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460017    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460021    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:49:54.465029 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460025    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460029    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460033    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460037    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460041    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460045    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460049    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460053    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460058    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460063    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460067    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460073    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460077    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460081    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460085    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:49:54.465578 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.460093    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460300    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460309    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460315    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460319    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460323    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460327    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460331    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460336    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460339    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460343    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460347    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460352    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460356    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460360    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460364    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460368    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460372    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460376    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460380    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 03:49:54.466001 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460385    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460389    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460394    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460398    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460402    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460406    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460411    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460415    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460422    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460429    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460434    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460438    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460443    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460447    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460452    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460456    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460461    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460465    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460469    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460474    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 03:49:54.466562 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460478    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460483    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460487    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460491    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460495    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460499    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460503    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460507    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460511    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460515    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460520    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460524    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460529    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460532    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460536    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460541    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460545    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460549    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460553    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 03:49:54.467115 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460557    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460562    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460566    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460571    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460575    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460579    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460583    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460587    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460591    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460615    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460623    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460628    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460632    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460636    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460640    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460644    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460648    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460652    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460656    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 03:49:54.467590 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460660    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460664    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460668    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460671    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460675    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460679    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460684    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460688    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460693    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460697    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460701    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460706    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460710    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460715    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460721    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460726    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460731    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460736    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460741    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460746    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 03:49:54.468304 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460750    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 03:49:54.469573 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:54.460754    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 03:49:54.469573 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.460763    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 03:49:54.469573 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.460910    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 03:49:54.469573 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.463983    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 03:49:54.469573 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.465201    2575 server.go:1019] "Starting client certificate rotation"
Sep 11 03:49:54.469573 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.465302    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 03:49:54.469573 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.465333    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 03:49:54.469573 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.468444    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 03:49:54.471755 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.471725    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 03:49:54.482926 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.482908    2575 log.go:25] "Validated CRI v1 runtime API"
Sep 11 03:49:54.486496 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.486476    2575 log.go:25] "Validated CRI v1 image API"
Sep 11 03:49:54.488736 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.488716    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 03:49:54.492897 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.492877    2575 fs.go:135] Filesystem UUIDs: map[3ba071bd-0025-4227-9d73-6282261ecd31:/dev/nvme0n1p3 5b44fe3d-e482-42dd-a4cd-1d97251a2a71:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 11 03:49:54.492962 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.492896    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 03:49:54.497927 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.497819    2575 manager.go:216] Machine: {Timestamp:2026-09-11 03:49:54.49640074 +0000 UTC m=+0.374593033 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100313 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d770a8bc09746396405ec82de187a SystemUUID:ec2d770a-8bc0-9746-3964-05ec82de187a BootID:86464ef4-c879-4ef1-9563-7bd60e57980f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:12:04:08:07:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:12:04:08:07:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:58:5c:49:53:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 03:49:54.497927 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.497922    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 03:49:54.498030 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.498009    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 03:49:54.498489 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.498469    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 03:49:54.501534 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.501506    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 03:49:54.501692 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.501537    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 03:49:54.503113 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.503102    2575 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 03:49:54.503146 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.503116    2575 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 03:49:54.503146 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.503123    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 03:49:54.503968 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.503957    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 03:49:54.505170 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.505160    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 03:49:54.509700 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.509689    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 03:49:54.509820 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.509811    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 03:49:54.509859 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.509840    2575 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 03:49:54.509859 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.509849    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 03:49:54.509926 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.509863    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 03:49:54.509926 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.509874    2575 kubelet.go:398] "Adding apiserver pod source"
Sep 11 03:49:54.509926 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.509884    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 03:49:54.510310 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.510298    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 03:49:54.510343 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.510321    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 03:49:54.514244 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.514221    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 03:49:54.516977 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.516963    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 03:49:54.517047 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.516994    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 03:49:54.519867 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519853    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 03:49:54.519933 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519873    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 03:49:54.519933 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519882    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 03:49:54.519933 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519890    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 03:49:54.519933 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519902    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 03:49:54.519933 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519910    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 03:49:54.520076 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519956    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 03:49:54.520076 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519964    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 03:49:54.520076 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519971    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 03:49:54.520076 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519976    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 03:49:54.520076 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519985    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 03:49:54.520076 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.519990    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 03:49:54.520804 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.520783    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 03:49:54.520874 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.520828    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 03:49:54.520874 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.520851    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 03:49:54.520874 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.520863    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 03:49:54.524573 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.524559    2575 server.go:1268] "Started kubelet"
Sep 11 03:49:54.524677 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.524621    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 03:49:54.527827 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.524644    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 03:49:54.527909 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.527858    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 03:49:54.528695 ip-10-0-140-70 systemd[1]: Started Kubernetes Kubelet.
Sep 11 03:49:54.530802 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.530779    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 03:49:54.531328 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.531307    2575 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 03:49:54.533356 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.533336    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 03:49:54.533499 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.533475    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 03:49:54.537886 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.537869    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 03:49:54.538649 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.538633    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 03:49:54.538759 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.538714    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 11 03:49:54.539446 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539422    2575 factory.go:55] Registering systemd factory
Sep 11 03:49:54.539446 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539443    2575 factory.go:223] Registration of the systemd container factory successfully
Sep 11 03:49:54.539592 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539456    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 03:49:54.539592 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539459    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 03:49:54.539592 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539482    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 03:49:54.539592 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539532    2575 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 03:49:54.539592 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539539    2575 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 03:49:54.539828 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539710    2575 factory.go:153] Registering CRI-O factory
Sep 11 03:49:54.539828 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539725    2575 factory.go:223] Registration of the crio container factory successfully
Sep 11 03:49:54.539828 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539772    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 03:49:54.539828 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539789    2575 factory.go:103] Registering Raw factory
Sep 11 03:49:54.539828 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.539804    2575 manager.go:1196] Started watching for new ooms in manager
Sep 11 03:49:54.540179 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.540166    2575 manager.go:349] Starting recovery of all containers
Sep 11 03:49:54.543703 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.543677    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 03:49:54.543838 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.543815    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 03:49:54.544399 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.544311    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fqd8m"
Sep 11 03:49:54.545061 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.543671    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-70.ec2.internal.18d427b152c8b9c5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-70.ec2.internal,UID:ip-10-0-140-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-70.ec2.internal,},FirstTimestamp:2026-09-11 03:49:54.524510661 +0000 UTC m=+0.402702955,LastTimestamp:2026-09-11 03:49:54.524510661 +0000 UTC m=+0.402702955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-70.ec2.internal,}"
Sep 11 03:49:54.550357 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.550341    2575 manager.go:354] Recovery completed
Sep 11 03:49:54.551754 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.551736    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fqd8m"
Sep 11 03:49:54.554237 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.554225    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 03:49:54.555975 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.555960    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 03:49:54.556050 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.555995    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 03:49:54.556050 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.556010    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 03:49:54.556560 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.556549    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 03:49:54.556560 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.556554    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 03:49:54.556560 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.556559    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 03:49:54.556727 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.556573    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 03:49:54.557540 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.557524    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 03:49:54.557983 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.557917    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-70.ec2.internal.18d427b154a8d90b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-70.ec2.internal,UID:ip-10-0-140-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-70.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-70.ec2.internal,},FirstTimestamp:2026-09-11 03:49:54.555975947 +0000 UTC m=+0.434168244,LastTimestamp:2026-09-11 03:49:54.555975947 +0000 UTC m=+0.434168244,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-70.ec2.internal,}"
Sep 11 03:49:54.558258 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.558243    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 03:49:54.558324 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.558276    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 03:49:54.559930 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.559914    2575 policy_none.go:49] "None policy: Start"
Sep 11 03:49:54.559997 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.559934    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 03:49:54.559997 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.559944    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 03:49:54.561859 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.561847    2575 policy_none.go:47] "Start"
Sep 11 03:49:54.611774 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.597188    2575 manager.go:337] "Starting Device Plugin manager"
Sep 11 03:49:54.611774 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.597219    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 03:49:54.611774 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.597230    2575 server.go:87] "Starting device plugin registration server"
Sep 11 03:49:54.611774 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.597540    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 03:49:54.611774 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.597552    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 03:49:54.611774 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.597690    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 03:49:54.611774 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.597763    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 03:49:54.611774 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.597772    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 03:49:54.611774 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.598220    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 03:49:54.611774 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.598268    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 11 03:49:54.624573 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.624544    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 03:49:54.625814 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.625800    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 03:49:54.625894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.625852    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 03:49:54.625894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.625881    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 03:49:54.625990 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.625924    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 03:49:54.628262 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.628242    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:49:54.698249 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.698199    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 03:49:54.699023 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.698996    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 03:49:54.699125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.699029    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 03:49:54.699125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.699047    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 03:49:54.699125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.699071    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.708177 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.708161    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.708224 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.708180    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-70.ec2.internal\": node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 11 03:49:54.726435 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.726416    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"]
Sep 11 03:49:54.726483 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.726470    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 03:49:54.727164 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.727149    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 03:49:54.727212 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.727185    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 03:49:54.727212 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.727198    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 03:49:54.729449 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.729438    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 03:49:54.729595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.729582    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.729694 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.729626    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 03:49:54.730124 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.730108    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 03:49:54.730185 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.730138    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 03:49:54.730185 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.730147    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 03:49:54.730246 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.730110    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 03:49:54.730246 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.730214    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 03:49:54.730246 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.730227    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 03:49:54.732466 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.732453    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.732527 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.732474    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 03:49:54.733091 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.733076    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 03:49:54.733164 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.733100    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 03:49:54.733164 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.733110    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 03:49:54.739631 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.739614    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 11 03:49:54.740575 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.740560    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70d048848a0525d7e0db136ea4e57369-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"70d048848a0525d7e0db136ea4e57369\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.740639 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.740583    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70d048848a0525d7e0db136ea4e57369-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"70d048848a0525d7e0db136ea4e57369\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.740639 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.740613    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45521813523a4f1b7be2eda5037f0f36-config\") pod \"kube-apiserver-proxy-ip-10-0-140-70.ec2.internal\" (UID: \"45521813523a4f1b7be2eda5037f0f36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.746143 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.746128    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-70.ec2.internal\" not found" node="ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.749902 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.749886    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-70.ec2.internal\" not found" node="ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.839743 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.839715    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 11 03:49:54.840859 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.840843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70d048848a0525d7e0db136ea4e57369-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"70d048848a0525d7e0db136ea4e57369\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.840914 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.840869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70d048848a0525d7e0db136ea4e57369-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"70d048848a0525d7e0db136ea4e57369\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.840914 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.840886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45521813523a4f1b7be2eda5037f0f36-config\") pod \"kube-apiserver-proxy-ip-10-0-140-70.ec2.internal\" (UID: \"45521813523a4f1b7be2eda5037f0f36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.841008 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.840922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45521813523a4f1b7be2eda5037f0f36-config\") pod \"kube-apiserver-proxy-ip-10-0-140-70.ec2.internal\" (UID: \"45521813523a4f1b7be2eda5037f0f36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.841008 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.840944    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70d048848a0525d7e0db136ea4e57369-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"70d048848a0525d7e0db136ea4e57369\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.841008 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:54.840966    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70d048848a0525d7e0db136ea4e57369-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal\" (UID: \"70d048848a0525d7e0db136ea4e57369\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:54.939986 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:54.939959    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 11 03:49:55.040662 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.040595    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 11 03:49:55.048831 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.048816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:55.051991 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.051972    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:55.141651 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.141628    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 11 03:49:55.242039 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.242014    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 11 03:49:55.342519 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.342466    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-70.ec2.internal\" not found"
Sep 11 03:49:55.348594 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.348569    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:49:55.402011 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.401987    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:49:55.439734 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.439712    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:55.452357 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.452340    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 03:49:55.453190 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.453178    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal"
Sep 11 03:49:55.459191 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.459172    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 03:49:55.465328 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.465313    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 03:49:55.465445 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.465429    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 03:49:55.465500 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.465465    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 03:49:55.465500 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.465482    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 03:49:55.510563 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.510544    2575 apiserver.go:52] "Watching apiserver"
Sep 11 03:49:55.526316 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.526295    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 03:49:55.527353 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.527317    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal","openshift-multus/multus-x8fvc","openshift-multus/network-metrics-daemon-nm7zn","openshift-network-diagnostics/network-check-target-hqtwx","kube-system/global-pull-secret-syncer-qbqz4","kube-system/konnectivity-agent-jhzkk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl","openshift-cluster-node-tuning-operator/tuned-qw5jr","openshift-image-registry/node-ca-625dw","openshift-multus/multus-additional-cni-plugins-wfnc5","openshift-network-operator/iptables-alerter-hvgjk","openshift-ovn-kubernetes/ovnkube-node-q7rfx","kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal","openshift-dns/node-resolver-9wpms"]
Sep 11 03:49:55.529914 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.529898    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:49:55.532028 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.532009    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.532315 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.532290    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 03:49:55.532402 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.532292    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 03:49:55.532402 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.532319    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gqkq8\""
Sep 11 03:49:55.534170 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.534152    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.534261 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.534229    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 03:49:55.534319 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.534288    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 03:49:55.534440 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.534425    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 03:49:55.534509 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.534497    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 03:49:55.534557 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.534523    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lxgqb\""
Sep 11 03:49:55.536156 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.536135    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 03:49:55.536257 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.536200    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gc9rn\""
Sep 11 03:49:55.536324 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.536272    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:49:55.536380 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.536362    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.537950 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.537934    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 03:49:55.538212 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.538196    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 03:49:55.538425 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.538410    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 03:49:55.538511 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.538497    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:49:55.538585 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.538564    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:49:55.538650 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.538583    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p9xjd\""
Sep 11 03:49:55.538706 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.538691    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 03:49:55.540753 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.540739    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:55.540802 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.540788    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:49:55.542921 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.542909    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:49:55.542977 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.542963    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:49:55.544152 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-lib-modules\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.544191 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544160    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72f25cb0-c85c-4220-99d1-1576de6c22e4-tmp\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.544191 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5qgw\" (UniqueName: \"kubernetes.io/projected/b36b012d-ba3b-4747-98e5-4fe69d1527ae-kube-api-access-p5qgw\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.544276 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:55.544276 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544209    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-run\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.544276 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.544407 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5ffdd30-c9e0-43bb-9dcd-1ac93623c991-konnectivity-ca\") pod \"konnectivity-agent-jhzkk\" (UID: \"a5ffdd30-c9e0-43bb-9dcd-1ac93623c991\") " pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:49:55.544407 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-cnibin\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.544407 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544325    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2f6b587-86ba-4d00-b50f-97d1da6ae108-cni-binary-copy\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.544407 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-run-netns\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.544407 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544371    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-conf-dir\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.544407 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-run-multus-certs\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.544407 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-sys\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.544719 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544425    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1aa676ca-bad6-45a7-8b9b-529c9bd74170-dbus\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:55.544719 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5ffdd30-c9e0-43bb-9dcd-1ac93623c991-agent-certs\") pod \"konnectivity-agent-jhzkk\" (UID: \"a5ffdd30-c9e0-43bb-9dcd-1ac93623c991\") " pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:49:55.544719 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-cni-dir\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.544719 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-socket-dir-parent\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.544719 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-var-lib-cni-bin\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.544719 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-var-lib-kubelet\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.544719 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544551    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhhd2\" (UniqueName: \"kubernetes.io/projected/b2f6b587-86ba-4d00-b50f-97d1da6ae108-kube-api-access-zhhd2\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.544719 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-sysctl-d\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.544719 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-sys-fs\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.544719 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-modprobe-d\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.544719 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-sysconfig\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544741    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-tuned\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544764    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx79c\" (UniqueName: \"kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c\") pod \"network-check-target-hqtwx\" (UID: \"c9fb5002-199e-4dee-8050-9173a2b1a076\") " pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544792    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1aa676ca-bad6-45a7-8b9b-529c9bd74170-kubelet-config\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-var-lib-cni-multus\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-daemon-config\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-host\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-run-k8s-cni-cncf-io\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-hostroot\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-sysctl-conf\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544978    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-systemd\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.544999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-var-lib-kubelet\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.545022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.545045    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-registration-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.545079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-device-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.545102    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-kubernetes\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.545160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.545125    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-625dw"
Sep 11 03:49:55.545701 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.545122    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crk55\" (UniqueName: \"kubernetes.io/projected/72f25cb0-c85c-4220-99d1-1576de6c22e4-kube-api-access-crk55\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.545701 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.545348    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-socket-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.545701 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.545375    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-system-cni-dir\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.545701 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.545426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-etc-kubernetes\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.547414 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.547365    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 03:49:55.547414 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.547401    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 03:49:55.547528 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.547484    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.547823 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.547649    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ghklm\""
Sep 11 03:49:55.547823 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.547716    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 03:49:55.549814 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.549800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hvgjk"
Sep 11 03:49:55.550225 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.550208    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 03:49:55.550298 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.550232    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 03:49:55.550298 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.550249    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v4qq8\""
Sep 11 03:49:55.552091 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.552073    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.552260 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.552076    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 03:49:55.553395 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.553242    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:49:55.553395 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.553276    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fdgwq\""
Sep 11 03:49:55.553545 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.553502    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 03:49:55.553545 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.553517    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 03:49:55.554962 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.554942    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9wpms"
Sep 11 03:49:55.555929 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.555915    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 03:49:55.556160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.556135    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l77nx\""
Sep 11 03:49:55.556222 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.556207    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 03:49:55.557027 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.556963    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 03:49:55.557027 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.557005    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 03:49:55.557027 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.557016    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 03:49:55.557354 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.557337    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 03:49:55.557466 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.557367    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 03:49:55.557588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.557574    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-75kvp\""
Sep 11 03:49:55.557660 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.557614    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 03:44:54 +0000 UTC" deadline="2028-02-19 01:42:38.214693971 +0000 UTC"
Sep 11 03:49:55.557660 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.557655    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12621h52m42.657042817s"
Sep 11 03:49:55.557741 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.557673    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 03:49:55.571067 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.571050    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v6wgg"
Sep 11 03:49:55.578792 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.578777    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v6wgg"
Sep 11 03:49:55.640236 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.640216    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 03:49:55.646240 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646209    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-modprobe-d\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.646349 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx79c\" (UniqueName: \"kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c\") pod \"network-check-target-hqtwx\" (UID: \"c9fb5002-199e-4dee-8050-9173a2b1a076\") " pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:49:55.646349 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b064e152-072d-42f9-b9bb-e59f02f831fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.646349 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646295    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c44dfb89-c6e2-4e01-a643-7203d29f827a-ovnkube-config\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.646349 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-host\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.646349 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646340    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-run-k8s-cni-cncf-io\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646349    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-modprobe-d\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c-host-slash\") pod \"iptables-alerter-hvgjk\" (UID: \"e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c\") " pod="openshift-network-operator/iptables-alerter-hvgjk"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-sysctl-conf\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646402    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-run-k8s-cni-cncf-io\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646410    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-host\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-systemd\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-registration-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646471    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-device-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-run-systemd\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-kubernetes\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646529    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-systemd\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-sysctl-conf\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crk55\" (UniqueName: \"kubernetes.io/projected/72f25cb0-c85c-4220-99d1-1576de6c22e4-kube-api-access-crk55\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.646588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646571    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-registration-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.647102 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646656    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-kubernetes\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.647102 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646663    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-device-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.647102 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.646813    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-socket-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.647293 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-socket-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.647293 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647155    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-etc-kubernetes\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.647293 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c-iptables-alerter-script\") pod \"iptables-alerter-hvgjk\" (UID: \"e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c\") " pod="openshift-network-operator/iptables-alerter-hvgjk"
Sep 11 03:49:55.647293 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647198    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n47fk\" (UniqueName: \"kubernetes.io/projected/80d22450-38cf-43aa-a876-056cb4fbb8ea-kube-api-access-n47fk\") pod \"node-resolver-9wpms\" (UID: \"80d22450-38cf-43aa-a876-056cb4fbb8ea\") " pod="openshift-dns/node-resolver-9wpms"
Sep 11 03:49:55.647293 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647217    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-lib-modules\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.647293 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647241    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-etc-kubernetes\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.647293 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5qgw\" (UniqueName: \"kubernetes.io/projected/b36b012d-ba3b-4747-98e5-4fe69d1527ae-kube-api-access-p5qgw\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.647293 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b064e152-072d-42f9-b9bb-e59f02f831fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647331    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-lib-modules\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-cni-netd\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647364    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-run\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.647402    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647421    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-run\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.647489    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret podName:1aa676ca-bad6-45a7-8b9b-529c9bd74170 nodeName:}" failed. No retries permitted until 2026-09-11 03:49:56.147457499 +0000 UTC m=+2.025649798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret") pod "global-pull-secret-syncer-qbqz4" (UID: "1aa676ca-bad6-45a7-8b9b-529c9bd74170") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-cnibin\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647518    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-run-netns\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647554    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-cnibin\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-etc-openvswitch\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647592    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5ffdd30-c9e0-43bb-9dcd-1ac93623c991-agent-certs\") pod \"konnectivity-agent-jhzkk\" (UID: \"a5ffdd30-c9e0-43bb-9dcd-1ac93623c991\") " pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647615    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-run-netns\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:49:55.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647673    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs9sb\" (UniqueName: \"kubernetes.io/projected/939a41d8-9275-4697-aed4-124c74dd8128-kube-api-access-zs9sb\") pod \"node-ca-625dw\" (UID: \"939a41d8-9275-4697-aed4-124c74dd8128\") " pod="openshift-image-registry/node-ca-625dw"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647688    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nb88\" (UniqueName: \"kubernetes.io/projected/e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c-kube-api-access-2nb88\") pod \"iptables-alerter-hvgjk\" (UID: \"e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c\") " pod="openshift-network-operator/iptables-alerter-hvgjk"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b064e152-072d-42f9-b9bb-e59f02f831fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-cni-bin\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647782    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwmxs\" (UniqueName: \"kubernetes.io/projected/c44dfb89-c6e2-4e01-a643-7203d29f827a-kube-api-access-lwmxs\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7plm\" (UniqueName: \"kubernetes.io/projected/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-kube-api-access-p7plm\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647820    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c44dfb89-c6e2-4e01-a643-7203d29f827a-ovn-node-metrics-cert\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-sysconfig\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647853    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-tuned\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1aa676ca-bad6-45a7-8b9b-529c9bd74170-kubelet-config\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-var-lib-cni-multus\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-daemon-config\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647926    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-sysconfig\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647926    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1aa676ca-bad6-45a7-8b9b-529c9bd74170-kubelet-config\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b064e152-072d-42f9-b9bb-e59f02f831fa-cnibin\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.648438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmfhj\" (UniqueName: \"kubernetes.io/projected/b064e152-072d-42f9-b9bb-e59f02f831fa-kube-api-access-bmfhj\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647958    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-var-lib-cni-multus\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-hostroot\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-slash\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.647984    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-hostroot\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c44dfb89-c6e2-4e01-a643-7203d29f827a-env-overrides\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-var-lib-kubelet\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/80d22450-38cf-43aa-a876-056cb4fbb8ea-hosts-file\") pod \"node-resolver-9wpms\" (UID: \"80d22450-38cf-43aa-a876-056cb4fbb8ea\") " pod="openshift-dns/node-resolver-9wpms"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-system-cni-dir\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648180    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/939a41d8-9275-4697-aed4-124c74dd8128-host\") pod \"node-ca-625dw\" (UID: \"939a41d8-9275-4697-aed4-124c74dd8128\") " pod="openshift-image-registry/node-ca-625dw"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648190    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-var-lib-kubelet\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/939a41d8-9275-4697-aed4-124c74dd8128-serviceca\") pod \"node-ca-625dw\" (UID: \"939a41d8-9275-4697-aed4-124c74dd8128\") " pod="openshift-image-registry/node-ca-625dw"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648255    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-system-cni-dir\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-kubelet\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-log-socket\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.649161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72f25cb0-c85c-4220-99d1-1576de6c22e4-tmp\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648386    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-daemon-config\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80d22450-38cf-43aa-a876-056cb4fbb8ea-tmp-dir\") pod \"node-resolver-9wpms\" (UID: \"80d22450-38cf-43aa-a876-056cb4fbb8ea\") " pod="openshift-dns/node-resolver-9wpms"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-systemd-units\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-run-netns\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-var-lib-openvswitch\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648495    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5ffdd30-c9e0-43bb-9dcd-1ac93623c991-konnectivity-ca\") pod \"konnectivity-agent-jhzkk\" (UID: \"a5ffdd30-c9e0-43bb-9dcd-1ac93623c991\") " pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2f6b587-86ba-4d00-b50f-97d1da6ae108-cni-binary-copy\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-conf-dir\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-run-multus-certs\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648640    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-conf-dir\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648678    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhhd2\" (UniqueName: \"kubernetes.io/projected/b2f6b587-86ba-4d00-b50f-97d1da6ae108-kube-api-access-zhhd2\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-run-ovn\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-run-multus-certs\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-node-log\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-sys\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1aa676ca-bad6-45a7-8b9b-529c9bd74170-dbus\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:55.649738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648796    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-cni-dir\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-socket-dir-parent\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-var-lib-cni-bin\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-var-lib-kubelet\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b064e152-072d-42f9-b9bb-e59f02f831fa-system-cni-dir\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c44dfb89-c6e2-4e01-a643-7203d29f827a-ovnkube-script-lib\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-sysctl-d\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-sys-fs\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648983    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5ffdd30-c9e0-43bb-9dcd-1ac93623c991-konnectivity-ca\") pod \"konnectivity-agent-jhzkk\" (UID: \"a5ffdd30-c9e0-43bb-9dcd-1ac93623c991\") " pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.648985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b064e152-072d-42f9-b9bb-e59f02f831fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.649031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-var-lib-kubelet\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.649035    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-run-openvswitch\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.649042    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2f6b587-86ba-4d00-b50f-97d1da6ae108-cni-binary-copy\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.649072    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-cni-dir\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.649082    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-multus-socket-dir-parent\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.649121    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-sys\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.649133    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1aa676ca-bad6-45a7-8b9b-529c9bd74170-dbus\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:55.650254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.649153    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2f6b587-86ba-4d00-b50f-97d1da6ae108-host-var-lib-cni-bin\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.650752 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.649161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b36b012d-ba3b-4747-98e5-4fe69d1527ae-sys-fs\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.650752 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.649233    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-sysctl-d\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.651275 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.651257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72f25cb0-c85c-4220-99d1-1576de6c22e4-tmp\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.651456 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.651439    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72f25cb0-c85c-4220-99d1-1576de6c22e4-etc-tuned\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.651748 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.651732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5ffdd30-c9e0-43bb-9dcd-1ac93623c991-agent-certs\") pod \"konnectivity-agent-jhzkk\" (UID: \"a5ffdd30-c9e0-43bb-9dcd-1ac93623c991\") " pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:49:55.656096 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.656074    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:49:55.656096 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.656098    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:49:55.656238 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.656107    2575 projected.go:196] Error preparing data for projected volume kube-api-access-qx79c for pod openshift-network-diagnostics/network-check-target-hqtwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:49:55.656238 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.656168    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c podName:c9fb5002-199e-4dee-8050-9173a2b1a076 nodeName:}" failed. No retries permitted until 2026-09-11 03:49:56.156149356 +0000 UTC m=+2.034341660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qx79c" (UniqueName: "kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c") pod "network-check-target-hqtwx" (UID: "c9fb5002-199e-4dee-8050-9173a2b1a076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:49:55.658838 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.658811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5qgw\" (UniqueName: \"kubernetes.io/projected/b36b012d-ba3b-4747-98e5-4fe69d1527ae-kube-api-access-p5qgw\") pod \"aws-ebs-csi-driver-node-mm7zl\" (UID: \"b36b012d-ba3b-4747-98e5-4fe69d1527ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.658967 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.658951    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crk55\" (UniqueName: \"kubernetes.io/projected/72f25cb0-c85c-4220-99d1-1576de6c22e4-kube-api-access-crk55\") pod \"tuned-qw5jr\" (UID: \"72f25cb0-c85c-4220-99d1-1576de6c22e4\") " pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.659274 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.659254    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhhd2\" (UniqueName: \"kubernetes.io/projected/b2f6b587-86ba-4d00-b50f-97d1da6ae108-kube-api-access-zhhd2\") pod \"multus-x8fvc\" (UID: \"b2f6b587-86ba-4d00-b50f-97d1da6ae108\") " pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.692416 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.692392    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:49:55.749268 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b064e152-072d-42f9-b9bb-e59f02f831fa-cnibin\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.749422 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmfhj\" (UniqueName: \"kubernetes.io/projected/b064e152-072d-42f9-b9bb-e59f02f831fa-kube-api-access-bmfhj\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.749422 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749292    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-slash\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749422 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749318    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c44dfb89-c6e2-4e01-a643-7203d29f827a-env-overrides\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749422 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/80d22450-38cf-43aa-a876-056cb4fbb8ea-hosts-file\") pod \"node-resolver-9wpms\" (UID: \"80d22450-38cf-43aa-a876-056cb4fbb8ea\") " pod="openshift-dns/node-resolver-9wpms"
Sep 11 03:49:55.749422 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749356    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b064e152-072d-42f9-b9bb-e59f02f831fa-cnibin\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.749422 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749365    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/939a41d8-9275-4697-aed4-124c74dd8128-host\") pod \"node-ca-625dw\" (UID: \"939a41d8-9275-4697-aed4-124c74dd8128\") " pod="openshift-image-registry/node-ca-625dw"
Sep 11 03:49:55.749422 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749369    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-slash\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749422 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/939a41d8-9275-4697-aed4-124c74dd8128-serviceca\") pod \"node-ca-625dw\" (UID: \"939a41d8-9275-4697-aed4-124c74dd8128\") " pod="openshift-image-registry/node-ca-625dw"
Sep 11 03:49:55.749422 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-kubelet\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749422 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749414    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/939a41d8-9275-4697-aed4-124c74dd8128-host\") pod \"node-ca-625dw\" (UID: \"939a41d8-9275-4697-aed4-124c74dd8128\") " pod="openshift-image-registry/node-ca-625dw"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-log-socket\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/80d22450-38cf-43aa-a876-056cb4fbb8ea-hosts-file\") pod \"node-resolver-9wpms\" (UID: \"80d22450-38cf-43aa-a876-056cb4fbb8ea\") " pod="openshift-dns/node-resolver-9wpms"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749455    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-kubelet\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749468    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-log-socket\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749565    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80d22450-38cf-43aa-a876-056cb4fbb8ea-tmp-dir\") pod \"node-resolver-9wpms\" (UID: \"80d22450-38cf-43aa-a876-056cb4fbb8ea\") " pod="openshift-dns/node-resolver-9wpms"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749572    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-systemd-units\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-run-netns\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-var-lib-openvswitch\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749658    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-systemd-units\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-run-ovn\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-run-netns\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-node-log\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b064e152-072d-42f9-b9bb-e59f02f831fa-system-cni-dir\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749735    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-run-ovn\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-var-lib-openvswitch\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.749923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-node-log\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749767    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b064e152-072d-42f9-b9bb-e59f02f831fa-system-cni-dir\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c44dfb89-c6e2-4e01-a643-7203d29f827a-ovnkube-script-lib\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749818    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b064e152-072d-42f9-b9bb-e59f02f831fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-run-openvswitch\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80d22450-38cf-43aa-a876-056cb4fbb8ea-tmp-dir\") pod \"node-resolver-9wpms\" (UID: \"80d22450-38cf-43aa-a876-056cb4fbb8ea\") " pod="openshift-dns/node-resolver-9wpms"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749853    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c44dfb89-c6e2-4e01-a643-7203d29f827a-env-overrides\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b064e152-072d-42f9-b9bb-e59f02f831fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-run-openvswitch\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c44dfb89-c6e2-4e01-a643-7203d29f827a-ovnkube-config\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749949    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c-host-slash\") pod \"iptables-alerter-hvgjk\" (UID: \"e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c\") " pod="openshift-network-operator/iptables-alerter-hvgjk"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749977    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b064e152-072d-42f9-b9bb-e59f02f831fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749920    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/939a41d8-9275-4697-aed4-124c74dd8128-serviceca\") pod \"node-ca-625dw\" (UID: \"939a41d8-9275-4697-aed4-124c74dd8128\") " pod="openshift-image-registry/node-ca-625dw"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.749977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-run-systemd\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750008    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-run-systemd\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750030    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c-host-slash\") pod \"iptables-alerter-hvgjk\" (UID: \"e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c\") " pod="openshift-network-operator/iptables-alerter-hvgjk"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c-iptables-alerter-script\") pod \"iptables-alerter-hvgjk\" (UID: \"e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c\") " pod="openshift-network-operator/iptables-alerter-hvgjk"
Sep 11 03:49:55.750770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750078    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n47fk\" (UniqueName: \"kubernetes.io/projected/80d22450-38cf-43aa-a876-056cb4fbb8ea-kube-api-access-n47fk\") pod \"node-resolver-9wpms\" (UID: \"80d22450-38cf-43aa-a876-056cb4fbb8ea\") " pod="openshift-dns/node-resolver-9wpms"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b064e152-072d-42f9-b9bb-e59f02f831fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-cni-netd\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750169    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-etc-openvswitch\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750194    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs9sb\" (UniqueName: \"kubernetes.io/projected/939a41d8-9275-4697-aed4-124c74dd8128-kube-api-access-zs9sb\") pod \"node-ca-625dw\" (UID: \"939a41d8-9275-4697-aed4-124c74dd8128\") " pod="openshift-image-registry/node-ca-625dw"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nb88\" (UniqueName: \"kubernetes.io/projected/e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c-kube-api-access-2nb88\") pod \"iptables-alerter-hvgjk\" (UID: \"e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c\") " pod="openshift-network-operator/iptables-alerter-hvgjk"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b064e152-072d-42f9-b9bb-e59f02f831fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-cni-bin\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwmxs\" (UniqueName: \"kubernetes.io/projected/c44dfb89-c6e2-4e01-a643-7203d29f827a-kube-api-access-lwmxs\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7plm\" (UniqueName: \"kubernetes.io/projected/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-kube-api-access-p7plm\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.750397    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c44dfb89-c6e2-4e01-a643-7203d29f827a-ovn-node-metrics-cert\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750416    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-cni-netd\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b064e152-072d-42f9-b9bb-e59f02f831fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.751337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750456    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-cni-bin\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751826 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.750464    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs podName:5dc15c92-4ed2-4ffd-8fa5-3081b380b439 nodeName:}" failed. No retries permitted until 2026-09-11 03:49:56.250445213 +0000 UTC m=+2.128637498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs") pod "network-metrics-daemon-nm7zn" (UID: "5dc15c92-4ed2-4ffd-8fa5-3081b380b439") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:49:55.751826 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c44dfb89-c6e2-4e01-a643-7203d29f827a-ovnkube-config\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751826 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750528    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-etc-openvswitch\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751826 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750538    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c-iptables-alerter-script\") pod \"iptables-alerter-hvgjk\" (UID: \"e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c\") " pod="openshift-network-operator/iptables-alerter-hvgjk"
Sep 11 03:49:55.751826 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c44dfb89-c6e2-4e01-a643-7203d29f827a-ovnkube-script-lib\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751826 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b064e152-072d-42f9-b9bb-e59f02f831fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.751826 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750815    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c44dfb89-c6e2-4e01-a643-7203d29f827a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.751826 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.750973    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b064e152-072d-42f9-b9bb-e59f02f831fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.753127 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.753109    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c44dfb89-c6e2-4e01-a643-7203d29f827a-ovn-node-metrics-cert\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.760812 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.760781    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7plm\" (UniqueName: \"kubernetes.io/projected/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-kube-api-access-p7plm\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:49:55.761003 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.760960    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nb88\" (UniqueName: \"kubernetes.io/projected/e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c-kube-api-access-2nb88\") pod \"iptables-alerter-hvgjk\" (UID: \"e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c\") " pod="openshift-network-operator/iptables-alerter-hvgjk"
Sep 11 03:49:55.761076 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.761015    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs9sb\" (UniqueName: \"kubernetes.io/projected/939a41d8-9275-4697-aed4-124c74dd8128-kube-api-access-zs9sb\") pod \"node-ca-625dw\" (UID: \"939a41d8-9275-4697-aed4-124c74dd8128\") " pod="openshift-image-registry/node-ca-625dw"
Sep 11 03:49:55.761348 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.761333    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n47fk\" (UniqueName: \"kubernetes.io/projected/80d22450-38cf-43aa-a876-056cb4fbb8ea-kube-api-access-n47fk\") pod \"node-resolver-9wpms\" (UID: \"80d22450-38cf-43aa-a876-056cb4fbb8ea\") " pod="openshift-dns/node-resolver-9wpms"
Sep 11 03:49:55.761391 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.761361    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmfhj\" (UniqueName: \"kubernetes.io/projected/b064e152-072d-42f9-b9bb-e59f02f831fa-kube-api-access-bmfhj\") pod \"multus-additional-cni-plugins-wfnc5\" (UID: \"b064e152-072d-42f9-b9bb-e59f02f831fa\") " pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.761595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.761576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwmxs\" (UniqueName: \"kubernetes.io/projected/c44dfb89-c6e2-4e01-a643-7203d29f827a-kube-api-access-lwmxs\") pod \"ovnkube-node-q7rfx\" (UID: \"c44dfb89-c6e2-4e01-a643-7203d29f827a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.793960 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:55.793935    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45521813523a4f1b7be2eda5037f0f36.slice/crio-3a6a2b2b78323f4739607980c9b6847461065677d32449c233e2c8340e95cde0 WatchSource:0}: Error finding container 3a6a2b2b78323f4739607980c9b6847461065677d32449c233e2c8340e95cde0: Status 404 returned error can't find the container with id 3a6a2b2b78323f4739607980c9b6847461065677d32449c233e2c8340e95cde0
Sep 11 03:49:55.799789 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.799770    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 03:49:55.859227 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.859152    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:49:55.869673 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:55.869640    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ffdd30_c9e0_43bb_9dcd_1ac93623c991.slice/crio-60862063c118111c11b90f5ed2de0be562015607b134c91d04db5903efe2c450 WatchSource:0}: Error finding container 60862063c118111c11b90f5ed2de0be562015607b134c91d04db5903efe2c450: Status 404 returned error can't find the container with id 60862063c118111c11b90f5ed2de0be562015607b134c91d04db5903efe2c450
Sep 11 03:49:55.884161 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.884142    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8fvc"
Sep 11 03:49:55.892836 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:55.892816    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f6b587_86ba_4d00_b50f_97d1da6ae108.slice/crio-2c1f3e72fdcdddcb345dbcef1e6848666047b6c57994b9b1e899c8e3a48fd5c2 WatchSource:0}: Error finding container 2c1f3e72fdcdddcb345dbcef1e6848666047b6c57994b9b1e899c8e3a48fd5c2: Status 404 returned error can't find the container with id 2c1f3e72fdcdddcb345dbcef1e6848666047b6c57994b9b1e899c8e3a48fd5c2
Sep 11 03:49:55.898695 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.898679    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qw5jr"
Sep 11 03:49:55.906088 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:55.906069    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f25cb0_c85c_4220_99d1_1576de6c22e4.slice/crio-c55256b3ece54270a7dd88086c348290c4602432409a168435efcc5002905363 WatchSource:0}: Error finding container c55256b3ece54270a7dd88086c348290c4602432409a168435efcc5002905363: Status 404 returned error can't find the container with id c55256b3ece54270a7dd88086c348290c4602432409a168435efcc5002905363
Sep 11 03:49:55.908336 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.908318    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl"
Sep 11 03:49:55.915982 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:55.915961    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36b012d_ba3b_4747_98e5_4fe69d1527ae.slice/crio-e833f94f52f5ec534937d429a4f8ccea6655cc9ffc62fbb139ac6dcc20f91b9b WatchSource:0}: Error finding container e833f94f52f5ec534937d429a4f8ccea6655cc9ffc62fbb139ac6dcc20f91b9b: Status 404 returned error can't find the container with id e833f94f52f5ec534937d429a4f8ccea6655cc9ffc62fbb139ac6dcc20f91b9b
Sep 11 03:49:55.921987 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.921967    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-625dw"
Sep 11 03:49:55.933859 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:55.933834    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939a41d8_9275_4697_aed4_124c74dd8128.slice/crio-ab25e6df8f977507b5d828809f6a81b7d7737f25cb865eeed9bfb5442fef5b6e WatchSource:0}: Error finding container ab25e6df8f977507b5d828809f6a81b7d7737f25cb865eeed9bfb5442fef5b6e: Status 404 returned error can't find the container with id ab25e6df8f977507b5d828809f6a81b7d7737f25cb865eeed9bfb5442fef5b6e
Sep 11 03:49:55.933971 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.933948    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wfnc5"
Sep 11 03:49:55.940888 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.940741    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hvgjk"
Sep 11 03:49:55.942061 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:55.942039    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb064e152_072d_42f9_b9bb_e59f02f831fa.slice/crio-c9ed98d006caa6e0be8b09b8b20acb7e23cc984417ce6dba03b069ec11b0dd00 WatchSource:0}: Error finding container c9ed98d006caa6e0be8b09b8b20acb7e23cc984417ce6dba03b069ec11b0dd00: Status 404 returned error can't find the container with id c9ed98d006caa6e0be8b09b8b20acb7e23cc984417ce6dba03b069ec11b0dd00
Sep 11 03:49:55.949273 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:55.949241    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d3584e_403b_4c20_8cb2_8f9c2fd7dc6c.slice/crio-a6081b8ecbe925376472baf92bfa10fa6b0a77eb65938c87f363f3f636eca394 WatchSource:0}: Error finding container a6081b8ecbe925376472baf92bfa10fa6b0a77eb65938c87f363f3f636eca394: Status 404 returned error can't find the container with id a6081b8ecbe925376472baf92bfa10fa6b0a77eb65938c87f363f3f636eca394
Sep 11 03:49:55.954301 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.954285    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:49:55.963461 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:55.963443    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44dfb89_c6e2_4e01_a643_7203d29f827a.slice/crio-2f16fd3c62f06fad53f22851f15ce90b951e69cd486d9fa6a321f6db3db6a738 WatchSource:0}: Error finding container 2f16fd3c62f06fad53f22851f15ce90b951e69cd486d9fa6a321f6db3db6a738: Status 404 returned error can't find the container with id 2f16fd3c62f06fad53f22851f15ce90b951e69cd486d9fa6a321f6db3db6a738
Sep 11 03:49:55.969642 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:55.969623    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9wpms"
Sep 11 03:49:55.978882 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:49:55.978857    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d22450_38cf_43aa_a876_056cb4fbb8ea.slice/crio-3014b6abbef3ea92f7ac599c7226cec9dc07977cd90b83a4797ebca6f29d042e WatchSource:0}: Error finding container 3014b6abbef3ea92f7ac599c7226cec9dc07977cd90b83a4797ebca6f29d042e: Status 404 returned error can't find the container with id 3014b6abbef3ea92f7ac599c7226cec9dc07977cd90b83a4797ebca6f29d042e
Sep 11 03:49:55.980535 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.980513    2575 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-9wpms_openshift-dns(80d22450-38cf-43aa-a876-056cb4fbb8ea): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Sep 11 03:49:55.980611 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:55.980550    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-9wpms" podUID="80d22450-38cf-43aa-a876-056cb4fbb8ea"
Sep 11 03:49:56.153314 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.153219    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:56.153475 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:56.153344    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:49:56.153475 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:56.153416    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret podName:1aa676ca-bad6-45a7-8b9b-529c9bd74170 nodeName:}" failed. No retries permitted until 2026-09-11 03:49:57.153396865 +0000 UTC m=+3.031589165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret") pod "global-pull-secret-syncer-qbqz4" (UID: "1aa676ca-bad6-45a7-8b9b-529c9bd74170") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:49:56.254292 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.254243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:49:56.254461 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.254341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx79c\" (UniqueName: \"kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c\") pod \"network-check-target-hqtwx\" (UID: \"c9fb5002-199e-4dee-8050-9173a2b1a076\") " pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:49:56.254461 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:56.254414    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:49:56.254568 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:56.254478    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:49:56.254568 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:56.254497    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs podName:5dc15c92-4ed2-4ffd-8fa5-3081b380b439 nodeName:}" failed. No retries permitted until 2026-09-11 03:49:57.254473704 +0000 UTC m=+3.132665987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs") pod "network-metrics-daemon-nm7zn" (UID: "5dc15c92-4ed2-4ffd-8fa5-3081b380b439") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:49:56.254568 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:56.254500    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:49:56.254568 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:56.254519    2575 projected.go:196] Error preparing data for projected volume kube-api-access-qx79c for pod openshift-network-diagnostics/network-check-target-hqtwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:49:56.254790 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:56.254571    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c podName:c9fb5002-199e-4dee-8050-9173a2b1a076 nodeName:}" failed. No retries permitted until 2026-09-11 03:49:57.254554229 +0000 UTC m=+3.132746515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx79c" (UniqueName: "kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c") pod "network-check-target-hqtwx" (UID: "c9fb5002-199e-4dee-8050-9173a2b1a076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:49:56.521796 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.521670    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:49:56.582281 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.582149    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 03:44:55 +0000 UTC" deadline="2028-04-12 04:33:17.01224292 +0000 UTC"
Sep 11 03:49:56.582281 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.582218    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13896h43m20.430029445s"
Sep 11 03:49:56.639353 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.639185    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx" event={"ID":"c44dfb89-c6e2-4e01-a643-7203d29f827a","Type":"ContainerStarted","Data":"2f16fd3c62f06fad53f22851f15ce90b951e69cd486d9fa6a321f6db3db6a738"}
Sep 11 03:49:56.642797 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.642763    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hvgjk" event={"ID":"e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c","Type":"ContainerStarted","Data":"a6081b8ecbe925376472baf92bfa10fa6b0a77eb65938c87f363f3f636eca394"}
Sep 11 03:49:56.652016 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.651917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfnc5" event={"ID":"b064e152-072d-42f9-b9bb-e59f02f831fa","Type":"ContainerStarted","Data":"c9ed98d006caa6e0be8b09b8b20acb7e23cc984417ce6dba03b069ec11b0dd00"}
Sep 11 03:49:56.661390 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.661291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-625dw" event={"ID":"939a41d8-9275-4697-aed4-124c74dd8128","Type":"ContainerStarted","Data":"ab25e6df8f977507b5d828809f6a81b7d7737f25cb865eeed9bfb5442fef5b6e"}
Sep 11 03:49:56.678432 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.678246    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jhzkk" event={"ID":"a5ffdd30-c9e0-43bb-9dcd-1ac93623c991","Type":"ContainerStarted","Data":"60862063c118111c11b90f5ed2de0be562015607b134c91d04db5903efe2c450"}
Sep 11 03:49:56.699446 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.699378    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" event={"ID":"45521813523a4f1b7be2eda5037f0f36","Type":"ContainerStarted","Data":"3a6a2b2b78323f4739607980c9b6847461065677d32449c233e2c8340e95cde0"}
Sep 11 03:49:56.702918 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.702787    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" event={"ID":"70d048848a0525d7e0db136ea4e57369","Type":"ContainerStarted","Data":"f8e1fac432590d0ccb5888e4bfbded6f96a894ada6ce8bcdfb29a0518036b12d"}
Sep 11 03:49:56.718522 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.718488    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9wpms" event={"ID":"80d22450-38cf-43aa-a876-056cb4fbb8ea","Type":"ContainerStarted","Data":"3014b6abbef3ea92f7ac599c7226cec9dc07977cd90b83a4797ebca6f29d042e"}
Sep 11 03:49:56.723023 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:56.722805    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0444a9580f430c7c6b52f78667a80a82198c825805f1f2004fdfdf9aed2b95f5\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-9wpms" podUID="80d22450-38cf-43aa-a876-056cb4fbb8ea"
Sep 11 03:49:56.745351 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.745313    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl" event={"ID":"b36b012d-ba3b-4747-98e5-4fe69d1527ae","Type":"ContainerStarted","Data":"e833f94f52f5ec534937d429a4f8ccea6655cc9ffc62fbb139ac6dcc20f91b9b"}
Sep 11 03:49:56.750956 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.750914    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qw5jr" event={"ID":"72f25cb0-c85c-4220-99d1-1576de6c22e4","Type":"ContainerStarted","Data":"c55256b3ece54270a7dd88086c348290c4602432409a168435efcc5002905363"}
Sep 11 03:49:56.754810 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:56.754782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8fvc" event={"ID":"b2f6b587-86ba-4d00-b50f-97d1da6ae108","Type":"ContainerStarted","Data":"2c1f3e72fdcdddcb345dbcef1e6848666047b6c57994b9b1e899c8e3a48fd5c2"}
Sep 11 03:49:57.164794 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:57.161937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:57.164794 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:57.162116    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:49:57.164794 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:57.162186    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret podName:1aa676ca-bad6-45a7-8b9b-529c9bd74170 nodeName:}" failed. No retries permitted until 2026-09-11 03:49:59.162167909 +0000 UTC m=+5.040360194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret") pod "global-pull-secret-syncer-qbqz4" (UID: "1aa676ca-bad6-45a7-8b9b-529c9bd74170") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:49:57.262443 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:57.262402    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:49:57.262643 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:57.262478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx79c\" (UniqueName: \"kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c\") pod \"network-check-target-hqtwx\" (UID: \"c9fb5002-199e-4dee-8050-9173a2b1a076\") " pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:49:57.262643 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:57.262616    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:49:57.262800 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:57.262660    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:49:57.262800 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:57.262674    2575 projected.go:196] Error preparing data for projected volume kube-api-access-qx79c for pod openshift-network-diagnostics/network-check-target-hqtwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:49:57.262800 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:57.262742    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c podName:c9fb5002-199e-4dee-8050-9173a2b1a076 nodeName:}" failed. No retries permitted until 2026-09-11 03:49:59.262720488 +0000 UTC m=+5.140912791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx79c" (UniqueName: "kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c") pod "network-check-target-hqtwx" (UID: "c9fb5002-199e-4dee-8050-9173a2b1a076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:49:57.263237 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:57.263212    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:49:57.263343 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:57.263275    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs podName:5dc15c92-4ed2-4ffd-8fa5-3081b380b439 nodeName:}" failed. No retries permitted until 2026-09-11 03:49:59.263259905 +0000 UTC m=+5.141452202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs") pod "network-metrics-daemon-nm7zn" (UID: "5dc15c92-4ed2-4ffd-8fa5-3081b380b439") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:49:57.492438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:57.491043    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:49:57.583291 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:57.583240    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 03:44:55 +0000 UTC" deadline="2028-03-18 14:19:12.225545171 +0000 UTC"
Sep 11 03:49:57.583291 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:57.583286    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13306h29m14.642264622s"
Sep 11 03:49:57.627009 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:57.626908    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:49:57.627215 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:57.627043    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:49:57.627816 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:57.627475    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:57.627816 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:57.627579    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:49:57.627816 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:57.627656    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:49:57.627816 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:57.627759    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:49:58.636635 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:58.636346    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 03:49:59.177071 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:59.177031    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:59.177246 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:59.177190    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:49:59.177301 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:59.177250    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret podName:1aa676ca-bad6-45a7-8b9b-529c9bd74170 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:03.177232093 +0000 UTC m=+9.055424392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret") pod "global-pull-secret-syncer-qbqz4" (UID: "1aa676ca-bad6-45a7-8b9b-529c9bd74170") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:49:59.278065 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:59.278029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx79c\" (UniqueName: \"kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c\") pod \"network-check-target-hqtwx\" (UID: \"c9fb5002-199e-4dee-8050-9173a2b1a076\") " pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:49:59.278245 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:59.278100    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:49:59.278245 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:59.278221    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:49:59.278341 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:59.278279    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs podName:5dc15c92-4ed2-4ffd-8fa5-3081b380b439 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:03.278261538 +0000 UTC m=+9.156453831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs") pod "network-metrics-daemon-nm7zn" (UID: "5dc15c92-4ed2-4ffd-8fa5-3081b380b439") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:49:59.278704 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:59.278683    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:49:59.278798 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:59.278709    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:49:59.278798 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:59.278722    2575 projected.go:196] Error preparing data for projected volume kube-api-access-qx79c for pod openshift-network-diagnostics/network-check-target-hqtwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:49:59.278798 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:59.278765    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c podName:c9fb5002-199e-4dee-8050-9173a2b1a076 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:03.278751571 +0000 UTC m=+9.156943855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx79c" (UniqueName: "kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c") pod "network-check-target-hqtwx" (UID: "c9fb5002-199e-4dee-8050-9173a2b1a076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:49:59.627063 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:59.626985    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:49:59.627218 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:59.627116    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:49:59.627478 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:59.627455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:49:59.627562 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:59.627548    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:49:59.627627 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:49:59.627593    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:49:59.627705 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:49:59.627686    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:01.626403 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:01.626369    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:01.626907 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:01.626514    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:01.626907 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:01.626672    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:01.626907 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:01.626757    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:01.626907 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:01.626804    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:01.626907 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:01.626880    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:03.211210 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:03.211162    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:03.211810 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:03.211290    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:50:03.211810 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:03.211364    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret podName:1aa676ca-bad6-45a7-8b9b-529c9bd74170 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:11.211342246 +0000 UTC m=+17.089534544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret") pod "global-pull-secret-syncer-qbqz4" (UID: "1aa676ca-bad6-45a7-8b9b-529c9bd74170") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:50:03.312286 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:03.312200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx79c\" (UniqueName: \"kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c\") pod \"network-check-target-hqtwx\" (UID: \"c9fb5002-199e-4dee-8050-9173a2b1a076\") " pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:03.312418 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:03.312289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:03.312418 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:03.312374    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:50:03.312418 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:03.312400    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:50:03.312418 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:03.312400    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:50:03.312418 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:03.312413    2575 projected.go:196] Error preparing data for projected volume kube-api-access-qx79c for pod openshift-network-diagnostics/network-check-target-hqtwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:50:03.312617 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:03.312471    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs podName:5dc15c92-4ed2-4ffd-8fa5-3081b380b439 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:11.312452112 +0000 UTC m=+17.190644394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs") pod "network-metrics-daemon-nm7zn" (UID: "5dc15c92-4ed2-4ffd-8fa5-3081b380b439") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:50:03.312617 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:03.312491    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c podName:c9fb5002-199e-4dee-8050-9173a2b1a076 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:11.312479764 +0000 UTC m=+17.190672047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx79c" (UniqueName: "kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c") pod "network-check-target-hqtwx" (UID: "c9fb5002-199e-4dee-8050-9173a2b1a076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:50:03.626879 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:03.626480    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:03.626879 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:03.626624    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:03.626879 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:03.626634    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:03.626879 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:03.626657    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:03.626879 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:03.626728    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:03.626879 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:03.626796    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:05.626239 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:05.626175    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:05.626721 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:05.626310    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:05.626721 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:05.626380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:05.626721 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:05.626471    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:05.626721 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:05.626509    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:05.626721 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:05.626584    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:07.626863 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:07.626808    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:07.627342 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:07.626811    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:07.627342 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:07.626929    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:07.627342 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:07.626811    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:07.627342 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:07.626994    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:07.627342 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:07.627097    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:09.626825 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:09.626793    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:09.626825 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:09.626819    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:09.627266 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:09.626793    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:09.627266 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:09.626919    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:09.627266 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:09.627001    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:09.627266 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:09.627071    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:11.269825 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:11.269745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:11.270231 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:11.269880    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:50:11.270231 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:11.269941    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret podName:1aa676ca-bad6-45a7-8b9b-529c9bd74170 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:27.26992192 +0000 UTC m=+33.148114215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret") pod "global-pull-secret-syncer-qbqz4" (UID: "1aa676ca-bad6-45a7-8b9b-529c9bd74170") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:50:11.370246 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:11.370215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:11.370408 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:11.370277    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx79c\" (UniqueName: \"kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c\") pod \"network-check-target-hqtwx\" (UID: \"c9fb5002-199e-4dee-8050-9173a2b1a076\") " pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:11.370408 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:11.370378    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:50:11.370509 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:11.370435    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:50:11.370509 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:11.370448    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs podName:5dc15c92-4ed2-4ffd-8fa5-3081b380b439 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:27.370427314 +0000 UTC m=+33.248619596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs") pod "network-metrics-daemon-nm7zn" (UID: "5dc15c92-4ed2-4ffd-8fa5-3081b380b439") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:50:11.370509 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:11.370450    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:50:11.370509 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:11.370468    2575 projected.go:196] Error preparing data for projected volume kube-api-access-qx79c for pod openshift-network-diagnostics/network-check-target-hqtwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:50:11.370735 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:11.370518    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c podName:c9fb5002-199e-4dee-8050-9173a2b1a076 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:27.370505708 +0000 UTC m=+33.248697991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx79c" (UniqueName: "kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c") pod "network-check-target-hqtwx" (UID: "c9fb5002-199e-4dee-8050-9173a2b1a076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:50:11.626624 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:11.626530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:11.626624 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:11.626530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:11.626868 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:11.626695    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:11.626868 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:11.626725    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:11.626868 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:11.626530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:11.626868 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:11.626825    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:13.626472 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:13.626436    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:13.626969 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:13.626453    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:13.626969 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:13.626557    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:13.626969 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:13.626639    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:13.626969 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:13.626453    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:13.626969 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:13.626719    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:15.626321 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.626153    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:15.626807 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.626169    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:15.626807 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:15.626399    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:15.626807 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:15.626518    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:15.626807 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.626211    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:15.626807 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:15.626669    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:15.805769 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.805536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx" event={"ID":"c44dfb89-c6e2-4e01-a643-7203d29f827a","Type":"ContainerStarted","Data":"3719f32121cfd038ef9164d5f39c26ce96f5abd0a1a4c8bd8598b50637441558"}
Sep 11 03:50:15.805894 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.805868    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx" event={"ID":"c44dfb89-c6e2-4e01-a643-7203d29f827a","Type":"ContainerStarted","Data":"f11e162dc42320fbc1c44773633ba4ae74eb79b260303660e298250f5c20ec59"}
Sep 11 03:50:15.805952 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.805910    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx" event={"ID":"c44dfb89-c6e2-4e01-a643-7203d29f827a","Type":"ContainerStarted","Data":"66b4791e3fa49ee57ffb9a5e5d6e847dbc7f14ae7d3352c70ac08f5e9f4e2c83"}
Sep 11 03:50:15.806001 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.805956    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx" event={"ID":"c44dfb89-c6e2-4e01-a643-7203d29f827a","Type":"ContainerStarted","Data":"38816a0ae69feaefbf33d6ac90f49c9ee0d75dba372fa9c8f727cf51810ce9a1"}
Sep 11 03:50:15.807039 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.807015    2575 generic.go:356] "Generic (PLEG): container finished" podID="b064e152-072d-42f9-b9bb-e59f02f831fa" containerID="b6bd6ec77bc384196f2c9c6dcfcea947edf6bad539344f72e649ca7f749cec1d" exitCode=0
Sep 11 03:50:15.807142 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.807082    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfnc5" event={"ID":"b064e152-072d-42f9-b9bb-e59f02f831fa","Type":"ContainerDied","Data":"b6bd6ec77bc384196f2c9c6dcfcea947edf6bad539344f72e649ca7f749cec1d"}
Sep 11 03:50:15.808825 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.808788    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-625dw" event={"ID":"939a41d8-9275-4697-aed4-124c74dd8128","Type":"ContainerStarted","Data":"942e68f78d892273718b3fedadc53f2bfe442461c0ae41ab5c409ebbe734057a"}
Sep 11 03:50:15.810329 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.810308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jhzkk" event={"ID":"a5ffdd30-c9e0-43bb-9dcd-1ac93623c991","Type":"ContainerStarted","Data":"ce86bb9d5972eb90b6a425195c3d28aa1320a55964fa596c6e4a256d74a77efc"}
Sep 11 03:50:15.811743 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.811723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" event={"ID":"45521813523a4f1b7be2eda5037f0f36","Type":"ContainerStarted","Data":"5c012faf8d3ed9e692f9e782df1ae75e1488007440ba06bcc3f872f995caf741"}
Sep 11 03:50:15.813126 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.813103    2575 generic.go:356] "Generic (PLEG): container finished" podID="70d048848a0525d7e0db136ea4e57369" containerID="a9d3ef2ab44bda1321699d7a22fb2ecf7be29b151ab17767224b2e721c51c3f7" exitCode=0
Sep 11 03:50:15.813211 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.813167    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" event={"ID":"70d048848a0525d7e0db136ea4e57369","Type":"ContainerDied","Data":"a9d3ef2ab44bda1321699d7a22fb2ecf7be29b151ab17767224b2e721c51c3f7"}
Sep 11 03:50:15.814404 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.814386    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9wpms" event={"ID":"80d22450-38cf-43aa-a876-056cb4fbb8ea","Type":"ContainerStarted","Data":"a78a16c8e9152661778e4943cc8991c756fb6ec68c66943602cd49d07eb1cc35"}
Sep 11 03:50:15.817029 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.817001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl" event={"ID":"b36b012d-ba3b-4747-98e5-4fe69d1527ae","Type":"ContainerStarted","Data":"ff82e4df3a176eedf943725cbe951c9b62b44ac16fe17164a32e7266a7877a81"}
Sep 11 03:50:15.819320 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.819293    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qw5jr" event={"ID":"72f25cb0-c85c-4220-99d1-1576de6c22e4","Type":"ContainerStarted","Data":"c46dd5eaa2afc9851177e95d406d37745e4e1afbbe3b8cfbe6aef00cbb7c3551"}
Sep 11 03:50:15.820914 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.820892    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8fvc" event={"ID":"b2f6b587-86ba-4d00-b50f-97d1da6ae108","Type":"ContainerStarted","Data":"186e6b05f8cdea7084d92517bb6243ddbc7a2f8ff00e70e68efa00b43598634b"}
Sep 11 03:50:15.836985 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.836931    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-625dw" podStartSLOduration=1.593390811 podStartE2EDuration="20.836914103s" totalImagesPullingTime="19.243523292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:15.836424056 +0000 UTC m=+21.714616360" watchObservedRunningTime="2026-09-11 03:50:15.836914103 +0000 UTC m=+21.715106406"
Sep 11 03:50:15.849290 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.849247    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9wpms" podStartSLOduration=1.549410758 podStartE2EDuration="20.849234727s" totalImagesPullingTime="19.299823969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-11 03:50:15.848856957 +0000 UTC m=+21.727049260" watchObservedRunningTime="2026-09-11 03:50:15.849234727 +0000 UTC m=+21.727427029"
Sep 11 03:50:15.906353 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.906310    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-70.ec2.internal" podStartSLOduration=20.906295091 podStartE2EDuration="20.906295091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:15.872720013 +0000 UTC m=+21.750912314" watchObservedRunningTime="2026-09-11 03:50:15.906295091 +0000 UTC m=+21.784487392"
Sep 11 03:50:15.906492 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.906464    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x8fvc" podStartSLOduration=2.527014402 podStartE2EDuration="21.906453781s" totalImagesPullingTime="19.379439379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:15.905912815 +0000 UTC m=+21.784105118" watchObservedRunningTime="2026-09-11 03:50:15.906453781 +0000 UTC m=+21.784646084"
Sep 11 03:50:15.922293 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.922251    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qw5jr" podStartSLOduration=2.698366764 podStartE2EDuration="21.922237172s" totalImagesPullingTime="19.223870408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:15.922001421 +0000 UTC m=+21.800193723" watchObservedRunningTime="2026-09-11 03:50:15.922237172 +0000 UTC m=+21.800429474"
Sep 11 03:50:15.935376 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:15.935342    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jhzkk" podStartSLOduration=2.6747497 podStartE2EDuration="21.935328523s" totalImagesPullingTime="19.260578823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:15.935239296 +0000 UTC m=+21.813431599" watchObservedRunningTime="2026-09-11 03:50:15.935328523 +0000 UTC m=+21.813520825"
Sep 11 03:50:16.829139 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:16.829107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx" event={"ID":"c44dfb89-c6e2-4e01-a643-7203d29f827a","Type":"ContainerStarted","Data":"02c6bb6ace24c5fe3225f08e0f863970be65164cb6803182cde8835e58d6bd84"}
Sep 11 03:50:16.830043 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:16.829229    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx" event={"ID":"c44dfb89-c6e2-4e01-a643-7203d29f827a","Type":"ContainerStarted","Data":"e0feff16cc3749d60cf189708fa9ea1ee229da1548882acd7a405f0e4d5f1ace"}
Sep 11 03:50:16.831733 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:16.831648    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hvgjk" event={"ID":"e4d3584e-403b-4c20-8cb2-8f9c2fd7dc6c","Type":"ContainerStarted","Data":"d516147884e4ab7d9f84fe84542934399f184f75467996ea4f7b559ef0654aac"}
Sep 11 03:50:16.846028 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:16.845991    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hvgjk" podStartSLOduration=2.619338877 podStartE2EDuration="21.845976042s" totalImagesPullingTime="19.226637165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:16.845760536 +0000 UTC m=+22.723952839" watchObservedRunningTime="2026-09-11 03:50:16.845976042 +0000 UTC m=+22.724168347"
Sep 11 03:50:17.386394 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:17.386369    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 03:50:17.610111 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:17.609755    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T03:50:17.386389802Z","UUID":"988a8eea-8113-4d9a-93c0-b01deeac9fa0","Handler":null,"Name":"","Endpoint":""}
Sep 11 03:50:17.611288 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:17.611264    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 03:50:17.611397 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:17.611293    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 03:50:17.627113 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:17.627087    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:17.627113 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:17.627104    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:17.627280 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:17.627186    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:17.627280 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:17.627096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:17.627398 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:17.627275    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:17.627398 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:17.627378    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:17.756968 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:17.756931    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:50:17.835844 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:17.835804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" event={"ID":"70d048848a0525d7e0db136ea4e57369","Type":"ContainerStarted","Data":"3baf0245703c79b51d0f66bd5d7b725e11ab3f962fb042c6b25e8312f21d5aad"}
Sep 11 03:50:17.837923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:17.837897    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl" event={"ID":"b36b012d-ba3b-4747-98e5-4fe69d1527ae","Type":"ContainerStarted","Data":"2ed73119d5b3aac9af79aad1600b44430178bb7a10d0c560743568928832e403"}
Sep 11 03:50:17.851529 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:17.851490    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-70.ec2.internal" podStartSLOduration=22.851475038 podStartE2EDuration="22.851475038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:17.851432535 +0000 UTC m=+23.729624838" watchObservedRunningTime="2026-09-11 03:50:17.851475038 +0000 UTC m=+23.729667341"
Sep 11 03:50:18.843455 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:18.843429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx" event={"ID":"c44dfb89-c6e2-4e01-a643-7203d29f827a","Type":"ContainerStarted","Data":"d71fa9370dd8241e98c7bfe822e704a57fd4c9af9aa2d75add60026d3a338001"}
Sep 11 03:50:18.845290 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:18.845269    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl" event={"ID":"b36b012d-ba3b-4747-98e5-4fe69d1527ae","Type":"ContainerStarted","Data":"0c7ff9ef377c3324aa153a12fbabdc5c660c288d07ef3109efb4208b093de0ff"}
Sep 11 03:50:18.866292 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:18.864246    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm7zl" podStartSLOduration=2.719859666 podStartE2EDuration="24.864198526s" totalImagesPullingTime="22.14433886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:49:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:18.863171454 +0000 UTC m=+24.741363755" watchObservedRunningTime="2026-09-11 03:50:18.864198526 +0000 UTC m=+24.742390830"
Sep 11 03:50:19.627012 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:19.626976    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:19.627227 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:19.626980    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:19.627227 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:19.627095    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:19.627227 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:19.627169    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:19.627227 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:19.626985    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:19.627425 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:19.627269    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:20.617448 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:20.617421    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:50:20.618040 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:20.618023    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:50:20.853540 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:20.853334    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx" event={"ID":"c44dfb89-c6e2-4e01-a643-7203d29f827a","Type":"ContainerStarted","Data":"d006e73726eb9c364c72373dab6c5f3a05e8cb6c48d60c8cfb5b9af23680ddf5"}
Sep 11 03:50:20.853676 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:20.853620    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:50:20.855363 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:20.855337    2575 generic.go:356] "Generic (PLEG): container finished" podID="b064e152-072d-42f9-b9bb-e59f02f831fa" containerID="eaa7c5838383475f26a8aa46218e5d01618f57b33e8199b54e9482a8d1067ee6" exitCode=0
Sep 11 03:50:20.855478 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:20.855427    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfnc5" event={"ID":"b064e152-072d-42f9-b9bb-e59f02f831fa","Type":"ContainerDied","Data":"eaa7c5838383475f26a8aa46218e5d01618f57b33e8199b54e9482a8d1067ee6"}
Sep 11 03:50:20.856097 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:20.856073    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jhzkk"
Sep 11 03:50:20.868520 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:20.868502    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:50:20.874961 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:20.874921    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx" podStartSLOduration=6.527808925 podStartE2EDuration="25.874906207s" totalImagesPullingTime="19.347097282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:20.87437864 +0000 UTC m=+26.752570942" watchObservedRunningTime="2026-09-11 03:50:20.874906207 +0000 UTC m=+26.753098517"
Sep 11 03:50:21.626107 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:21.626073    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:21.626574 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:21.626074    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:21.626574 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:21.626178    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:21.626574 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:21.626299    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:21.626574 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:21.626074    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:21.626574 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:21.626402    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:21.858039 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:21.858014    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:50:21.858205 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:21.858090    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:50:21.872776 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:21.872752    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:50:22.395456 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:22.395425    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hqtwx"]
Sep 11 03:50:22.395636 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:22.395543    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:22.395708 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:22.395682    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:22.398636 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:22.398582    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qbqz4"]
Sep 11 03:50:22.398800 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:22.398785    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:22.398905 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:22.398886    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:22.399374 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:22.399354    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nm7zn"]
Sep 11 03:50:22.399457 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:22.399445    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:22.399587 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:22.399548    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:22.861456 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:22.861422    2575 generic.go:356] "Generic (PLEG): container finished" podID="b064e152-072d-42f9-b9bb-e59f02f831fa" containerID="cee2b7a07dcc760fb6f50182d206040f2b186db2ad241add4f96616946c7c1d0" exitCode=0
Sep 11 03:50:22.862023 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:22.861506    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfnc5" event={"ID":"b064e152-072d-42f9-b9bb-e59f02f831fa","Type":"ContainerDied","Data":"cee2b7a07dcc760fb6f50182d206040f2b186db2ad241add4f96616946c7c1d0"}
Sep 11 03:50:23.626732 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:23.626698    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:23.626908 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:23.626820    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:23.626908 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:23.626875    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:23.627045 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:23.627024    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:24.627192 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:24.627166    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:24.627722 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:24.627268    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:24.868587 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:24.868515    2575 generic.go:356] "Generic (PLEG): container finished" podID="b064e152-072d-42f9-b9bb-e59f02f831fa" containerID="ceaff16ae48a58ef28f4d300ae3c2156e971d9879d3cd0469576bc6f029abff3" exitCode=0
Sep 11 03:50:24.868587 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:24.868565    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfnc5" event={"ID":"b064e152-072d-42f9-b9bb-e59f02f831fa","Type":"ContainerDied","Data":"ceaff16ae48a58ef28f4d300ae3c2156e971d9879d3cd0469576bc6f029abff3"}
Sep 11 03:50:25.626725 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:25.626428    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:25.626725 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:25.626478    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:25.626928 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:25.626770    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:25.626928 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:25.626831    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:26.626989 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:26.626955    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:26.627403 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:26.627076    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:27.292962 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:27.292886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:27.293126 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:27.292998    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 03:50:27.293126 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:27.293051    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret podName:1aa676ca-bad6-45a7-8b9b-529c9bd74170 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:59.293037831 +0000 UTC m=+65.171230111 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret") pod "global-pull-secret-syncer-qbqz4" (UID: "1aa676ca-bad6-45a7-8b9b-529c9bd74170") : object "kube-system"/"original-pull-secret" not registered
Sep 11 03:50:27.393538 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:27.393508    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:27.393710 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:27.393566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx79c\" (UniqueName: \"kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c\") pod \"network-check-target-hqtwx\" (UID: \"c9fb5002-199e-4dee-8050-9173a2b1a076\") " pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:27.393710 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:27.393688    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 03:50:27.393830 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:27.393723    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 03:50:27.393830 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:27.393738    2575 projected.go:196] Error preparing data for projected volume kube-api-access-qx79c for pod openshift-network-diagnostics/network-check-target-hqtwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:50:27.393830 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:27.393685    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:50:27.393830 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:27.393791    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c podName:c9fb5002-199e-4dee-8050-9173a2b1a076 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:59.393777452 +0000 UTC m=+65.271969732 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx79c" (UniqueName: "kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c") pod "network-check-target-hqtwx" (UID: "c9fb5002-199e-4dee-8050-9173a2b1a076") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 03:50:27.394003 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:27.393836    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs podName:5dc15c92-4ed2-4ffd-8fa5-3081b380b439 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:59.393821881 +0000 UTC m=+65.272014161 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs") pod "network-metrics-daemon-nm7zn" (UID: "5dc15c92-4ed2-4ffd-8fa5-3081b380b439") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 03:50:27.626148 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:27.626069    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:27.626148 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:27.626100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:27.626453 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:27.626174    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hqtwx" podUID="c9fb5002-199e-4dee-8050-9173a2b1a076"
Sep 11 03:50:27.626543 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:27.626494    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm7zn" podUID="5dc15c92-4ed2-4ffd-8fa5-3081b380b439"
Sep 11 03:50:28.627080 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:28.626997    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:28.627515 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:28.627132    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qbqz4" podUID="1aa676ca-bad6-45a7-8b9b-529c9bd74170"
Sep 11 03:50:28.947149 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:28.947080    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-70.ec2.internal" event="NodeReady"
Sep 11 03:50:28.947281 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:28.947252    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 03:50:28.983137 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:28.983096    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"]
Sep 11 03:50:29.013272 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.013239    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-sw4fd"]
Sep 11 03:50:29.013474 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.013456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:29.017678 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.017654    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:50:29.017816 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.017792    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 03:50:29.018109 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.018085    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 03:50:29.018225 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.018188    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7z5hc\""
Sep 11 03:50:29.029825 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.029027    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"]
Sep 11 03:50:29.030087 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.030032    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-sw4fd"
Sep 11 03:50:29.033067 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.032583    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ffqlx\""
Sep 11 03:50:29.033067 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.032937    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:50:29.033067 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.033049    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 03:50:29.047821 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.047798    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-9t5rs"]
Sep 11 03:50:29.047960 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.047944    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"
Sep 11 03:50:29.050706 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.050684    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 03:50:29.050832 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.050728    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 03:50:29.050957 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.050943    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:50:29.051013 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.050988    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 03:50:29.051060 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.050942    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-znps7\""
Sep 11 03:50:29.063565 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.063539    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"]
Sep 11 03:50:29.063723 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.063703    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.066187 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.066170    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qchm9\""
Sep 11 03:50:29.066447 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.066425    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 03:50:29.066544 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.066482    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 03:50:29.066750 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.066734    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:50:29.066750 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.066747    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 03:50:29.073312 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.073286    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 03:50:29.083060 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.083041    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5949fcfbfd-2xc8v"]
Sep 11 03:50:29.083209 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.083179    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"
Sep 11 03:50:29.085851 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.085831    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:50:29.085937 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.085851    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 03:50:29.085990 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.085851    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-62q6h\""
Sep 11 03:50:29.086176 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.086160    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 03:50:29.086245 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.086214    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 03:50:29.095773 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.095751    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"]
Sep 11 03:50:29.095867 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.095797    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-sw4fd"]
Sep 11 03:50:29.095867 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.095818    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"]
Sep 11 03:50:29.095867 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.095836    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"]
Sep 11 03:50:29.095867 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.095853    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-9t5rs"]
Sep 11 03:50:29.095867 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.095868    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zbhfp"]
Sep 11 03:50:29.096070 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.095884    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.098340 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.098273    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qn2bv\""
Sep 11 03:50:29.098340 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.098316    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 03:50:29.098474 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.098285    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 03:50:29.098596 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.098576    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 03:50:29.107118 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.107098    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 03:50:29.111345 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.111324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsrs6\" (UniqueName: \"kubernetes.io/projected/928fbdd8-5094-4dbd-ae72-a958f7654942-kube-api-access-rsrs6\") pod \"cluster-samples-operator-86499c89c4-6g47v\" (UID: \"928fbdd8-5094-4dbd-ae72-a958f7654942\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:29.111433 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.111370    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6g47v\" (UID: \"928fbdd8-5094-4dbd-ae72-a958f7654942\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:29.111492 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.111449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pxvg\" (UniqueName: \"kubernetes.io/projected/eefc1bba-4c1d-4611-8314-a7a8d2472d03-kube-api-access-7pxvg\") pod \"volume-data-source-validator-86695b7cc7-sw4fd\" (UID: \"eefc1bba-4c1d-4611-8314-a7a8d2472d03\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-sw4fd"
Sep 11 03:50:29.115740 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.115720    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"]
Sep 11 03:50:29.115851 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.115839    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.118320 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.118301    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 03:50:29.118424 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.118320    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 03:50:29.118424 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.118309    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hznd4\""
Sep 11 03:50:29.136842 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.136823    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w4h7p"]
Sep 11 03:50:29.136954 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.136940    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:50:29.139432 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.139321    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bp8v6\""
Sep 11 03:50:29.139432 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.139338    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 03:50:29.139616 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.139499    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 03:50:29.143912 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.143890    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-jfnfq"]
Sep 11 03:50:29.144017 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.144007    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4h7p"
Sep 11 03:50:29.150001 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.149983    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 03:50:29.150001 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.149993    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 03:50:29.150160 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.150121    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 03:50:29.150227 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.150204    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g2lkd\""
Sep 11 03:50:29.167740 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.167718    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"]
Sep 11 03:50:29.167870 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.167758    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5949fcfbfd-2xc8v"]
Sep 11 03:50:29.167870 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.167782    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4h7p"]
Sep 11 03:50:29.167870 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.167802    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zbhfp"]
Sep 11 03:50:29.167870 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.167812    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-jfnfq"
Sep 11 03:50:29.167870 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.167827    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-jfnfq"]
Sep 11 03:50:29.170409 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.170391    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 03:50:29.170521 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.170396    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pslw6\""
Sep 11 03:50:29.170594 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.170577    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 03:50:29.212516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.212447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6g47v\" (UID: \"928fbdd8-5094-4dbd-ae72-a958f7654942\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:29.212516 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.212481    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz5pv\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-kube-api-access-rz5pv\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.212717 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.212525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-bound-sa-token\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.212717 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.212546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggb8v\" (UniqueName: \"kubernetes.io/projected/7f3b15bd-4948-4c13-959a-e6fe1536e4ae-kube-api-access-ggb8v\") pod \"kube-storage-version-migrator-operator-6c8f84f897-kx2qq\" (UID: \"7f3b15bd-4948-4c13-959a-e6fe1536e4ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"
Sep 11 03:50:29.212717 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.212562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b24e197-b19c-4b52-b4f2-d847a7430ecc-serving-cert\") pod \"service-ca-operator-cf7c776b7-9t26c\" (UID: \"4b24e197-b19c-4b52-b4f2-d847a7430ecc\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"
Sep 11 03:50:29.212717 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.212578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-config-volume\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.212717 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.212589    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 03:50:29.212717 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.212622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-image-registry-private-configuration\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.212717 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.212694    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls podName:928fbdd8-5094-4dbd-ae72-a958f7654942 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:29.712671727 +0000 UTC m=+35.590864031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-6g47v" (UID: "928fbdd8-5094-4dbd-ae72-a958f7654942") : secret "samples-operator-tls" not found
Sep 11 03:50:29.213029 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.212777    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.213029 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.212808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv6cq\" (UniqueName: \"kubernetes.io/projected/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-kube-api-access-bv6cq\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.213029 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.212862    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pxvg\" (UniqueName: \"kubernetes.io/projected/eefc1bba-4c1d-4611-8314-a7a8d2472d03-kube-api-access-7pxvg\") pod \"volume-data-source-validator-86695b7cc7-sw4fd\" (UID: \"eefc1bba-4c1d-4611-8314-a7a8d2472d03\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-sw4fd"
Sep 11 03:50:29.213029 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.212901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d77g2\" (UniqueName: \"kubernetes.io/projected/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-kube-api-access-d77g2\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.213029 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.213274 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-config\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.213274 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213104    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fe23932-4bbe-4ea9-bd65-3263e1bae721-ca-trust-extracted\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.213274 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-installation-pull-secrets\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.213274 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-serving-cert\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.213274 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-trusted-ca\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.213274 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213259    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f3b15bd-4948-4c13-959a-e6fe1536e4ae-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-kx2qq\" (UID: \"7f3b15bd-4948-4c13-959a-e6fe1536e4ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"
Sep 11 03:50:29.213506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213281    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b24e197-b19c-4b52-b4f2-d847a7430ecc-config\") pod \"service-ca-operator-cf7c776b7-9t26c\" (UID: \"4b24e197-b19c-4b52-b4f2-d847a7430ecc\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"
Sep 11 03:50:29.213506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxqhd\" (UniqueName: \"kubernetes.io/projected/4b24e197-b19c-4b52-b4f2-d847a7430ecc-kube-api-access-sxqhd\") pod \"service-ca-operator-cf7c776b7-9t26c\" (UID: \"4b24e197-b19c-4b52-b4f2-d847a7430ecc\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"
Sep 11 03:50:29.213506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:50:29.213506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213358    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-certificates\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.213506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:50:29.213506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-tmp-dir\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.213506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsrs6\" (UniqueName: \"kubernetes.io/projected/928fbdd8-5094-4dbd-ae72-a958f7654942-kube-api-access-rsrs6\") pod \"cluster-samples-operator-86499c89c4-6g47v\" (UID: \"928fbdd8-5094-4dbd-ae72-a958f7654942\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:29.213506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213474    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f3b15bd-4948-4c13-959a-e6fe1536e4ae-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-kx2qq\" (UID: \"7f3b15bd-4948-4c13-959a-e6fe1536e4ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"
Sep 11 03:50:29.213506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.213506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-trusted-ca\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.226114 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.226088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pxvg\" (UniqueName: \"kubernetes.io/projected/eefc1bba-4c1d-4611-8314-a7a8d2472d03-kube-api-access-7pxvg\") pod \"volume-data-source-validator-86695b7cc7-sw4fd\" (UID: \"eefc1bba-4c1d-4611-8314-a7a8d2472d03\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-sw4fd"
Sep 11 03:50:29.226240 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.226088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsrs6\" (UniqueName: \"kubernetes.io/projected/928fbdd8-5094-4dbd-ae72-a958f7654942-kube-api-access-rsrs6\") pod \"cluster-samples-operator-86499c89c4-6g47v\" (UID: \"928fbdd8-5094-4dbd-ae72-a958f7654942\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:29.313934 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.313900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.313934 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.313934    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv6cq\" (UniqueName: \"kubernetes.io/projected/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-kube-api-access-bv6cq\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.314092 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.313951    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-trusted-ca\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.314092 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.313967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b24e197-b19c-4b52-b4f2-d847a7430ecc-config\") pod \"service-ca-operator-cf7c776b7-9t26c\" (UID: \"4b24e197-b19c-4b52-b4f2-d847a7430ecc\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"
Sep 11 03:50:29.314161 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.314107    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:50:29.314197 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.314161    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls podName:a4c172c0-bc0f-42e1-9183-2bfc7d021e3d nodeName:}" failed. No retries permitted until 2026-09-11 03:50:29.814146315 +0000 UTC m=+35.692338598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls") pod "dns-default-zbhfp" (UID: "a4c172c0-bc0f-42e1-9183-2bfc7d021e3d") : secret "dns-default-metrics-tls" not found
Sep 11 03:50:29.314197 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314178    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-tmp-dir\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.314296 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314198    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-certificates\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.314296 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f3b15bd-4948-4c13-959a-e6fe1536e4ae-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-kx2qq\" (UID: \"7f3b15bd-4948-4c13-959a-e6fe1536e4ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"
Sep 11 03:50:29.314296 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-trusted-ca\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.314296 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314272    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz5pv\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-kube-api-access-rz5pv\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.314561 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggb8v\" (UniqueName: \"kubernetes.io/projected/7f3b15bd-4948-4c13-959a-e6fe1536e4ae-kube-api-access-ggb8v\") pod \"kube-storage-version-migrator-operator-6c8f84f897-kx2qq\" (UID: \"7f3b15bd-4948-4c13-959a-e6fe1536e4ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"
Sep 11 03:50:29.314561 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-image-registry-private-configuration\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.314561 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.314561 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-config\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.314561 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fe23932-4bbe-4ea9-bd65-3263e1bae721-ca-trust-extracted\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.314561 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-installation-pull-secrets\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.314561 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brghh\" (UniqueName: \"kubernetes.io/projected/83a3356b-727e-4cf5-88ec-c12797a2ab56-kube-api-access-brghh\") pod \"ingress-canary-w4h7p\" (UID: \"83a3356b-727e-4cf5-88ec-c12797a2ab56\") " pod="openshift-ingress-canary/ingress-canary-w4h7p"
Sep 11 03:50:29.314561 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-serving-cert\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.314561 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-tmp-dir\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.314561 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f3b15bd-4948-4c13-959a-e6fe1536e4ae-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-kx2qq\" (UID: \"7f3b15bd-4948-4c13-959a-e6fe1536e4ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314563    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b24e197-b19c-4b52-b4f2-d847a7430ecc-config\") pod \"service-ca-operator-cf7c776b7-9t26c\" (UID: \"4b24e197-b19c-4b52-b4f2-d847a7430ecc\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314569    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxqhd\" (UniqueName: \"kubernetes.io/projected/4b24e197-b19c-4b52-b4f2-d847a7430ecc-kube-api-access-sxqhd\") pod \"service-ca-operator-cf7c776b7-9t26c\" (UID: \"4b24e197-b19c-4b52-b4f2-d847a7430ecc\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83a3356b-727e-4cf5-88ec-c12797a2ab56-cert\") pod \"ingress-canary-w4h7p\" (UID: \"83a3356b-727e-4cf5-88ec-c12797a2ab56\") " pod="openshift-ingress-canary/ingress-canary-w4h7p"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-bound-sa-token\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314813    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b24e197-b19c-4b52-b4f2-d847a7430ecc-serving-cert\") pod \"service-ca-operator-cf7c776b7-9t26c\" (UID: \"4b24e197-b19c-4b52-b4f2-d847a7430ecc\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314838    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-config-volume\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314853    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-certificates\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb9x7\" (UniqueName: \"kubernetes.io/projected/fb379542-40ad-491b-bd18-60f31393ab4b-kube-api-access-cb9x7\") pod \"network-check-source-6f8b768455-jfnfq\" (UID: \"fb379542-40ad-491b-bd18-60f31393ab4b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-jfnfq"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d77g2\" (UniqueName: \"kubernetes.io/projected/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-kube-api-access-d77g2\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.315072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.314916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-trusted-ca\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.315700 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.315189    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:50:29.315700 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.315205    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5949fcfbfd-2xc8v: secret "image-registry-tls" not found
Sep 11 03:50:29.315700 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.315405    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f3b15bd-4948-4c13-959a-e6fe1536e4ae-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-kx2qq\" (UID: \"7f3b15bd-4948-4c13-959a-e6fe1536e4ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"
Sep 11 03:50:29.315700 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.315438    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls podName:5fe23932-4bbe-4ea9-bd65-3263e1bae721 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:29.815240005 +0000 UTC m=+35.693432288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls") pod "image-registry-5949fcfbfd-2xc8v" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721") : secret "image-registry-tls" not found
Sep 11 03:50:29.315898 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.315706    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-trusted-ca\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.315898 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.315725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:50:29.315898 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.315772    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fe23932-4bbe-4ea9-bd65-3263e1bae721-ca-trust-extracted\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.316351 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.316326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-config\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.316496 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.316466    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-config-volume\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.316496 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.316479    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:50:29.316590 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.316538    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert podName:ec394572-d8bc-4f3c-b9a6-1c35eb67a263 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:29.816522443 +0000 UTC m=+35.694714728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-wv4lw" (UID: "ec394572-d8bc-4f3c-b9a6-1c35eb67a263") : secret "networking-console-plugin-cert" not found
Sep 11 03:50:29.317518 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.317496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-image-registry-private-configuration\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.317586 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.317504    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f3b15bd-4948-4c13-959a-e6fe1536e4ae-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-kx2qq\" (UID: \"7f3b15bd-4948-4c13-959a-e6fe1536e4ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"
Sep 11 03:50:29.317652 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.317625    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-installation-pull-secrets\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.318122 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.318107    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-serving-cert\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.318310 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.318294    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b24e197-b19c-4b52-b4f2-d847a7430ecc-serving-cert\") pod \"service-ca-operator-cf7c776b7-9t26c\" (UID: \"4b24e197-b19c-4b52-b4f2-d847a7430ecc\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"
Sep 11 03:50:29.323914 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.323873    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxqhd\" (UniqueName: \"kubernetes.io/projected/4b24e197-b19c-4b52-b4f2-d847a7430ecc-kube-api-access-sxqhd\") pod \"service-ca-operator-cf7c776b7-9t26c\" (UID: \"4b24e197-b19c-4b52-b4f2-d847a7430ecc\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"
Sep 11 03:50:29.324437 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.324411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv6cq\" (UniqueName: \"kubernetes.io/projected/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-kube-api-access-bv6cq\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.324529 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.324459    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-bound-sa-token\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.324582 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.324567    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz5pv\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-kube-api-access-rz5pv\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.324880 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.324862    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d77g2\" (UniqueName: \"kubernetes.io/projected/276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af-kube-api-access-d77g2\") pod \"console-operator-696884fb9c-9t5rs\" (UID: \"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af\") " pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.324987 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.324962    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggb8v\" (UniqueName: \"kubernetes.io/projected/7f3b15bd-4948-4c13-959a-e6fe1536e4ae-kube-api-access-ggb8v\") pod \"kube-storage-version-migrator-operator-6c8f84f897-kx2qq\" (UID: \"7f3b15bd-4948-4c13-959a-e6fe1536e4ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"
Sep 11 03:50:29.341119 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.341101    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-sw4fd"
Sep 11 03:50:29.358341 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.358323    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"
Sep 11 03:50:29.373341 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.373324    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:29.392139 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.392120    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"
Sep 11 03:50:29.415825 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.415787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brghh\" (UniqueName: \"kubernetes.io/projected/83a3356b-727e-4cf5-88ec-c12797a2ab56-kube-api-access-brghh\") pod \"ingress-canary-w4h7p\" (UID: \"83a3356b-727e-4cf5-88ec-c12797a2ab56\") " pod="openshift-ingress-canary/ingress-canary-w4h7p"
Sep 11 03:50:29.415951 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.415857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83a3356b-727e-4cf5-88ec-c12797a2ab56-cert\") pod \"ingress-canary-w4h7p\" (UID: \"83a3356b-727e-4cf5-88ec-c12797a2ab56\") " pod="openshift-ingress-canary/ingress-canary-w4h7p"
Sep 11 03:50:29.415951 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.415892    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb9x7\" (UniqueName: \"kubernetes.io/projected/fb379542-40ad-491b-bd18-60f31393ab4b-kube-api-access-cb9x7\") pod \"network-check-source-6f8b768455-jfnfq\" (UID: \"fb379542-40ad-491b-bd18-60f31393ab4b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-jfnfq"
Sep 11 03:50:29.418448 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.418423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83a3356b-727e-4cf5-88ec-c12797a2ab56-cert\") pod \"ingress-canary-w4h7p\" (UID: \"83a3356b-727e-4cf5-88ec-c12797a2ab56\") " pod="openshift-ingress-canary/ingress-canary-w4h7p"
Sep 11 03:50:29.425252 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.425144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb9x7\" (UniqueName: \"kubernetes.io/projected/fb379542-40ad-491b-bd18-60f31393ab4b-kube-api-access-cb9x7\") pod \"network-check-source-6f8b768455-jfnfq\" (UID: \"fb379542-40ad-491b-bd18-60f31393ab4b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-jfnfq"
Sep 11 03:50:29.425252 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.425213    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brghh\" (UniqueName: \"kubernetes.io/projected/83a3356b-727e-4cf5-88ec-c12797a2ab56-kube-api-access-brghh\") pod \"ingress-canary-w4h7p\" (UID: \"83a3356b-727e-4cf5-88ec-c12797a2ab56\") " pod="openshift-ingress-canary/ingress-canary-w4h7p"
Sep 11 03:50:29.454394 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.454290    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4h7p"
Sep 11 03:50:29.477260 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.477233    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-jfnfq"
Sep 11 03:50:29.627163 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.626991    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:29.627569 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.626996    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:29.630319 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.630301    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 03:50:29.630379 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.630367    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-58qzc\""
Sep 11 03:50:29.630424 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.630367    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-snbvm\""
Sep 11 03:50:29.666547 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.666519    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq"]
Sep 11 03:50:29.667591 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.667574    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-sw4fd"]
Sep 11 03:50:29.670435 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:50:29.670410    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3b15bd_4948_4c13_959a_e6fe1536e4ae.slice/crio-49e540eaf142e5aa659f7f8eb4bbc16e9c1fa813a64035663e1550db1cd7344e WatchSource:0}: Error finding container 49e540eaf142e5aa659f7f8eb4bbc16e9c1fa813a64035663e1550db1cd7344e: Status 404 returned error can't find the container with id 49e540eaf142e5aa659f7f8eb4bbc16e9c1fa813a64035663e1550db1cd7344e
Sep 11 03:50:29.670853 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:50:29.670833    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefc1bba_4c1d_4611_8314_a7a8d2472d03.slice/crio-393631e6519405dea49be677c0353e320f0dd4010e723aaf6fafb24d89efabd6 WatchSource:0}: Error finding container 393631e6519405dea49be677c0353e320f0dd4010e723aaf6fafb24d89efabd6: Status 404 returned error can't find the container with id 393631e6519405dea49be677c0353e320f0dd4010e723aaf6fafb24d89efabd6
Sep 11 03:50:29.702307 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.702285    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-9t5rs"]
Sep 11 03:50:29.707324 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:50:29.707282    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276aa6c9_6021_4eb8_a0f4_e2ecc82fc0af.slice/crio-84bd4914ab67b75be89af52d9a6dde7e33d96f60302720b74e7f255fd8271f0b WatchSource:0}: Error finding container 84bd4914ab67b75be89af52d9a6dde7e33d96f60302720b74e7f255fd8271f0b: Status 404 returned error can't find the container with id 84bd4914ab67b75be89af52d9a6dde7e33d96f60302720b74e7f255fd8271f0b
Sep 11 03:50:29.719206 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.719179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6g47v\" (UID: \"928fbdd8-5094-4dbd-ae72-a958f7654942\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:29.719699 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.719337    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 03:50:29.719699 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.719395    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls podName:928fbdd8-5094-4dbd-ae72-a958f7654942 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:30.719376762 +0000 UTC m=+36.597569059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-6g47v" (UID: "928fbdd8-5094-4dbd-ae72-a958f7654942") : secret "samples-operator-tls" not found
Sep 11 03:50:29.734547 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.734477    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c"]
Sep 11 03:50:29.754872 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.754851    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4h7p"]
Sep 11 03:50:29.757787 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:50:29.757762    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a3356b_727e_4cf5_88ec_c12797a2ab56.slice/crio-8a1dfd0bc21fefa96b53110b365947e20fec4ab58de6cd11c038f5d46ea280a6 WatchSource:0}: Error finding container 8a1dfd0bc21fefa96b53110b365947e20fec4ab58de6cd11c038f5d46ea280a6: Status 404 returned error can't find the container with id 8a1dfd0bc21fefa96b53110b365947e20fec4ab58de6cd11c038f5d46ea280a6
Sep 11 03:50:29.778394 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.778369    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-jfnfq"]
Sep 11 03:50:29.781508 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:50:29.781475    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb379542_40ad_491b_bd18_60f31393ab4b.slice/crio-19ccc5cb6d99b15b27828970a9788015b4f9515f99f21de1940beb3c756593de WatchSource:0}: Error finding container 19ccc5cb6d99b15b27828970a9788015b4f9515f99f21de1940beb3c756593de: Status 404 returned error can't find the container with id 19ccc5cb6d99b15b27828970a9788015b4f9515f99f21de1940beb3c756593de
Sep 11 03:50:29.819958 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.819926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:29.820115 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.820009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:29.820115 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.820052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:50:29.820115 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.820090    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:50:29.820285 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.820140    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:50:29.820285 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.820143    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:50:29.820285 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.820155    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls podName:a4c172c0-bc0f-42e1-9183-2bfc7d021e3d nodeName:}" failed. No retries permitted until 2026-09-11 03:50:30.820136075 +0000 UTC m=+36.698328365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls") pod "dns-default-zbhfp" (UID: "a4c172c0-bc0f-42e1-9183-2bfc7d021e3d") : secret "dns-default-metrics-tls" not found
Sep 11 03:50:29.820285 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.820162    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5949fcfbfd-2xc8v: secret "image-registry-tls" not found
Sep 11 03:50:29.820285 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.820195    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert podName:ec394572-d8bc-4f3c-b9a6-1c35eb67a263 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:30.820178288 +0000 UTC m=+36.698370572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-wv4lw" (UID: "ec394572-d8bc-4f3c-b9a6-1c35eb67a263") : secret "networking-console-plugin-cert" not found
Sep 11 03:50:29.820285 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:29.820213    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls podName:5fe23932-4bbe-4ea9-bd65-3263e1bae721 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:30.820204349 +0000 UTC m=+36.698396632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls") pod "image-registry-5949fcfbfd-2xc8v" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721") : secret "image-registry-tls" not found
Sep 11 03:50:29.883328 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.883287    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4h7p" event={"ID":"83a3356b-727e-4cf5-88ec-c12797a2ab56","Type":"ContainerStarted","Data":"8a1dfd0bc21fefa96b53110b365947e20fec4ab58de6cd11c038f5d46ea280a6"}
Sep 11 03:50:29.884542 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.884514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq" event={"ID":"7f3b15bd-4948-4c13-959a-e6fe1536e4ae","Type":"ContainerStarted","Data":"49e540eaf142e5aa659f7f8eb4bbc16e9c1fa813a64035663e1550db1cd7344e"}
Sep 11 03:50:29.885759 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.885727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs" event={"ID":"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af","Type":"ContainerStarted","Data":"84bd4914ab67b75be89af52d9a6dde7e33d96f60302720b74e7f255fd8271f0b"}
Sep 11 03:50:29.886862 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.886840    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-jfnfq" event={"ID":"fb379542-40ad-491b-bd18-60f31393ab4b","Type":"ContainerStarted","Data":"19ccc5cb6d99b15b27828970a9788015b4f9515f99f21de1940beb3c756593de"}
Sep 11 03:50:29.888050 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.888022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-sw4fd" event={"ID":"eefc1bba-4c1d-4611-8314-a7a8d2472d03","Type":"ContainerStarted","Data":"393631e6519405dea49be677c0353e320f0dd4010e723aaf6fafb24d89efabd6"}
Sep 11 03:50:29.889271 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.889240    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c" event={"ID":"4b24e197-b19c-4b52-b4f2-d847a7430ecc","Type":"ContainerStarted","Data":"daf92e260b482af964694aa4afb120c4ebc6ae696cc11b7029cb3d983b8519eb"}
Sep 11 03:50:29.892426 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:29.892402    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfnc5" event={"ID":"b064e152-072d-42f9-b9bb-e59f02f831fa","Type":"ContainerStarted","Data":"63f2f361528150acfaaf3276ad77ef0bf65e9af4fd6e7f975f6219e32e177b3d"}
Sep 11 03:50:30.629905 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:30.629279    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:30.632284 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:30.632259    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 03:50:30.730477 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:30.730440    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6g47v\" (UID: \"928fbdd8-5094-4dbd-ae72-a958f7654942\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:30.730663 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:30.730631    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 03:50:30.730747 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:30.730698    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls podName:928fbdd8-5094-4dbd-ae72-a958f7654942 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:32.730679731 +0000 UTC m=+38.608872031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-6g47v" (UID: "928fbdd8-5094-4dbd-ae72-a958f7654942") : secret "samples-operator-tls" not found
Sep 11 03:50:30.831898 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:30.831860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:30.832081 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:30.831945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:30.832081 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:30.831981    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:50:30.832186 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:30.832112    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:50:30.832186 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:30.832181    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert podName:ec394572-d8bc-4f3c-b9a6-1c35eb67a263 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:32.832161821 +0000 UTC m=+38.710354103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-wv4lw" (UID: "ec394572-d8bc-4f3c-b9a6-1c35eb67a263") : secret "networking-console-plugin-cert" not found
Sep 11 03:50:30.832860 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:30.832576    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:50:30.832860 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:30.832697    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:50:30.832860 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:30.832709    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5949fcfbfd-2xc8v: secret "image-registry-tls" not found
Sep 11 03:50:30.832860 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:30.832756    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls podName:5fe23932-4bbe-4ea9-bd65-3263e1bae721 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:32.832739854 +0000 UTC m=+38.710932144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls") pod "image-registry-5949fcfbfd-2xc8v" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721") : secret "image-registry-tls" not found
Sep 11 03:50:30.833267 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:30.833235    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls podName:a4c172c0-bc0f-42e1-9183-2bfc7d021e3d nodeName:}" failed. No retries permitted until 2026-09-11 03:50:32.833215883 +0000 UTC m=+38.711408178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls") pod "dns-default-zbhfp" (UID: "a4c172c0-bc0f-42e1-9183-2bfc7d021e3d") : secret "dns-default-metrics-tls" not found
Sep 11 03:50:30.904700 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:30.904625    2575 generic.go:356] "Generic (PLEG): container finished" podID="b064e152-072d-42f9-b9bb-e59f02f831fa" containerID="63f2f361528150acfaaf3276ad77ef0bf65e9af4fd6e7f975f6219e32e177b3d" exitCode=0
Sep 11 03:50:30.904842 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:30.904706    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfnc5" event={"ID":"b064e152-072d-42f9-b9bb-e59f02f831fa","Type":"ContainerDied","Data":"63f2f361528150acfaaf3276ad77ef0bf65e9af4fd6e7f975f6219e32e177b3d"}
Sep 11 03:50:31.910187 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:31.909937    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-sw4fd" event={"ID":"eefc1bba-4c1d-4611-8314-a7a8d2472d03","Type":"ContainerStarted","Data":"d2fdaa7abb0cb2d455fbeaef7e744034be19d3d0669834e5c860e8478c082a4e"}
Sep 11 03:50:31.916002 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:31.915967    2575 generic.go:356] "Generic (PLEG): container finished" podID="b064e152-072d-42f9-b9bb-e59f02f831fa" containerID="cb7b6560684b4783df13c9a81a0d4f8d6cf91dcfc3a31b56cb074e949c50bb3a" exitCode=0
Sep 11 03:50:31.916141 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:31.916020    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfnc5" event={"ID":"b064e152-072d-42f9-b9bb-e59f02f831fa","Type":"ContainerDied","Data":"cb7b6560684b4783df13c9a81a0d4f8d6cf91dcfc3a31b56cb074e949c50bb3a"}
Sep 11 03:50:31.959851 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:31.959770    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-sw4fd" podStartSLOduration=35.52069242 podStartE2EDuration="36.959747374s" totalImagesPullingTime="1.439054954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:31.927000255 +0000 UTC m=+37.805192558" watchObservedRunningTime="2026-09-11 03:50:31.959747374 +0000 UTC m=+37.837939677"
Sep 11 03:50:32.749367 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:32.749327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6g47v\" (UID: \"928fbdd8-5094-4dbd-ae72-a958f7654942\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:32.749558 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:32.749502    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 03:50:32.749661 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:32.749568    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls podName:928fbdd8-5094-4dbd-ae72-a958f7654942 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:36.749548581 +0000 UTC m=+42.627740860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-6g47v" (UID: "928fbdd8-5094-4dbd-ae72-a958f7654942") : secret "samples-operator-tls" not found
Sep 11 03:50:32.850177 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:32.850146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:32.850343 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:32.850214    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:32.850343 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:32.850246    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:50:32.850343 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:32.850301    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:50:32.850513 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:32.850360    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:50:32.850513 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:32.850367    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls podName:a4c172c0-bc0f-42e1-9183-2bfc7d021e3d nodeName:}" failed. No retries permitted until 2026-09-11 03:50:36.850345157 +0000 UTC m=+42.728537439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls") pod "dns-default-zbhfp" (UID: "a4c172c0-bc0f-42e1-9183-2bfc7d021e3d") : secret "dns-default-metrics-tls" not found
Sep 11 03:50:32.850513 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:32.850365    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:50:32.850513 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:32.850384    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5949fcfbfd-2xc8v: secret "image-registry-tls" not found
Sep 11 03:50:32.850513 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:32.850422    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls podName:5fe23932-4bbe-4ea9-bd65-3263e1bae721 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:36.85040805 +0000 UTC m=+42.728600331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls") pod "image-registry-5949fcfbfd-2xc8v" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721") : secret "image-registry-tls" not found
Sep 11 03:50:32.850513 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:32.850446    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert podName:ec394572-d8bc-4f3c-b9a6-1c35eb67a263 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:36.850436746 +0000 UTC m=+42.728629025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-wv4lw" (UID: "ec394572-d8bc-4f3c-b9a6-1c35eb67a263") : secret "networking-console-plugin-cert" not found
Sep 11 03:50:36.789331 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.789287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6g47v\" (UID: \"928fbdd8-5094-4dbd-ae72-a958f7654942\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:36.789717 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:36.789444    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 03:50:36.789717 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:36.789512    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls podName:928fbdd8-5094-4dbd-ae72-a958f7654942 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:44.789495395 +0000 UTC m=+50.667687675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-6g47v" (UID: "928fbdd8-5094-4dbd-ae72-a958f7654942") : secret "samples-operator-tls" not found
Sep 11 03:50:36.889979 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.889947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:36.890105 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.890039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:36.890105 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.890087    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:50:36.890187 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:36.890100    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:50:36.890187 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:36.890157    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls podName:a4c172c0-bc0f-42e1-9183-2bfc7d021e3d nodeName:}" failed. No retries permitted until 2026-09-11 03:50:44.890135266 +0000 UTC m=+50.768327550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls") pod "dns-default-zbhfp" (UID: "a4c172c0-bc0f-42e1-9183-2bfc7d021e3d") : secret "dns-default-metrics-tls" not found
Sep 11 03:50:36.890263 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:36.890199    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:50:36.890263 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:36.890212    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:50:36.890263 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:36.890221    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5949fcfbfd-2xc8v: secret "image-registry-tls" not found
Sep 11 03:50:36.890358 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:36.890268    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert podName:ec394572-d8bc-4f3c-b9a6-1c35eb67a263 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:44.890253093 +0000 UTC m=+50.768445380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-wv4lw" (UID: "ec394572-d8bc-4f3c-b9a6-1c35eb67a263") : secret "networking-console-plugin-cert" not found
Sep 11 03:50:36.890358 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:36.890286    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls podName:5fe23932-4bbe-4ea9-bd65-3263e1bae721 nodeName:}" failed. No retries permitted until 2026-09-11 03:50:44.890276722 +0000 UTC m=+50.768469007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls") pod "image-registry-5949fcfbfd-2xc8v" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721") : secret "image-registry-tls" not found
Sep 11 03:50:36.931038 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.931010    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4h7p" event={"ID":"83a3356b-727e-4cf5-88ec-c12797a2ab56","Type":"ContainerStarted","Data":"ed42b466f33c95114136c6b7c73a5acd6e9292ea9d99633d58206a5e74c05e74"}
Sep 11 03:50:36.932891 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.932871    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq" event={"ID":"7f3b15bd-4948-4c13-959a-e6fe1536e4ae","Type":"ContainerStarted","Data":"110bc59905740c88e0edf6cd51558fc6d77487bf644c62c227dde97d63e93d6b"}
Sep 11 03:50:36.934593 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.934570    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/0.log"
Sep 11 03:50:36.934679 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.934627    2575 generic.go:356] "Generic (PLEG): container finished" podID="276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af" containerID="acddbe1825eed7ca10c7c1b93ffd94c6ee2784dbb855a641d95a675c23bdd20f" exitCode=255
Sep 11 03:50:36.934750 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.934709    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs" event={"ID":"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af","Type":"ContainerDied","Data":"acddbe1825eed7ca10c7c1b93ffd94c6ee2784dbb855a641d95a675c23bdd20f"}
Sep 11 03:50:36.934931 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.934912    2575 scope.go:117] "RemoveContainer" containerID="acddbe1825eed7ca10c7c1b93ffd94c6ee2784dbb855a641d95a675c23bdd20f"
Sep 11 03:50:36.936401 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.936305    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-jfnfq" event={"ID":"fb379542-40ad-491b-bd18-60f31393ab4b","Type":"ContainerStarted","Data":"602cc488e82fe0807692ebed95a0cdd8b8eba7b584361aac1f2cf9586e547b94"}
Sep 11 03:50:36.938054 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.938030    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c" event={"ID":"4b24e197-b19c-4b52-b4f2-d847a7430ecc","Type":"ContainerStarted","Data":"0fdbad1da0591e5b7592dcb466184f33d95bcf3f761a97b07f3d76353288ead6"}
Sep 11 03:50:36.941532 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.941505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wfnc5" event={"ID":"b064e152-072d-42f9-b9bb-e59f02f831fa","Type":"ContainerStarted","Data":"bc59775de26937f86143dcefd0e1034e31969510721014e6762dc1ce29e142dd"}
Sep 11 03:50:36.951043 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.950996    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w4h7p" podStartSLOduration=2.75862506 podStartE2EDuration="8.950979116s" totalImagesPullingTime="6.192354056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:36.945802648 +0000 UTC m=+42.823994949" watchObservedRunningTime="2026-09-11 03:50:36.950979116 +0000 UTC m=+42.829171420"
Sep 11 03:50:36.963203 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.963157    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq" podStartSLOduration=30.684137978 podStartE2EDuration="36.963139714s" totalImagesPullingTime="6.279001736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:36.96237757 +0000 UTC m=+42.840569874" watchObservedRunningTime="2026-09-11 03:50:36.963139714 +0000 UTC m=+42.841332017"
Sep 11 03:50:36.997044 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:36.996991    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c" podStartSLOduration=30.784805924 podStartE2EDuration="36.996972022s" totalImagesPullingTime="6.212166098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:36.995809157 +0000 UTC m=+42.874001460" watchObservedRunningTime="2026-09-11 03:50:36.996972022 +0000 UTC m=+42.875164325"
Sep 11 03:50:37.018074 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:37.018012    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wfnc5" podStartSLOduration=10.718897158 podStartE2EDuration="42.017997862s" totalImagesPullingTime="31.299100704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:37.016293359 +0000 UTC m=+42.894485666" watchObservedRunningTime="2026-09-11 03:50:37.017997862 +0000 UTC m=+42.896190166"
Sep 11 03:50:37.030762 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:37.030708    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-jfnfq" podStartSLOduration=29.853805212 podStartE2EDuration="36.030686492s" totalImagesPullingTime="6.17688128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:37.030660431 +0000 UTC m=+42.908852732" watchObservedRunningTime="2026-09-11 03:50:37.030686492 +0000 UTC m=+42.908878796"
Sep 11 03:50:37.947672 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:37.947641    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 03:50:37.948112 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:37.948096    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/0.log"
Sep 11 03:50:37.948167 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:37.948136    2575 generic.go:356] "Generic (PLEG): container finished" podID="276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af" containerID="225d3e6f75a490b9edbd54f9d0527d05d3dcd561ba04542d0737e9d8f619544e" exitCode=255
Sep 11 03:50:37.948274 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:37.948247    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs" event={"ID":"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af","Type":"ContainerDied","Data":"225d3e6f75a490b9edbd54f9d0527d05d3dcd561ba04542d0737e9d8f619544e"}
Sep 11 03:50:37.948363 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:37.948349    2575 scope.go:117] "RemoveContainer" containerID="acddbe1825eed7ca10c7c1b93ffd94c6ee2784dbb855a641d95a675c23bdd20f"
Sep 11 03:50:37.948456 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:37.948441    2575 scope.go:117] "RemoveContainer" containerID="225d3e6f75a490b9edbd54f9d0527d05d3dcd561ba04542d0737e9d8f619544e"
Sep 11 03:50:37.948648 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:37.948588    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-9t5rs_openshift-console-operator(276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af)\"" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs" podUID="276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af"
Sep 11 03:50:38.953167 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:38.953139    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 03:50:38.953619 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:38.953428    2575 scope.go:117] "RemoveContainer" containerID="225d3e6f75a490b9edbd54f9d0527d05d3dcd561ba04542d0737e9d8f619544e"
Sep 11 03:50:38.953619 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:38.953580    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-9t5rs_openshift-console-operator(276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af)\"" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs" podUID="276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af"
Sep 11 03:50:39.374098 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:39.374059    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:39.374258 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:39.374121    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:39.957565 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:39.957528    2575 scope.go:117] "RemoveContainer" containerID="225d3e6f75a490b9edbd54f9d0527d05d3dcd561ba04542d0737e9d8f619544e"
Sep 11 03:50:39.958033 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:39.957753    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-9t5rs_openshift-console-operator(276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af)\"" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs" podUID="276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af"
Sep 11 03:50:44.851827 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:44.851790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6g47v\" (UID: \"928fbdd8-5094-4dbd-ae72-a958f7654942\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:44.855583 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:44.855559    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/928fbdd8-5094-4dbd-ae72-a958f7654942-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-6g47v\" (UID: \"928fbdd8-5094-4dbd-ae72-a958f7654942\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:44.925524 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:44.925491    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"
Sep 11 03:50:44.952713 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:44.952682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:50:44.952858 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:44.952744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:50:44.952858 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:44.952776    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:50:44.952858 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:44.952826    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 03:50:44.953015 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:44.952889    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 03:50:44.953015 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:44.952893    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 03:50:44.953015 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:44.952909    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5949fcfbfd-2xc8v: secret "image-registry-tls" not found
Sep 11 03:50:44.953015 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:44.952893    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls podName:a4c172c0-bc0f-42e1-9183-2bfc7d021e3d nodeName:}" failed. No retries permitted until 2026-09-11 03:51:00.952875284 +0000 UTC m=+66.831067565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls") pod "dns-default-zbhfp" (UID: "a4c172c0-bc0f-42e1-9183-2bfc7d021e3d") : secret "dns-default-metrics-tls" not found
Sep 11 03:50:44.953015 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:44.952964    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert podName:ec394572-d8bc-4f3c-b9a6-1c35eb67a263 nodeName:}" failed. No retries permitted until 2026-09-11 03:51:00.952952169 +0000 UTC m=+66.831144449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-wv4lw" (UID: "ec394572-d8bc-4f3c-b9a6-1c35eb67a263") : secret "networking-console-plugin-cert" not found
Sep 11 03:50:44.953015 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:50:44.952974    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls podName:5fe23932-4bbe-4ea9-bd65-3263e1bae721 nodeName:}" failed. No retries permitted until 2026-09-11 03:51:00.952968693 +0000 UTC m=+66.831160973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls") pod "image-registry-5949fcfbfd-2xc8v" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721") : secret "image-registry-tls" not found
Sep 11 03:50:45.194190 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:45.194118    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v"]
Sep 11 03:50:45.977743 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:45.977703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v" event={"ID":"928fbdd8-5094-4dbd-ae72-a958f7654942","Type":"ContainerStarted","Data":"ae547ff0769f6a585fcaee04a94df3a6416626883e820c2ae83f4f26a32719b2"}
Sep 11 03:50:47.985062 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:47.985026    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v" event={"ID":"928fbdd8-5094-4dbd-ae72-a958f7654942","Type":"ContainerStarted","Data":"ac8cacc96aed09443071b63c4c582dad4c26d828057b2fce662d40122e12e5a6"}
Sep 11 03:50:47.985437 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:47.985073    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v" event={"ID":"928fbdd8-5094-4dbd-ae72-a958f7654942","Type":"ContainerStarted","Data":"017fddd47b10a215b57b1a33a813e762c09d5f9bad4dc65096be3593c1692837"}
Sep 11 03:50:48.004634 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:48.004572    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-6g47v" podStartSLOduration=51.289502943 podStartE2EDuration="53.004558502s" totalImagesPullingTime="1.715055559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:48.003825312 +0000 UTC m=+53.882017616" watchObservedRunningTime="2026-09-11 03:50:48.004558502 +0000 UTC m=+53.882750856"
Sep 11 03:50:50.627200 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:50.627166    2575 scope.go:117] "RemoveContainer" containerID="225d3e6f75a490b9edbd54f9d0527d05d3dcd561ba04542d0737e9d8f619544e"
Sep 11 03:50:50.996536 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:50.996508    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 03:50:50.996697 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:50.996587    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs" event={"ID":"276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af","Type":"ContainerStarted","Data":"9e1b5913b39c35c43f1c55505d7767928b69325453f543cea7a7a923cd02a017"}
Sep 11 03:50:50.996955 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:50.996932    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:51.014364 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:51.014324    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs" podStartSLOduration=48.772261854 podStartE2EDuration="55.014309647s" totalImagesPullingTime="6.242047793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:50:51.01357618 +0000 UTC m=+56.891768493" watchObservedRunningTime="2026-09-11 03:50:51.014309647 +0000 UTC m=+56.892501948"
Sep 11 03:50:51.669025 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:51.668996    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-9t5rs"
Sep 11 03:50:53.875285 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:53.875260    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7rfx"
Sep 11 03:50:59.365834 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.365787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:59.368957 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.368940    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 03:50:59.378874 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.378851    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1aa676ca-bad6-45a7-8b9b-529c9bd74170-original-pull-secret\") pod \"global-pull-secret-syncer-qbqz4\" (UID: \"1aa676ca-bad6-45a7-8b9b-529c9bd74170\") " pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:59.444166 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.444125    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qbqz4"
Sep 11 03:50:59.466858 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.466832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx79c\" (UniqueName: \"kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c\") pod \"network-check-target-hqtwx\" (UID: \"c9fb5002-199e-4dee-8050-9173a2b1a076\") " pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:59.466971 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.466924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:59.469323 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.469300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx79c\" (UniqueName: \"kubernetes.io/projected/c9fb5002-199e-4dee-8050-9173a2b1a076-kube-api-access-qx79c\") pod \"network-check-target-hqtwx\" (UID: \"c9fb5002-199e-4dee-8050-9173a2b1a076\") " pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:59.471134 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.471109    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 03:50:59.479891 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.479869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dc15c92-4ed2-4ffd-8fa5-3081b380b439-metrics-certs\") pod \"network-metrics-daemon-nm7zn\" (UID: \"5dc15c92-4ed2-4ffd-8fa5-3081b380b439\") " pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:59.640489 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.640412    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-snbvm\""
Sep 11 03:50:59.643855 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.643839    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-58qzc\""
Sep 11 03:50:59.647908 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.647894    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:50:59.652109 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.652092    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm7zn"
Sep 11 03:50:59.715928 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.715829    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qbqz4"]
Sep 11 03:50:59.721792 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:50:59.721768    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa676ca_bad6_45a7_8b9b_529c9bd74170.slice/crio-dcc1bacd6a067d7caf7a40a4156e98fb13f039a4d9e9fce96c3e5db279aad55a WatchSource:0}: Error finding container dcc1bacd6a067d7caf7a40a4156e98fb13f039a4d9e9fce96c3e5db279aad55a: Status 404 returned error can't find the container with id dcc1bacd6a067d7caf7a40a4156e98fb13f039a4d9e9fce96c3e5db279aad55a
Sep 11 03:50:59.919646 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.919623    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hqtwx"]
Sep 11 03:50:59.921985 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:50:59.921938    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9fb5002_199e_4dee_8050_9173a2b1a076.slice/crio-4fa223b6287754f20e8c5169ed9d8737907b9bcd84a890990d148991e878ba51 WatchSource:0}: Error finding container 4fa223b6287754f20e8c5169ed9d8737907b9bcd84a890990d148991e878ba51: Status 404 returned error can't find the container with id 4fa223b6287754f20e8c5169ed9d8737907b9bcd84a890990d148991e878ba51
Sep 11 03:50:59.922814 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:50:59.922791    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nm7zn"]
Sep 11 03:50:59.925323 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:50:59.925301    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc15c92_4ed2_4ffd_8fa5_3081b380b439.slice/crio-b33b86696c03b68be4485525d1c0de521d3328531d39fbd363a87db2c7513759 WatchSource:0}: Error finding container b33b86696c03b68be4485525d1c0de521d3328531d39fbd363a87db2c7513759: Status 404 returned error can't find the container with id b33b86696c03b68be4485525d1c0de521d3328531d39fbd363a87db2c7513759
Sep 11 03:51:00.025879 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.025847    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nm7zn" event={"ID":"5dc15c92-4ed2-4ffd-8fa5-3081b380b439","Type":"ContainerStarted","Data":"b33b86696c03b68be4485525d1c0de521d3328531d39fbd363a87db2c7513759"}
Sep 11 03:51:00.027071 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.027047    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qbqz4" event={"ID":"1aa676ca-bad6-45a7-8b9b-529c9bd74170","Type":"ContainerStarted","Data":"dcc1bacd6a067d7caf7a40a4156e98fb13f039a4d9e9fce96c3e5db279aad55a"}
Sep 11 03:51:00.028357 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.028337    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hqtwx" event={"ID":"c9fb5002-199e-4dee-8050-9173a2b1a076","Type":"ContainerStarted","Data":"13e9e1fb7534d41a3e7d6c0f7bda0ed2891f34943054ef86c680dff6718ecf95"}
Sep 11 03:51:00.028438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.028372    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hqtwx" event={"ID":"c9fb5002-199e-4dee-8050-9173a2b1a076","Type":"ContainerStarted","Data":"4fa223b6287754f20e8c5169ed9d8737907b9bcd84a890990d148991e878ba51"}
Sep 11 03:51:00.028506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.028486    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:51:00.042917 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.042878    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hqtwx" podStartSLOduration=65.04286018 podStartE2EDuration="1m5.04286018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:00.042845455 +0000 UTC m=+65.921037759" watchObservedRunningTime="2026-09-11 03:51:00.04286018 +0000 UTC m=+65.921052461"
Sep 11 03:51:00.980401 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.980363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:51:00.980868 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.980420    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:51:00.980868 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.980453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:51:00.983082 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.983056    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c172c0-bc0f-42e1-9183-2bfc7d021e3d-metrics-tls\") pod \"dns-default-zbhfp\" (UID: \"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d\") " pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:51:00.983209 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.983181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec394572-d8bc-4f3c-b9a6-1c35eb67a263-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-wv4lw\" (UID: \"ec394572-d8bc-4f3c-b9a6-1c35eb67a263\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:51:00.983298 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:00.983275    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls\") pod \"image-registry-5949fcfbfd-2xc8v\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") " pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:51:01.208340 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.208315    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qn2bv\""
Sep 11 03:51:01.216668 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.216530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:51:01.228233 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.228211    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hznd4\""
Sep 11 03:51:01.236555 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.236499    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:51:01.248563 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.248449    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bp8v6\""
Sep 11 03:51:01.256809 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.256784    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"
Sep 11 03:51:01.399535 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.399494    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc"]
Sep 11 03:51:01.408080 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.408053    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"]
Sep 11 03:51:01.408241 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.408188    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc"
Sep 11 03:51:01.411108 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.411085    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79d99445d4-9hhp8"]
Sep 11 03:51:01.411558 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.411538    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"
Sep 11 03:51:01.412576 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.412557    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 03:51:01.412784 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.412770    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 03:51:01.413005 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.412988    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 03:51:01.413472 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.413161    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-kzvgj\""
Sep 11 03:51:01.413472 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.413342    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 11 03:51:01.414219 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.414200    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 03:51:01.414310 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.414217    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 03:51:01.414310 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.414262    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.414592 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.414575    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9llcd\""
Sep 11 03:51:01.415435 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.415277    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 03:51:01.415435 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.415294    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 03:51:01.417448 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.417176    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc"]
Sep 11 03:51:01.417524 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.417513    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 03:51:01.418337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.417637    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 03:51:01.418337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.417783    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 03:51:01.418337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.417843    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 03:51:01.418337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.418055    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 03:51:01.418337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.418069    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b78hg\""
Sep 11 03:51:01.418337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.418277    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 03:51:01.419456 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.419436    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"]
Sep 11 03:51:01.422193 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.422143    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79d99445d4-9hhp8"]
Sep 11 03:51:01.485977 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.485945    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2e9d136-2475-433a-b93b-76c4379a11a2-stats-auth\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.485977 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.485980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrgdg\" (UniqueName: \"kubernetes.io/projected/d2e9d136-2475-433a-b93b-76c4379a11a2-kube-api-access-jrgdg\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.486194 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.486002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2e9d136-2475-433a-b93b-76c4379a11a2-default-certificate\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.486194 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.486057    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7c79e0fc-5e34-4381-bfcf-57fe8430c7c2-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-mp9dn\" (UID: \"7c79e0fc-5e34-4381-bfcf-57fe8430c7c2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"
Sep 11 03:51:01.486194 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.486097    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srcl7\" (UniqueName: \"kubernetes.io/projected/7c79e0fc-5e34-4381-bfcf-57fe8430c7c2-kube-api-access-srcl7\") pod \"cluster-monitoring-operator-6cd954b897-mp9dn\" (UID: \"7c79e0fc-5e34-4381-bfcf-57fe8430c7c2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"
Sep 11 03:51:01.486194 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.486124    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e9d136-2475-433a-b93b-76c4379a11a2-service-ca-bundle\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.486194 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.486169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6faf7782-b1a6-442c-b22c-20237e505285-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55b4f599d4-tg5pc\" (UID: \"6faf7782-b1a6-442c-b22c-20237e505285\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc"
Sep 11 03:51:01.486381 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.486232    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g74px\" (UniqueName: \"kubernetes.io/projected/6faf7782-b1a6-442c-b22c-20237e505285-kube-api-access-g74px\") pod \"managed-serviceaccount-addon-agent-55b4f599d4-tg5pc\" (UID: \"6faf7782-b1a6-442c-b22c-20237e505285\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc"
Sep 11 03:51:01.486381 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.486305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e9d136-2475-433a-b93b-76c4379a11a2-metrics-certs\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.486381 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.486326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c79e0fc-5e34-4381-bfcf-57fe8430c7c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mp9dn\" (UID: \"7c79e0fc-5e34-4381-bfcf-57fe8430c7c2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"
Sep 11 03:51:01.512435 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.512362    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-9khwd"]
Sep 11 03:51:01.515667 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.515637    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-t4prc"]
Sep 11 03:51:01.515808 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.515692    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-9khwd"
Sep 11 03:51:01.518952 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.518564    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.518952 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.518724    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8nnr9\""
Sep 11 03:51:01.518952 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.518724    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 03:51:01.519192 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.519140    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 03:51:01.521145 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.521114    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 03:51:01.521655 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.521633    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 03:51:01.521768 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.521727    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 03:51:01.522068 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.522039    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 03:51:01.522979 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.522806    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qx2g2\""
Sep 11 03:51:01.527575 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.527556    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5949fcfbfd-2xc8v"]
Sep 11 03:51:01.529541 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:51:01.529515    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe23932_4bbe_4ea9_bd65_3263e1bae721.slice/crio-edf0b56eac5a9f7f3f4c3e1d923c196c14e4a2de1cbab9fc6678dd86e2cb2be8 WatchSource:0}: Error finding container edf0b56eac5a9f7f3f4c3e1d923c196c14e4a2de1cbab9fc6678dd86e2cb2be8: Status 404 returned error can't find the container with id edf0b56eac5a9f7f3f4c3e1d923c196c14e4a2de1cbab9fc6678dd86e2cb2be8
Sep 11 03:51:01.531137 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.531106    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 03:51:01.538686 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.538660    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-t4prc"]
Sep 11 03:51:01.539717 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.539619    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-9khwd"]
Sep 11 03:51:01.550844 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.550752    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zbhfp"]
Sep 11 03:51:01.556067 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:51:01.556017    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c172c0_bc0f_42e1_9183_2bfc7d021e3d.slice/crio-ab1ab3a558a01774e21753bfc26062b73c9f1d3124793007b15b3c6a4298505a WatchSource:0}: Error finding container ab1ab3a558a01774e21753bfc26062b73c9f1d3124793007b15b3c6a4298505a: Status 404 returned error can't find the container with id ab1ab3a558a01774e21753bfc26062b73c9f1d3124793007b15b3c6a4298505a
Sep 11 03:51:01.568614 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.568240    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw"]
Sep 11 03:51:01.572531 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:51:01.572498    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec394572_d8bc_4f3c_b9a6_1c35eb67a263.slice/crio-30ea1232155e6ad1682e79ee273e0f3bc32c0c91a50f7ad6780ac3a8d0ff740e WatchSource:0}: Error finding container 30ea1232155e6ad1682e79ee273e0f3bc32c0c91a50f7ad6780ac3a8d0ff740e: Status 404 returned error can't find the container with id 30ea1232155e6ad1682e79ee273e0f3bc32c0c91a50f7ad6780ac3a8d0ff740e
Sep 11 03:51:01.587316 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e9d136-2475-433a-b93b-76c4379a11a2-metrics-certs\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.587435 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c79e0fc-5e34-4381-bfcf-57fe8430c7c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mp9dn\" (UID: \"7c79e0fc-5e34-4381-bfcf-57fe8430c7c2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"
Sep 11 03:51:01.587510 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl4v5\" (UniqueName: \"kubernetes.io/projected/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-kube-api-access-gl4v5\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.587643 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2e9d136-2475-433a-b93b-76c4379a11a2-stats-auth\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.587643 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrgdg\" (UniqueName: \"kubernetes.io/projected/d2e9d136-2475-433a-b93b-76c4379a11a2-kube-api-access-jrgdg\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.587643 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-trusted-ca-bundle\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.588199 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2e9d136-2475-433a-b93b-76c4379a11a2-default-certificate\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.588199 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7c79e0fc-5e34-4381-bfcf-57fe8430c7c2-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-mp9dn\" (UID: \"7c79e0fc-5e34-4381-bfcf-57fe8430c7c2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"
Sep 11 03:51:01.588199 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srcl7\" (UniqueName: \"kubernetes.io/projected/7c79e0fc-5e34-4381-bfcf-57fe8430c7c2-kube-api-access-srcl7\") pod \"cluster-monitoring-operator-6cd954b897-mp9dn\" (UID: \"7c79e0fc-5e34-4381-bfcf-57fe8430c7c2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"
Sep 11 03:51:01.588199 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e9d136-2475-433a-b93b-76c4379a11a2-service-ca-bundle\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.588199 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6faf7782-b1a6-442c-b22c-20237e505285-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55b4f599d4-tg5pc\" (UID: \"6faf7782-b1a6-442c-b22c-20237e505285\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc"
Sep 11 03:51:01.588199 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj9nh\" (UniqueName: \"kubernetes.io/projected/d9479be1-1923-4787-84e8-a9c95221e6c0-kube-api-access-bj9nh\") pod \"downloads-76f99584f4-9khwd\" (UID: \"d9479be1-1923-4787-84e8-a9c95221e6c0\") " pod="openshift-console/downloads-76f99584f4-9khwd"
Sep 11 03:51:01.588199 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g74px\" (UniqueName: \"kubernetes.io/projected/6faf7782-b1a6-442c-b22c-20237e505285-kube-api-access-g74px\") pod \"managed-serviceaccount-addon-agent-55b4f599d4-tg5pc\" (UID: \"6faf7782-b1a6-442c-b22c-20237e505285\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc"
Sep 11 03:51:01.588199 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587945    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-serving-cert\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.588199 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.587971    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-tmp\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.588199 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.588189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-snapshots\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.588757 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.588215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-service-ca-bundle\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.588757 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.588684    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7c79e0fc-5e34-4381-bfcf-57fe8430c7c2-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-mp9dn\" (UID: \"7c79e0fc-5e34-4381-bfcf-57fe8430c7c2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"
Sep 11 03:51:01.589122 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.589012    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e9d136-2475-433a-b93b-76c4379a11a2-service-ca-bundle\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.590672 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.590648    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e9d136-2475-433a-b93b-76c4379a11a2-metrics-certs\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.590963 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.590931    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2e9d136-2475-433a-b93b-76c4379a11a2-stats-auth\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.591636 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.591616    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2e9d136-2475-433a-b93b-76c4379a11a2-default-certificate\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.592481 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.592458    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6faf7782-b1a6-442c-b22c-20237e505285-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55b4f599d4-tg5pc\" (UID: \"6faf7782-b1a6-442c-b22c-20237e505285\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc"
Sep 11 03:51:01.592951 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.592917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c79e0fc-5e34-4381-bfcf-57fe8430c7c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mp9dn\" (UID: \"7c79e0fc-5e34-4381-bfcf-57fe8430c7c2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"
Sep 11 03:51:01.603629 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.603582    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrgdg\" (UniqueName: \"kubernetes.io/projected/d2e9d136-2475-433a-b93b-76c4379a11a2-kube-api-access-jrgdg\") pod \"router-default-79d99445d4-9hhp8\" (UID: \"d2e9d136-2475-433a-b93b-76c4379a11a2\") " pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.608885 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.608861    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g74px\" (UniqueName: \"kubernetes.io/projected/6faf7782-b1a6-442c-b22c-20237e505285-kube-api-access-g74px\") pod \"managed-serviceaccount-addon-agent-55b4f599d4-tg5pc\" (UID: \"6faf7782-b1a6-442c-b22c-20237e505285\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc"
Sep 11 03:51:01.609397 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.609376    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srcl7\" (UniqueName: \"kubernetes.io/projected/7c79e0fc-5e34-4381-bfcf-57fe8430c7c2-kube-api-access-srcl7\") pod \"cluster-monitoring-operator-6cd954b897-mp9dn\" (UID: \"7c79e0fc-5e34-4381-bfcf-57fe8430c7c2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"
Sep 11 03:51:01.688747 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.688714    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-trusted-ca-bundle\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.688747 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.688760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj9nh\" (UniqueName: \"kubernetes.io/projected/d9479be1-1923-4787-84e8-a9c95221e6c0-kube-api-access-bj9nh\") pod \"downloads-76f99584f4-9khwd\" (UID: \"d9479be1-1923-4787-84e8-a9c95221e6c0\") " pod="openshift-console/downloads-76f99584f4-9khwd"
Sep 11 03:51:01.688966 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.688792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-serving-cert\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.688966 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.688808    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-tmp\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.688966 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.688827    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-snapshots\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.688966 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.688848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-service-ca-bundle\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.688966 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.688877    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl4v5\" (UniqueName: \"kubernetes.io/projected/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-kube-api-access-gl4v5\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.689677 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.689651    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-snapshots\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.689790 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.689692    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-tmp\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.689790 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.689729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-service-ca-bundle\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.689857 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.689794    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-trusted-ca-bundle\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.691766 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.691745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-serving-cert\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.701228 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.701199    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl4v5\" (UniqueName: \"kubernetes.io/projected/2be2cc42-8aab-4493-82bf-3c2c1eb8d688-kube-api-access-gl4v5\") pod \"insights-operator-5844b856db-t4prc\" (UID: \"2be2cc42-8aab-4493-82bf-3c2c1eb8d688\") " pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:01.701336 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.701287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj9nh\" (UniqueName: \"kubernetes.io/projected/d9479be1-1923-4787-84e8-a9c95221e6c0-kube-api-access-bj9nh\") pod \"downloads-76f99584f4-9khwd\" (UID: \"d9479be1-1923-4787-84e8-a9c95221e6c0\") " pod="openshift-console/downloads-76f99584f4-9khwd"
Sep 11 03:51:01.728272 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.728243    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc"
Sep 11 03:51:01.736454 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.736430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"
Sep 11 03:51:01.743646 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.743493    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:01.833173 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.832876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-9khwd"
Sep 11 03:51:01.843553 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:01.843524    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-t4prc"
Sep 11 03:51:02.024335 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.024211    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc"]
Sep 11 03:51:02.026885 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:51:02.026855    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6faf7782_b1a6_442c_b22c_20237e505285.slice/crio-bbb6658e8b60ff266ab282b5f597bf9e282bfa2a4e175e15251eb5105e29fe9b WatchSource:0}: Error finding container bbb6658e8b60ff266ab282b5f597bf9e282bfa2a4e175e15251eb5105e29fe9b: Status 404 returned error can't find the container with id bbb6658e8b60ff266ab282b5f597bf9e282bfa2a4e175e15251eb5105e29fe9b
Sep 11 03:51:02.030688 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.030628    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn"]
Sep 11 03:51:02.034774 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:51:02.034719    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c79e0fc_5e34_4381_bfcf_57fe8430c7c2.slice/crio-b8b5fd2d3d7d5cb9c3b037735ecaba0582f4049ce19b2fd7c0829e59b31a9852 WatchSource:0}: Error finding container b8b5fd2d3d7d5cb9c3b037735ecaba0582f4049ce19b2fd7c0829e59b31a9852: Status 404 returned error can't find the container with id b8b5fd2d3d7d5cb9c3b037735ecaba0582f4049ce19b2fd7c0829e59b31a9852
Sep 11 03:51:02.038484 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.038425    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc" event={"ID":"6faf7782-b1a6-442c-b22c-20237e505285","Type":"ContainerStarted","Data":"bbb6658e8b60ff266ab282b5f597bf9e282bfa2a4e175e15251eb5105e29fe9b"}
Sep 11 03:51:02.040262 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.040223    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw" event={"ID":"ec394572-d8bc-4f3c-b9a6-1c35eb67a263","Type":"ContainerStarted","Data":"30ea1232155e6ad1682e79ee273e0f3bc32c0c91a50f7ad6780ac3a8d0ff740e"}
Sep 11 03:51:02.041664 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.041636    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zbhfp" event={"ID":"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d","Type":"ContainerStarted","Data":"ab1ab3a558a01774e21753bfc26062b73c9f1d3124793007b15b3c6a4298505a"}
Sep 11 03:51:02.043534 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.043478    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v" event={"ID":"5fe23932-4bbe-4ea9-bd65-3263e1bae721","Type":"ContainerStarted","Data":"ecbe98c7fbae4b3ef5464f37fa719b59bfbffabc048a0f58afc797ee3d0c95e6"}
Sep 11 03:51:02.043534 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.043524    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v" event={"ID":"5fe23932-4bbe-4ea9-bd65-3263e1bae721","Type":"ContainerStarted","Data":"edf0b56eac5a9f7f3f4c3e1d923c196c14e4a2de1cbab9fc6678dd86e2cb2be8"}
Sep 11 03:51:02.043707 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.043676    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:51:02.045886 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.045866    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nm7zn" event={"ID":"5dc15c92-4ed2-4ffd-8fa5-3081b380b439","Type":"ContainerStarted","Data":"3985a6b20cbf116b370ebc84379cc61a552cebaa3de9533dddb190b4a03ddad9"}
Sep 11 03:51:02.045993 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.045901    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nm7zn" event={"ID":"5dc15c92-4ed2-4ffd-8fa5-3081b380b439","Type":"ContainerStarted","Data":"611324c307d41c8de126c9d969a93000a52ea6ee05c3b12a380714f4c9e481b1"}
Sep 11 03:51:02.061229 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.061206    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79d99445d4-9hhp8"]
Sep 11 03:51:02.062326 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:51:02.062299    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e9d136_2475_433a_b93b_76c4379a11a2.slice/crio-cbb0717ed06a84b57b8e3a29b1df7a671b576be9eaa96402349be33c0a634ae2 WatchSource:0}: Error finding container cbb0717ed06a84b57b8e3a29b1df7a671b576be9eaa96402349be33c0a634ae2: Status 404 returned error can't find the container with id cbb0717ed06a84b57b8e3a29b1df7a671b576be9eaa96402349be33c0a634ae2
Sep 11 03:51:02.066223 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.066181    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v" podStartSLOduration=67.066162614 podStartE2EDuration="1m7.066162614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:02.065032138 +0000 UTC m=+67.943224465" watchObservedRunningTime="2026-09-11 03:51:02.066162614 +0000 UTC m=+67.944355257"
Sep 11 03:51:02.080343 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.080300    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nm7zn" podStartSLOduration=65.9855489 podStartE2EDuration="1m7.080283799s" totalImagesPullingTime="1.094734899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:02.079929071 +0000 UTC m=+67.958121373" watchObservedRunningTime="2026-09-11 03:51:02.080283799 +0000 UTC m=+67.958476100"
Sep 11 03:51:02.128772 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.128744    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-9khwd"]
Sep 11 03:51:02.132196 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:51:02.132169    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9479be1_1923_4787_84e8_a9c95221e6c0.slice/crio-6e64eb4f70a840d77a444c2e0f9b18a373f30fb6086af830ef1389150d51a278 WatchSource:0}: Error finding container 6e64eb4f70a840d77a444c2e0f9b18a373f30fb6086af830ef1389150d51a278: Status 404 returned error can't find the container with id 6e64eb4f70a840d77a444c2e0f9b18a373f30fb6086af830ef1389150d51a278
Sep 11 03:51:02.146887 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:02.146783    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-t4prc"]
Sep 11 03:51:02.149619 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:51:02.149570    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be2cc42_8aab_4493_82bf_3c2c1eb8d688.slice/crio-4a01e28e2d58468fd8d386cc15a77786a1bd9036b1678f07fb7171bcc45b5481 WatchSource:0}: Error finding container 4a01e28e2d58468fd8d386cc15a77786a1bd9036b1678f07fb7171bcc45b5481: Status 404 returned error can't find the container with id 4a01e28e2d58468fd8d386cc15a77786a1bd9036b1678f07fb7171bcc45b5481
Sep 11 03:51:03.054429 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:03.053993    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-t4prc" event={"ID":"2be2cc42-8aab-4493-82bf-3c2c1eb8d688","Type":"ContainerStarted","Data":"4a01e28e2d58468fd8d386cc15a77786a1bd9036b1678f07fb7171bcc45b5481"}
Sep 11 03:51:03.057275 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:03.056786    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79d99445d4-9hhp8" event={"ID":"d2e9d136-2475-433a-b93b-76c4379a11a2","Type":"ContainerStarted","Data":"eada1323911c208582c428342adc431ad3b29e06b207186608c1c226227c3cee"}
Sep 11 03:51:03.057275 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:03.056835    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79d99445d4-9hhp8" event={"ID":"d2e9d136-2475-433a-b93b-76c4379a11a2","Type":"ContainerStarted","Data":"cbb0717ed06a84b57b8e3a29b1df7a671b576be9eaa96402349be33c0a634ae2"}
Sep 11 03:51:03.058586 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:03.058212    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn" event={"ID":"7c79e0fc-5e34-4381-bfcf-57fe8430c7c2","Type":"ContainerStarted","Data":"b8b5fd2d3d7d5cb9c3b037735ecaba0582f4049ce19b2fd7c0829e59b31a9852"}
Sep 11 03:51:03.060207 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:03.060033    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-9khwd" event={"ID":"d9479be1-1923-4787-84e8-a9c95221e6c0","Type":"ContainerStarted","Data":"6e64eb4f70a840d77a444c2e0f9b18a373f30fb6086af830ef1389150d51a278"}
Sep 11 03:51:03.077494 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:03.077443    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79d99445d4-9hhp8" podStartSLOduration=2.077425126 podStartE2EDuration="2.077425126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:51:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:03.077000514 +0000 UTC m=+68.955192818" watchObservedRunningTime="2026-09-11 03:51:03.077425126 +0000 UTC m=+68.955617430"
Sep 11 03:51:03.745309 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:03.743999    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:03.747521 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:03.747313    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:04.066270 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:04.066024    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:04.067565 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:04.067543    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79d99445d4-9hhp8"
Sep 11 03:51:10.100067 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.098927    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc" event={"ID":"6faf7782-b1a6-442c-b22c-20237e505285","Type":"ContainerStarted","Data":"78f5e66695afc95267d6744e84176ae00dfd606e3cc656b7f9345a17aa804722"}
Sep 11 03:51:10.101457 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.101426    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw" event={"ID":"ec394572-d8bc-4f3c-b9a6-1c35eb67a263","Type":"ContainerStarted","Data":"cfcb5b1010e0d1977ad721329b300e5b54ab5ec8f5181b9130507425c65c3ea8"}
Sep 11 03:51:10.103492 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.103464    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-t4prc" event={"ID":"2be2cc42-8aab-4493-82bf-3c2c1eb8d688","Type":"ContainerStarted","Data":"34d7f56a3da20ebba1d3790507d173a54e4fa8e3eae9a3fbd431a0b3205208d6"}
Sep 11 03:51:10.106231 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.106185    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qbqz4" event={"ID":"1aa676ca-bad6-45a7-8b9b-529c9bd74170","Type":"ContainerStarted","Data":"5f0c3c00d74c05f07e3ce9f62fb9de3becd357b74fe663c5a0d3ca222e34f980"}
Sep 11 03:51:10.108683 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.108630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn" event={"ID":"7c79e0fc-5e34-4381-bfcf-57fe8430c7c2","Type":"ContainerStarted","Data":"cd630597eaec3a1f537a638a86781979c4bddcb11ce95a0afc775217e6f0464d"}
Sep 11 03:51:10.111104 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.111073    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zbhfp" event={"ID":"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d","Type":"ContainerStarted","Data":"b227387c17ba58954cdf00413ce4e7f8a25fd61fa1a2ca42878fffe0c38e1c3b"}
Sep 11 03:51:10.111210 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.111127    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zbhfp" event={"ID":"a4c172c0-bc0f-42e1-9183-2bfc7d021e3d","Type":"ContainerStarted","Data":"4583df844dd1269971ba8c823710637ee9d79d30cf169adfaf74f184a49017af"}
Sep 11 03:51:10.111210 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.111168    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:51:10.117151 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.116951    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b4f599d4-tg5pc" podStartSLOduration=1.299257992 podStartE2EDuration="9.11693323s" totalImagesPullingTime="7.817675238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:10.116437195 +0000 UTC m=+75.994629495" watchObservedRunningTime="2026-09-11 03:51:10.11693323 +0000 UTC m=+75.995125530"
Sep 11 03:51:10.135640 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.135579    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zbhfp" podStartSLOduration=34.291879231 podStartE2EDuration="42.135559312s" totalImagesPullingTime="7.843680081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:10.135072146 +0000 UTC m=+76.013264447" watchObservedRunningTime="2026-09-11 03:51:10.135559312 +0000 UTC m=+76.013751612"
Sep 11 03:51:10.151242 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.150400    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-wv4lw" podStartSLOduration=35.02304016 podStartE2EDuration="42.150383079s" totalImagesPullingTime="7.127342919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:10.149988707 +0000 UTC m=+76.028181011" watchObservedRunningTime="2026-09-11 03:51:10.150383079 +0000 UTC m=+76.028575381"
Sep 11 03:51:10.187453 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.187400    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mp9dn" podStartSLOduration=1.821182738 podStartE2EDuration="9.187380641s" totalImagesPullingTime="7.366197903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:10.18625696 +0000 UTC m=+76.064449261" watchObservedRunningTime="2026-09-11 03:51:10.187380641 +0000 UTC m=+76.065572942"
Sep 11 03:51:10.188017 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.187969    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-t4prc" podStartSLOduration=1.930311127 podStartE2EDuration="9.187961661s" totalImagesPullingTime="7.257650534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:10.169177851 +0000 UTC m=+76.047370156" watchObservedRunningTime="2026-09-11 03:51:10.187961661 +0000 UTC m=+76.066153964"
Sep 11 03:51:10.208119 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.208070    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qbqz4" podStartSLOduration=65.530760468 podStartE2EDuration="1m15.208050899s" totalImagesPullingTime="9.677290431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:10.20805136 +0000 UTC m=+76.086243663" watchObservedRunningTime="2026-09-11 03:51:10.208050899 +0000 UTC m=+76.086243202"
Sep 11 03:51:10.802340 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.802302    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6zk87"]
Sep 11 03:51:10.837725 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.837680    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6zk87"]
Sep 11 03:51:10.837896 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.837826    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:10.840753 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.840724    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 03:51:10.840895 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.840801    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 03:51:10.840895 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.840797    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jpvnw\""
Sep 11 03:51:10.973330 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.973292    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7859e4ab-e97d-47de-b4a0-b97ad5c86465-crio-socket\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:10.973505 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.973344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx5sw\" (UniqueName: \"kubernetes.io/projected/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-api-access-hx5sw\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:10.973505 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.973396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:10.973505 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.973440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:10.973505 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:10.973475    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7859e4ab-e97d-47de-b4a0-b97ad5c86465-data-volume\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:11.073920 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:11.073835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7859e4ab-e97d-47de-b4a0-b97ad5c86465-crio-socket\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:11.073920 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:11.073879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx5sw\" (UniqueName: \"kubernetes.io/projected/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-api-access-hx5sw\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:11.074133 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:11.073934    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:11.074133 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:11.073983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:11.074133 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:11.074009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7859e4ab-e97d-47de-b4a0-b97ad5c86465-data-volume\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:11.074133 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:11.074014    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7859e4ab-e97d-47de-b4a0-b97ad5c86465-crio-socket\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:11.074287 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:11.074145    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 03:51:11.074287 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:11.074168    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 03:51:11.074287 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:11.074211    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls podName:7859e4ab-e97d-47de-b4a0-b97ad5c86465 nodeName:}" failed. No retries permitted until 2026-09-11 03:51:11.574191298 +0000 UTC m=+77.452383580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6zk87" (UID: "7859e4ab-e97d-47de-b4a0-b97ad5c86465") : secret "insights-runtime-extractor-tls" not found
Sep 11 03:51:11.074287 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:11.074233    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm podName:7859e4ab-e97d-47de-b4a0-b97ad5c86465 nodeName:}" failed. No retries permitted until 2026-09-11 03:51:11.574219709 +0000 UTC m=+77.452411989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6zk87" (UID: "7859e4ab-e97d-47de-b4a0-b97ad5c86465") : configmap "kube-rbac-proxy" not found
Sep 11 03:51:11.074425 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:11.074305    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7859e4ab-e97d-47de-b4a0-b97ad5c86465-data-volume\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:11.083258 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:11.083232    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx5sw\" (UniqueName: \"kubernetes.io/projected/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-api-access-hx5sw\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:11.579304 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:11.579271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:11.579722 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:11.579314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:11.579722 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:11.579399    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 03:51:11.579722 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:11.579431    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 03:51:11.579722 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:11.579463    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm podName:7859e4ab-e97d-47de-b4a0-b97ad5c86465 nodeName:}" failed. No retries permitted until 2026-09-11 03:51:12.579450968 +0000 UTC m=+78.457643251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6zk87" (UID: "7859e4ab-e97d-47de-b4a0-b97ad5c86465") : configmap "kube-rbac-proxy" not found
Sep 11 03:51:11.579722 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:11.579488    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls podName:7859e4ab-e97d-47de-b4a0-b97ad5c86465 nodeName:}" failed. No retries permitted until 2026-09-11 03:51:12.579473089 +0000 UTC m=+78.457665373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6zk87" (UID: "7859e4ab-e97d-47de-b4a0-b97ad5c86465") : secret "insights-runtime-extractor-tls" not found
Sep 11 03:51:12.587855 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:12.587812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:12.588301 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:12.587885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:12.588301 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:12.587996    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 03:51:12.588301 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:12.588030    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 03:51:12.588301 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:12.588081    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls podName:7859e4ab-e97d-47de-b4a0-b97ad5c86465 nodeName:}" failed. No retries permitted until 2026-09-11 03:51:14.588060376 +0000 UTC m=+80.466252656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6zk87" (UID: "7859e4ab-e97d-47de-b4a0-b97ad5c86465") : secret "insights-runtime-extractor-tls" not found
Sep 11 03:51:12.588301 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:12.588107    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm podName:7859e4ab-e97d-47de-b4a0-b97ad5c86465 nodeName:}" failed. No retries permitted until 2026-09-11 03:51:14.588092516 +0000 UTC m=+80.466284799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6zk87" (UID: "7859e4ab-e97d-47de-b4a0-b97ad5c86465") : configmap "kube-rbac-proxy" not found
Sep 11 03:51:12.991787 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:12.991744    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-wv4lw_ec394572-d8bc-4f3c-b9a6-1c35eb67a263/networking-console-plugin/0.log"
Sep 11 03:51:13.178677 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:13.178652    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 03:51:13.366932 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:13.366853    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/2.log"
Sep 11 03:51:14.605126 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:14.605093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:14.605639 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:14.605156    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:14.605639 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:14.605264    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 03:51:14.605639 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:14.605327    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm podName:7859e4ab-e97d-47de-b4a0-b97ad5c86465 nodeName:}" failed. No retries permitted until 2026-09-11 03:51:18.605309018 +0000 UTC m=+84.483501312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6zk87" (UID: "7859e4ab-e97d-47de-b4a0-b97ad5c86465") : configmap "kube-rbac-proxy" not found
Sep 11 03:51:14.605639 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:14.605343    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 03:51:14.605639 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:51:14.605383    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls podName:7859e4ab-e97d-47de-b4a0-b97ad5c86465 nodeName:}" failed. No retries permitted until 2026-09-11 03:51:18.605372618 +0000 UTC m=+84.483564898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6zk87" (UID: "7859e4ab-e97d-47de-b4a0-b97ad5c86465") : secret "insights-runtime-extractor-tls" not found
Sep 11 03:51:14.968102 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:14.968070    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zbhfp_a4c172c0-bc0f-42e1-9183-2bfc7d021e3d/dns/0.log"
Sep 11 03:51:15.171236 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:15.171207    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zbhfp_a4c172c0-bc0f-42e1-9183-2bfc7d021e3d/kube-rbac-proxy/0.log"
Sep 11 03:51:15.764656 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:15.764626    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9wpms_80d22450-38cf-43aa-a876-056cb4fbb8ea/dns-node-resolver/0.log"
Sep 11 03:51:15.965509 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:15.965481    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5949fcfbfd-2xc8v_5fe23932-4bbe-4ea9-bd65-3263e1bae721/registry/0.log"
Sep 11 03:51:16.563930 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:16.563901    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-625dw_939a41d8-9275-4697-aed4-124c74dd8128/node-ca/0.log"
Sep 11 03:51:17.169034 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:17.168981    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d99445d4-9hhp8_d2e9d136-2475-433a-b93b-76c4379a11a2/router/0.log"
Sep 11 03:51:17.764565 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:17.764536    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4h7p_83a3356b-727e-4cf5-88ec-c12797a2ab56/serve-healthcheck-canary/0.log"
Sep 11 03:51:17.966862 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:17.966830    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-6g47v_928fbdd8-5094-4dbd-ae72-a958f7654942/cluster-samples-operator/0.log"
Sep 11 03:51:18.166314 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.166211    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-6g47v_928fbdd8-5094-4dbd-ae72-a958f7654942/cluster-samples-operator-watch/0.log"
Sep 11 03:51:18.581484 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.581449    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xms2w"]
Sep 11 03:51:18.585961 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.585939    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.590476 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.590452    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 03:51:18.590595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.590481    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k2sm5\""
Sep 11 03:51:18.590933 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.590917    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 03:51:18.591987 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.591971    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 03:51:18.594668 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.594651    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 03:51:18.642520 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.642492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:18.642673 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.642539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:18.643110 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.643087    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7859e4ab-e97d-47de-b4a0-b97ad5c86465-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:18.645357 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.645334    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7859e4ab-e97d-47de-b4a0-b97ad5c86465-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6zk87\" (UID: \"7859e4ab-e97d-47de-b4a0-b97ad5c86465\") " pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:18.649207 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.649183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6zk87"
Sep 11 03:51:18.743659 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.743631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-textfile\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.743823 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.743667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-wtmp\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.743823 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.743695    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42f7196c-cd2a-4b44-b989-ee02a79401bb-root\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.743823 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.743711    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.743823 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.743783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-tls\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.744037 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.743867    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w66l7\" (UniqueName: \"kubernetes.io/projected/42f7196c-cd2a-4b44-b989-ee02a79401bb-kube-api-access-w66l7\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.744037 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.743927    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42f7196c-cd2a-4b44-b989-ee02a79401bb-sys\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.744037 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.743950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42f7196c-cd2a-4b44-b989-ee02a79401bb-metrics-client-ca\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.744037 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.743996    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.844954 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.844869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w66l7\" (UniqueName: \"kubernetes.io/projected/42f7196c-cd2a-4b44-b989-ee02a79401bb-kube-api-access-w66l7\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.844954 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.844918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42f7196c-cd2a-4b44-b989-ee02a79401bb-sys\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.844954 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.844946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42f7196c-cd2a-4b44-b989-ee02a79401bb-metrics-client-ca\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.845207 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.844989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.845207 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.845022    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42f7196c-cd2a-4b44-b989-ee02a79401bb-sys\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.845207 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.845031    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-textfile\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.845207 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.845079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-wtmp\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.845207 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.845135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42f7196c-cd2a-4b44-b989-ee02a79401bb-root\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.845207 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.845158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.845207 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.845189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-tls\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.845505 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.845338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-textfile\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.845505 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.845413    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42f7196c-cd2a-4b44-b989-ee02a79401bb-root\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.845624 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.845540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-wtmp\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.845878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.845846    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.846005 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.845917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42f7196c-cd2a-4b44-b989-ee02a79401bb-metrics-client-ca\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.848472 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.848453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.848584 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.848470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42f7196c-cd2a-4b44-b989-ee02a79401bb-node-exporter-tls\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.853855 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.853830    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w66l7\" (UniqueName: \"kubernetes.io/projected/42f7196c-cd2a-4b44-b989-ee02a79401bb-kube-api-access-w66l7\") pod \"node-exporter-xms2w\" (UID: \"42f7196c-cd2a-4b44-b989-ee02a79401bb\") " pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:18.896771 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:18.896746    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xms2w"
Sep 11 03:51:20.117852 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:20.117820    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zbhfp"
Sep 11 03:51:20.127179 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:51:20.127150    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f7196c_cd2a_4b44_b989_ee02a79401bb.slice/crio-ac0dd41ea8215fddb25dbd33e119d266d38ee8464b76e6a6a1e35f26b4ef2892 WatchSource:0}: Error finding container ac0dd41ea8215fddb25dbd33e119d266d38ee8464b76e6a6a1e35f26b4ef2892: Status 404 returned error can't find the container with id ac0dd41ea8215fddb25dbd33e119d266d38ee8464b76e6a6a1e35f26b4ef2892
Sep 11 03:51:20.166870 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:20.166829    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xms2w" event={"ID":"42f7196c-cd2a-4b44-b989-ee02a79401bb","Type":"ContainerStarted","Data":"ac0dd41ea8215fddb25dbd33e119d266d38ee8464b76e6a6a1e35f26b4ef2892"}
Sep 11 03:51:20.402179 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:20.402154    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6zk87"]
Sep 11 03:51:20.404262 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:51:20.404228    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7859e4ab_e97d_47de_b4a0_b97ad5c86465.slice/crio-91cf41aedc6a7cc3a3b7fbb093025aa1a652de301198b2efefae5480cb3a985d WatchSource:0}: Error finding container 91cf41aedc6a7cc3a3b7fbb093025aa1a652de301198b2efefae5480cb3a985d: Status 404 returned error can't find the container with id 91cf41aedc6a7cc3a3b7fbb093025aa1a652de301198b2efefae5480cb3a985d
Sep 11 03:51:21.181937 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:21.181827    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6zk87" event={"ID":"7859e4ab-e97d-47de-b4a0-b97ad5c86465","Type":"ContainerStarted","Data":"a4e1b8c5d06e0f1a1461c99c86f4b96693bbfece03205797aa6c2d7cbef6b88b"}
Sep 11 03:51:21.181937 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:21.181898    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6zk87" event={"ID":"7859e4ab-e97d-47de-b4a0-b97ad5c86465","Type":"ContainerStarted","Data":"91cf41aedc6a7cc3a3b7fbb093025aa1a652de301198b2efefae5480cb3a985d"}
Sep 11 03:51:21.185137 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:21.185020    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-9khwd" event={"ID":"d9479be1-1923-4787-84e8-a9c95221e6c0","Type":"ContainerStarted","Data":"3f77cc79b7b0c4dbddb803cbac8ef15566f6c27e80338390475e1fc986022f34"}
Sep 11 03:51:21.186131 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:21.186078    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-9khwd"
Sep 11 03:51:21.196227 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:21.196173    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-9khwd"
Sep 11 03:51:21.204188 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:21.203718    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-9khwd" podStartSLOduration=2.096917665 podStartE2EDuration="20.203700093s" totalImagesPullingTime="18.106782428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:21.202302116 +0000 UTC m=+87.080494419" watchObservedRunningTime="2026-09-11 03:51:21.203700093 +0000 UTC m=+87.081892398"
Sep 11 03:51:22.191976 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:22.191938    2575 generic.go:356] "Generic (PLEG): container finished" podID="42f7196c-cd2a-4b44-b989-ee02a79401bb" containerID="e1d0529376f453cff975eb1b918ea73491c1bdc4d08584e68ee9a422f837e482" exitCode=0
Sep 11 03:51:22.192444 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:22.192038    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xms2w" event={"ID":"42f7196c-cd2a-4b44-b989-ee02a79401bb","Type":"ContainerDied","Data":"e1d0529376f453cff975eb1b918ea73491c1bdc4d08584e68ee9a422f837e482"}
Sep 11 03:51:22.195271 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:22.195243    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6zk87" event={"ID":"7859e4ab-e97d-47de-b4a0-b97ad5c86465","Type":"ContainerStarted","Data":"d8f0a99d4cd41e7dfa5e06c4bdfcb03ef66ede300c43d96e688fc51686cc2310"}
Sep 11 03:51:23.066029 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:23.065995    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:51:23.204769 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:23.204671    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xms2w" event={"ID":"42f7196c-cd2a-4b44-b989-ee02a79401bb","Type":"ContainerStarted","Data":"586a92827eda6b555f3f12d1faa90d813ddebba07258624482a26d33026f84c5"}
Sep 11 03:51:23.204769 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:23.204731    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xms2w" event={"ID":"42f7196c-cd2a-4b44-b989-ee02a79401bb","Type":"ContainerStarted","Data":"53df62735525b79129317e5daceda0771ada6c34852c2e78ad8e6adec2cb4758"}
Sep 11 03:51:23.227499 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:23.227436    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xms2w" podStartSLOduration=4.113261992 podStartE2EDuration="5.22741657s" totalImagesPullingTime="1.014432846s" totalInitContainerRuntime="99.721732ms" isStatefulPod=true podCreationTimestamp="2026-09-11 03:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:23.226732608 +0000 UTC m=+89.104924911" watchObservedRunningTime="2026-09-11 03:51:23.22741657 +0000 UTC m=+89.105608871"
Sep 11 03:51:24.212976 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:24.212934    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6zk87" event={"ID":"7859e4ab-e97d-47de-b4a0-b97ad5c86465","Type":"ContainerStarted","Data":"da16ccb40a7c2de6df7d9733c5386235cfd7e22468da18a504bb1a4b7f75e416"}
Sep 11 03:51:24.233409 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:24.233349    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6zk87" podStartSLOduration=10.869010811999999 podStartE2EDuration="14.233333307s" totalImagesPullingTime="3.364322495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:51:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:24.231544741 +0000 UTC m=+90.109737056" watchObservedRunningTime="2026-09-11 03:51:24.233333307 +0000 UTC m=+90.111525608"
Sep 11 03:51:25.136538 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:25.136502    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5949fcfbfd-2xc8v"]
Sep 11 03:51:28.459279 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.459244    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-748d44bc6d-vthgg"]
Sep 11 03:51:28.507113 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.507074    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748d44bc6d-vthgg"]
Sep 11 03:51:28.507283 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.507202    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.511713 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.511688    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 03:51:28.511848 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.511718    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 03:51:28.511848 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.511738    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 03:51:28.512337 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.512316    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 03:51:28.512754 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.512737    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sq84r\""
Sep 11 03:51:28.512953 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.512938    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 03:51:28.520009 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.519987    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 03:51:28.543111 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.543085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-config\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.543258 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.543145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-service-ca\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.543258 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.543173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-serving-cert\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.543258 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.543193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-trusted-ca-bundle\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.543258 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.543238    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-oauth-config\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.543460 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.543313    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-oauth-serving-cert\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.543460 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.543354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kz4j\" (UniqueName: \"kubernetes.io/projected/d9ed7a97-79ea-4510-866e-4dc14b9629a3-kube-api-access-6kz4j\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.644174 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.644139    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-service-ca\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.644364 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.644186    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-serving-cert\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.644364 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.644208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-trusted-ca-bundle\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.644364 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.644233    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-oauth-config\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.644364 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.644280    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-oauth-serving-cert\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.644364 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.644315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kz4j\" (UniqueName: \"kubernetes.io/projected/d9ed7a97-79ea-4510-866e-4dc14b9629a3-kube-api-access-6kz4j\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.644364 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.644362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-config\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.645079 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.645050    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-oauth-serving-cert\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.645330 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.645309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-trusted-ca-bundle\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.645626 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.645574    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-service-ca\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.645809 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.645786    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-config\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.647319 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.647298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-oauth-config\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.648119 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.648096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-serving-cert\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.653524 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.653500    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kz4j\" (UniqueName: \"kubernetes.io/projected/d9ed7a97-79ea-4510-866e-4dc14b9629a3-kube-api-access-6kz4j\") pod \"console-748d44bc6d-vthgg\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") " pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:28.819388 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:28.819336    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:29.124632 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:29.124469    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748d44bc6d-vthgg"]
Sep 11 03:51:29.127143 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:51:29.127112    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ed7a97_79ea_4510_866e_4dc14b9629a3.slice/crio-0ff2c7ec285d596bfee3862c142d07b18dfa934506fa7e2fff551481500bd0d7 WatchSource:0}: Error finding container 0ff2c7ec285d596bfee3862c142d07b18dfa934506fa7e2fff551481500bd0d7: Status 404 returned error can't find the container with id 0ff2c7ec285d596bfee3862c142d07b18dfa934506fa7e2fff551481500bd0d7
Sep 11 03:51:29.236232 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:29.236191    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748d44bc6d-vthgg" event={"ID":"d9ed7a97-79ea-4510-866e-4dc14b9629a3","Type":"ContainerStarted","Data":"0ff2c7ec285d596bfee3862c142d07b18dfa934506fa7e2fff551481500bd0d7"}
Sep 11 03:51:31.034331 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:31.034299    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hqtwx"
Sep 11 03:51:33.254006 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:33.253975    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748d44bc6d-vthgg" event={"ID":"d9ed7a97-79ea-4510-866e-4dc14b9629a3","Type":"ContainerStarted","Data":"4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a"}
Sep 11 03:51:33.276120 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:33.276074    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-748d44bc6d-vthgg" podStartSLOduration=2.007133237 podStartE2EDuration="5.276059293s" totalImagesPullingTime="3.268926056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:51:33.274765099 +0000 UTC m=+99.152957401" watchObservedRunningTime="2026-09-11 03:51:33.276059293 +0000 UTC m=+99.154251595"
Sep 11 03:51:38.820284 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:38.820239    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:38.820780 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:38.820311    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:38.825012 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:38.824991    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:39.278988 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:39.278963    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:51:50.159339 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.159299    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v" podUID="5fe23932-4bbe-4ea9-bd65-3263e1bae721" containerName="registry" containerID="cri-o://ecbe98c7fbae4b3ef5464f37fa719b59bfbffabc048a0f58afc797ee3d0c95e6" gracePeriod=30
Sep 11 03:51:50.318467 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.318438    2575 generic.go:356] "Generic (PLEG): container finished" podID="5fe23932-4bbe-4ea9-bd65-3263e1bae721" containerID="ecbe98c7fbae4b3ef5464f37fa719b59bfbffabc048a0f58afc797ee3d0c95e6" exitCode=0
Sep 11 03:51:50.318639 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.318497    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v" event={"ID":"5fe23932-4bbe-4ea9-bd65-3263e1bae721","Type":"ContainerDied","Data":"ecbe98c7fbae4b3ef5464f37fa719b59bfbffabc048a0f58afc797ee3d0c95e6"}
Sep 11 03:51:50.402060 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.402038    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:51:50.524511 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.524478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls\") pod \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") "
Sep 11 03:51:50.524745 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.524534    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz5pv\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-kube-api-access-rz5pv\") pod \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") "
Sep 11 03:51:50.524745 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.524565    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-trusted-ca\") pod \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") "
Sep 11 03:51:50.524745 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.524649    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-image-registry-private-configuration\") pod \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") "
Sep 11 03:51:50.524745 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.524683    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-installation-pull-secrets\") pod \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") "
Sep 11 03:51:50.524745 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.524706    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-bound-sa-token\") pod \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") "
Sep 11 03:51:50.524745 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.524744    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fe23932-4bbe-4ea9-bd65-3263e1bae721-ca-trust-extracted\") pod \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") "
Sep 11 03:51:50.525020 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.524780    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-certificates\") pod \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\" (UID: \"5fe23932-4bbe-4ea9-bd65-3263e1bae721\") "
Sep 11 03:51:50.525285 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.525252    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5fe23932-4bbe-4ea9-bd65-3263e1bae721" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:51:50.525661 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.525637    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5fe23932-4bbe-4ea9-bd65-3263e1bae721" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:51:50.527314 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.527286    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5fe23932-4bbe-4ea9-bd65-3263e1bae721" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:51:50.527451 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.527403    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5fe23932-4bbe-4ea9-bd65-3263e1bae721" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 03:51:50.527451 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.527437    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-kube-api-access-rz5pv" (OuterVolumeSpecName: "kube-api-access-rz5pv") pod "5fe23932-4bbe-4ea9-bd65-3263e1bae721" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721"). InnerVolumeSpecName "kube-api-access-rz5pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:51:50.527675 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.527655    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5fe23932-4bbe-4ea9-bd65-3263e1bae721" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:51:50.527723 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.527688    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5fe23932-4bbe-4ea9-bd65-3263e1bae721" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 03:51:50.533933 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.533906    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe23932-4bbe-4ea9-bd65-3263e1bae721-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5fe23932-4bbe-4ea9-bd65-3263e1bae721" (UID: "5fe23932-4bbe-4ea9-bd65-3263e1bae721"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:51:50.626207 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.626176    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fe23932-4bbe-4ea9-bd65-3263e1bae721-ca-trust-extracted\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:51:50.626207 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.626204    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-certificates\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:51:50.626403 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.626217    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-registry-tls\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:51:50.626403 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.626230    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz5pv\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-kube-api-access-rz5pv\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:51:50.626403 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.626240    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fe23932-4bbe-4ea9-bd65-3263e1bae721-trusted-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:51:50.626403 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.626253    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-image-registry-private-configuration\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:51:50.626403 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.626265    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fe23932-4bbe-4ea9-bd65-3263e1bae721-installation-pull-secrets\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:51:50.626403 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:50.626278    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fe23932-4bbe-4ea9-bd65-3263e1bae721-bound-sa-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:51:51.323928 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:51.323886    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v" event={"ID":"5fe23932-4bbe-4ea9-bd65-3263e1bae721","Type":"ContainerDied","Data":"edf0b56eac5a9f7f3f4c3e1d923c196c14e4a2de1cbab9fc6678dd86e2cb2be8"}
Sep 11 03:51:51.324324 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:51.323944    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5949fcfbfd-2xc8v"
Sep 11 03:51:51.324324 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:51.323979    2575 scope.go:117] "RemoveContainer" containerID="ecbe98c7fbae4b3ef5464f37fa719b59bfbffabc048a0f58afc797ee3d0c95e6"
Sep 11 03:51:51.341022 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:51.340998    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5949fcfbfd-2xc8v"]
Sep 11 03:51:51.344564 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:51.344543    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5949fcfbfd-2xc8v"]
Sep 11 03:51:52.630859 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:51:52.630828    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe23932-4bbe-4ea9-bd65-3263e1bae721" path="/var/lib/kubelet/pods/5fe23932-4bbe-4ea9-bd65-3263e1bae721/volumes"
Sep 11 03:52:02.366162 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:02.366127    2575 generic.go:356] "Generic (PLEG): container finished" podID="7f3b15bd-4948-4c13-959a-e6fe1536e4ae" containerID="110bc59905740c88e0edf6cd51558fc6d77487bf644c62c227dde97d63e93d6b" exitCode=0
Sep 11 03:52:02.366162 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:02.366170    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq" event={"ID":"7f3b15bd-4948-4c13-959a-e6fe1536e4ae","Type":"ContainerDied","Data":"110bc59905740c88e0edf6cd51558fc6d77487bf644c62c227dde97d63e93d6b"}
Sep 11 03:52:02.366633 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:02.366503    2575 scope.go:117] "RemoveContainer" containerID="110bc59905740c88e0edf6cd51558fc6d77487bf644c62c227dde97d63e93d6b"
Sep 11 03:52:03.371235 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:03.371203    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-kx2qq" event={"ID":"7f3b15bd-4948-4c13-959a-e6fe1536e4ae","Type":"ContainerStarted","Data":"ddd907b1610f1a038b504eec133241a4cdc5bc8d4aa8302412d6aed08d534330"}
Sep 11 03:52:07.387019 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:07.386989    2575 generic.go:356] "Generic (PLEG): container finished" podID="4b24e197-b19c-4b52-b4f2-d847a7430ecc" containerID="0fdbad1da0591e5b7592dcb466184f33d95bcf3f761a97b07f3d76353288ead6" exitCode=0
Sep 11 03:52:07.387455 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:07.387056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c" event={"ID":"4b24e197-b19c-4b52-b4f2-d847a7430ecc","Type":"ContainerDied","Data":"0fdbad1da0591e5b7592dcb466184f33d95bcf3f761a97b07f3d76353288ead6"}
Sep 11 03:52:07.387455 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:07.387350    2575 scope.go:117] "RemoveContainer" containerID="0fdbad1da0591e5b7592dcb466184f33d95bcf3f761a97b07f3d76353288ead6"
Sep 11 03:52:08.392310 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:08.392277    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9t26c" event={"ID":"4b24e197-b19c-4b52-b4f2-d847a7430ecc","Type":"ContainerStarted","Data":"2223ee937bb3dc89a40533c83689c9c4baccae94dd72866ab650b03065df9fad"}
Sep 11 03:52:48.183489 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.183418    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f4bb5d7d5-rblx6"]
Sep 11 03:52:48.183993 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.183758    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe23932-4bbe-4ea9-bd65-3263e1bae721" containerName="registry"
Sep 11 03:52:48.183993 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.183772    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe23932-4bbe-4ea9-bd65-3263e1bae721" containerName="registry"
Sep 11 03:52:48.183993 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.183824    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe23932-4bbe-4ea9-bd65-3263e1bae721" containerName="registry"
Sep 11 03:52:48.186783 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.186760    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.200771 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.200742    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f4bb5d7d5-rblx6"]
Sep 11 03:52:48.239479 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.239453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-serving-cert\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.239641 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.239492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-oauth-serving-cert\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.239641 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.239581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-trusted-ca-bundle\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.239718 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.239640    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-service-ca\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.239718 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.239660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb57l\" (UniqueName: \"kubernetes.io/projected/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-kube-api-access-kb57l\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.239718 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.239714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-config\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.239816 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.239734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-oauth-config\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.340331 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.340295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-config\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.340331 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.340334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-oauth-config\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.340565 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.340358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-serving-cert\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.340565 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.340494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-oauth-serving-cert\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.340701 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.340582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-trusted-ca-bundle\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.340701 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.340633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-service-ca\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.340701 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.340663    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb57l\" (UniqueName: \"kubernetes.io/projected/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-kube-api-access-kb57l\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.341284 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.341260    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-service-ca\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.341370 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.341258    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-oauth-serving-cert\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.341409 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.341382    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-config\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.341750 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.341721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-trusted-ca-bundle\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.343149 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.343127    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-serving-cert\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.343241 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.343181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-oauth-config\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.348016 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.347991    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb57l\" (UniqueName: \"kubernetes.io/projected/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-kube-api-access-kb57l\") pod \"console-5f4bb5d7d5-rblx6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") " pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.496875 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.496847    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:48.766540 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:48.766474    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f4bb5d7d5-rblx6"]
Sep 11 03:52:48.769993 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:52:48.769969    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6bf9b1_aa97_4938_a0fb_1091cacdfed6.slice/crio-8b7dc2422629988505d7d69a927d3650a63e2acfbedc367df15476f114461c9b WatchSource:0}: Error finding container 8b7dc2422629988505d7d69a927d3650a63e2acfbedc367df15476f114461c9b: Status 404 returned error can't find the container with id 8b7dc2422629988505d7d69a927d3650a63e2acfbedc367df15476f114461c9b
Sep 11 03:52:49.541990 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:49.541958    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f4bb5d7d5-rblx6" event={"ID":"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6","Type":"ContainerStarted","Data":"16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28"}
Sep 11 03:52:49.542374 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:49.542006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f4bb5d7d5-rblx6" event={"ID":"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6","Type":"ContainerStarted","Data":"8b7dc2422629988505d7d69a927d3650a63e2acfbedc367df15476f114461c9b"}
Sep 11 03:52:49.559543 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:49.559497    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f4bb5d7d5-rblx6" podStartSLOduration=1.559482342 podStartE2EDuration="1.559482342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:52:49.558538551 +0000 UTC m=+175.436730865" watchObservedRunningTime="2026-09-11 03:52:49.559482342 +0000 UTC m=+175.437674643"
Sep 11 03:52:58.497788 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:58.497737    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:58.498332 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:58.497830    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:58.502795 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:58.502767    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:58.579417 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:58.579387    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:52:58.632560 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:52:58.632519    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-748d44bc6d-vthgg"]
Sep 11 03:53:23.655117 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:23.655075    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-748d44bc6d-vthgg" podUID="d9ed7a97-79ea-4510-866e-4dc14b9629a3" containerName="console" containerID="cri-o://4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a" gracePeriod=15
Sep 11 03:53:23.892751 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:23.892726    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:53:24.003444 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.003421    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-serving-cert\") pod \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") "
Sep 11 03:53:24.003595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.003466    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-config\") pod \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") "
Sep 11 03:53:24.003595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.003513    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-trusted-ca-bundle\") pod \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") "
Sep 11 03:53:24.003595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.003536    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-oauth-config\") pod \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") "
Sep 11 03:53:24.003595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.003581    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-service-ca\") pod \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") "
Sep 11 03:53:24.003816 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.003741    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-oauth-serving-cert\") pod \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") "
Sep 11 03:53:24.003816 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.003804    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kz4j\" (UniqueName: \"kubernetes.io/projected/d9ed7a97-79ea-4510-866e-4dc14b9629a3-kube-api-access-6kz4j\") pod \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\" (UID: \"d9ed7a97-79ea-4510-866e-4dc14b9629a3\") "
Sep 11 03:53:24.003988 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.003963    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-config" (OuterVolumeSpecName: "console-config") pod "d9ed7a97-79ea-4510-866e-4dc14b9629a3" (UID: "d9ed7a97-79ea-4510-866e-4dc14b9629a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:53:24.004054 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.003978    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "d9ed7a97-79ea-4510-866e-4dc14b9629a3" (UID: "d9ed7a97-79ea-4510-866e-4dc14b9629a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:53:24.004054 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.003992    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d9ed7a97-79ea-4510-866e-4dc14b9629a3" (UID: "d9ed7a97-79ea-4510-866e-4dc14b9629a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:53:24.004193 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.004161    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:53:24.004193 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.004188    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-trusted-ca-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:53:24.004301 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.004203    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:53:24.004301 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.004197    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d9ed7a97-79ea-4510-866e-4dc14b9629a3" (UID: "d9ed7a97-79ea-4510-866e-4dc14b9629a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:53:24.005950 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.005925    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d9ed7a97-79ea-4510-866e-4dc14b9629a3" (UID: "d9ed7a97-79ea-4510-866e-4dc14b9629a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 03:53:24.006040 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.005960    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d9ed7a97-79ea-4510-866e-4dc14b9629a3" (UID: "d9ed7a97-79ea-4510-866e-4dc14b9629a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 03:53:24.006040 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.005973    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9ed7a97-79ea-4510-866e-4dc14b9629a3-kube-api-access-6kz4j" (OuterVolumeSpecName: "kube-api-access-6kz4j") pod "d9ed7a97-79ea-4510-866e-4dc14b9629a3" (UID: "d9ed7a97-79ea-4510-866e-4dc14b9629a3"). InnerVolumeSpecName "kube-api-access-6kz4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:53:24.105231 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.105188    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-oauth-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:53:24.105231 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.105224    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9ed7a97-79ea-4510-866e-4dc14b9629a3-oauth-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:53:24.105231 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.105236    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kz4j\" (UniqueName: \"kubernetes.io/projected/d9ed7a97-79ea-4510-866e-4dc14b9629a3-kube-api-access-6kz4j\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:53:24.105231 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.105245    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9ed7a97-79ea-4510-866e-4dc14b9629a3-console-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:53:24.666807 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.666773    2575 generic.go:356] "Generic (PLEG): container finished" podID="d9ed7a97-79ea-4510-866e-4dc14b9629a3" containerID="4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a" exitCode=0
Sep 11 03:53:24.667189 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.666813    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748d44bc6d-vthgg"
Sep 11 03:53:24.667189 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.666847    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748d44bc6d-vthgg" event={"ID":"d9ed7a97-79ea-4510-866e-4dc14b9629a3","Type":"ContainerDied","Data":"4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a"}
Sep 11 03:53:24.667189 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.666894    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748d44bc6d-vthgg" event={"ID":"d9ed7a97-79ea-4510-866e-4dc14b9629a3","Type":"ContainerDied","Data":"0ff2c7ec285d596bfee3862c142d07b18dfa934506fa7e2fff551481500bd0d7"}
Sep 11 03:53:24.667189 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.666915    2575 scope.go:117] "RemoveContainer" containerID="4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a"
Sep 11 03:53:24.674793 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.674773    2575 scope.go:117] "RemoveContainer" containerID="4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a"
Sep 11 03:53:24.675083 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:53:24.675054    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a\": container with ID starting with 4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a not found: ID does not exist" containerID="4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a"
Sep 11 03:53:24.675152 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.675096    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a"} err="failed to get container status \"4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a\": rpc error: code = NotFound desc = could not find container \"4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a\": container with ID starting with 4685c83e8c52291b30bf19f7a9d0b3c3716afd6733014e12609563b0cf4d155a not found: ID does not exist"
Sep 11 03:53:24.684731 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.684706    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-748d44bc6d-vthgg"]
Sep 11 03:53:24.688641 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:24.688619    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-748d44bc6d-vthgg"]
Sep 11 03:53:26.631054 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:53:26.631020    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9ed7a97-79ea-4510-866e-4dc14b9629a3" path="/var/lib/kubelet/pods/d9ed7a97-79ea-4510-866e-4dc14b9629a3/volumes"
Sep 11 03:54:05.255956 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.255920    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"]
Sep 11 03:54:05.256532 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.256322    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ed7a97-79ea-4510-866e-4dc14b9629a3" containerName="console"
Sep 11 03:54:05.256532 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.256341    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ed7a97-79ea-4510-866e-4dc14b9629a3" containerName="console"
Sep 11 03:54:05.256532 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.256440    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ed7a97-79ea-4510-866e-4dc14b9629a3" containerName="console"
Sep 11 03:54:05.260618 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.260580    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:05.263288 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.263271    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 03:54:05.264164 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.264144    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qgwlc\""
Sep 11 03:54:05.264255 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.264146    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 03:54:05.271745 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.271724    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"]
Sep 11 03:54:05.311042 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.311017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:05.311162 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.311051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:05.311162 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.311073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgjvm\" (UniqueName: \"kubernetes.io/projected/61046c4e-8ebe-42d4-a2f9-cad69f955875-kube-api-access-dgjvm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:05.412410 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.412383    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:05.412521 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.412419    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:05.412521 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.412445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgjvm\" (UniqueName: \"kubernetes.io/projected/61046c4e-8ebe-42d4-a2f9-cad69f955875-kube-api-access-dgjvm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:05.412763 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.412746    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:05.412802 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.412774    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:05.421011 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.420986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgjvm\" (UniqueName: \"kubernetes.io/projected/61046c4e-8ebe-42d4-a2f9-cad69f955875-kube-api-access-dgjvm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:05.569819 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.569762    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:05.838107 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:05.838083    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"]
Sep 11 03:54:05.840467 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:54:05.840424    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61046c4e_8ebe_42d4_a2f9_cad69f955875.slice/crio-e4e51c1fcaf7446ffe74c66981277379992bcedd684e54550d402f8279840548 WatchSource:0}: Error finding container e4e51c1fcaf7446ffe74c66981277379992bcedd684e54550d402f8279840548: Status 404 returned error can't find the container with id e4e51c1fcaf7446ffe74c66981277379992bcedd684e54550d402f8279840548
Sep 11 03:54:06.815557 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:06.815525    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp" event={"ID":"61046c4e-8ebe-42d4-a2f9-cad69f955875","Type":"ContainerStarted","Data":"e4e51c1fcaf7446ffe74c66981277379992bcedd684e54550d402f8279840548"}
Sep 11 03:54:13.845708 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:13.845645    2575 generic.go:356] "Generic (PLEG): container finished" podID="61046c4e-8ebe-42d4-a2f9-cad69f955875" containerID="6de4006e607bb5ae41a9dd71dfeb3bf90873c3ee8132aae71e5c7a05da2a783a" exitCode=0
Sep 11 03:54:13.846099 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:13.845745    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp" event={"ID":"61046c4e-8ebe-42d4-a2f9-cad69f955875","Type":"ContainerDied","Data":"6de4006e607bb5ae41a9dd71dfeb3bf90873c3ee8132aae71e5c7a05da2a783a"}
Sep 11 03:54:16.859174 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:16.859140    2575 generic.go:356] "Generic (PLEG): container finished" podID="61046c4e-8ebe-42d4-a2f9-cad69f955875" containerID="760ee692faf767d7a8c508aba49a17657a0c8d433db27074d53bd540955521d9" exitCode=0
Sep 11 03:54:16.859577 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:16.859212    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp" event={"ID":"61046c4e-8ebe-42d4-a2f9-cad69f955875","Type":"ContainerDied","Data":"760ee692faf767d7a8c508aba49a17657a0c8d433db27074d53bd540955521d9"}
Sep 11 03:54:24.898362 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:24.898322    2575 generic.go:356] "Generic (PLEG): container finished" podID="61046c4e-8ebe-42d4-a2f9-cad69f955875" containerID="f14d415df0de2773a58ea76d1fc2c9c35641353284485465b5b2af65cbafd5bc" exitCode=0
Sep 11 03:54:24.898795 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:24.898410    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp" event={"ID":"61046c4e-8ebe-42d4-a2f9-cad69f955875","Type":"ContainerDied","Data":"f14d415df0de2773a58ea76d1fc2c9c35641353284485465b5b2af65cbafd5bc"}
Sep 11 03:54:26.031552 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.031529    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:26.187664 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.187549    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-util\") pod \"61046c4e-8ebe-42d4-a2f9-cad69f955875\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") "
Sep 11 03:54:26.187664 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.187645    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgjvm\" (UniqueName: \"kubernetes.io/projected/61046c4e-8ebe-42d4-a2f9-cad69f955875-kube-api-access-dgjvm\") pod \"61046c4e-8ebe-42d4-a2f9-cad69f955875\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") "
Sep 11 03:54:26.187904 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.187674    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-bundle\") pod \"61046c4e-8ebe-42d4-a2f9-cad69f955875\" (UID: \"61046c4e-8ebe-42d4-a2f9-cad69f955875\") "
Sep 11 03:54:26.188343 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.188318    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-bundle" (OuterVolumeSpecName: "bundle") pod "61046c4e-8ebe-42d4-a2f9-cad69f955875" (UID: "61046c4e-8ebe-42d4-a2f9-cad69f955875"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:54:26.190004 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.189967    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61046c4e-8ebe-42d4-a2f9-cad69f955875-kube-api-access-dgjvm" (OuterVolumeSpecName: "kube-api-access-dgjvm") pod "61046c4e-8ebe-42d4-a2f9-cad69f955875" (UID: "61046c4e-8ebe-42d4-a2f9-cad69f955875"). InnerVolumeSpecName "kube-api-access-dgjvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:54:26.192364 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.192343    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-util" (OuterVolumeSpecName: "util") pod "61046c4e-8ebe-42d4-a2f9-cad69f955875" (UID: "61046c4e-8ebe-42d4-a2f9-cad69f955875"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:54:26.288663 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.288625    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:54:26.288663 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.288653    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgjvm\" (UniqueName: \"kubernetes.io/projected/61046c4e-8ebe-42d4-a2f9-cad69f955875-kube-api-access-dgjvm\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:54:26.288663 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.288662    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61046c4e-8ebe-42d4-a2f9-cad69f955875-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:54:26.908165 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.908093    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp"
Sep 11 03:54:26.908299 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.908101    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dvgcp" event={"ID":"61046c4e-8ebe-42d4-a2f9-cad69f955875","Type":"ContainerDied","Data":"e4e51c1fcaf7446ffe74c66981277379992bcedd684e54550d402f8279840548"}
Sep 11 03:54:26.908299 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:26.908214    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4e51c1fcaf7446ffe74c66981277379992bcedd684e54550d402f8279840548"
Sep 11 03:54:33.328656 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.328622    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26"]
Sep 11 03:54:33.329080 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.328897    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61046c4e-8ebe-42d4-a2f9-cad69f955875" containerName="pull"
Sep 11 03:54:33.329080 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.328907    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="61046c4e-8ebe-42d4-a2f9-cad69f955875" containerName="pull"
Sep 11 03:54:33.329080 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.328920    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61046c4e-8ebe-42d4-a2f9-cad69f955875" containerName="util"
Sep 11 03:54:33.329080 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.328926    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="61046c4e-8ebe-42d4-a2f9-cad69f955875" containerName="util"
Sep 11 03:54:33.329080 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.328932    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61046c4e-8ebe-42d4-a2f9-cad69f955875" containerName="extract"
Sep 11 03:54:33.329080 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.328937    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="61046c4e-8ebe-42d4-a2f9-cad69f955875" containerName="extract"
Sep 11 03:54:33.329080 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.329002    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="61046c4e-8ebe-42d4-a2f9-cad69f955875" containerName="extract"
Sep 11 03:54:33.334914 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.334897    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26"
Sep 11 03:54:33.337590 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.337566    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 03:54:33.337751 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.337633    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:54:33.337751 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.337658    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fl9ls\""
Sep 11 03:54:33.348443 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.348419    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26"]
Sep 11 03:54:33.446058 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.446026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e588e2ad-f353-4156-a234-9efb24787236-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nxs26\" (UID: \"e588e2ad-f353-4156-a234-9efb24787236\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26"
Sep 11 03:54:33.446196 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.446070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5pkv\" (UniqueName: \"kubernetes.io/projected/e588e2ad-f353-4156-a234-9efb24787236-kube-api-access-p5pkv\") pod \"cert-manager-operator-controller-manager-55c444bf86-nxs26\" (UID: \"e588e2ad-f353-4156-a234-9efb24787236\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26"
Sep 11 03:54:33.546522 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.546489    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e588e2ad-f353-4156-a234-9efb24787236-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nxs26\" (UID: \"e588e2ad-f353-4156-a234-9efb24787236\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26"
Sep 11 03:54:33.546711 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.546536    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5pkv\" (UniqueName: \"kubernetes.io/projected/e588e2ad-f353-4156-a234-9efb24787236-kube-api-access-p5pkv\") pod \"cert-manager-operator-controller-manager-55c444bf86-nxs26\" (UID: \"e588e2ad-f353-4156-a234-9efb24787236\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26"
Sep 11 03:54:33.546950 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.546933    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e588e2ad-f353-4156-a234-9efb24787236-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nxs26\" (UID: \"e588e2ad-f353-4156-a234-9efb24787236\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26"
Sep 11 03:54:33.556484 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.556463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5pkv\" (UniqueName: \"kubernetes.io/projected/e588e2ad-f353-4156-a234-9efb24787236-kube-api-access-p5pkv\") pod \"cert-manager-operator-controller-manager-55c444bf86-nxs26\" (UID: \"e588e2ad-f353-4156-a234-9efb24787236\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26"
Sep 11 03:54:33.643465 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.643392    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26"
Sep 11 03:54:33.925888 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:33.925811    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26"]
Sep 11 03:54:33.930640 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:54:33.930611    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode588e2ad_f353_4156_a234_9efb24787236.slice/crio-860bfd9d5258b90060d04c6e97a3b7f80b59dc19fc55912956b4435b1fd09874 WatchSource:0}: Error finding container 860bfd9d5258b90060d04c6e97a3b7f80b59dc19fc55912956b4435b1fd09874: Status 404 returned error can't find the container with id 860bfd9d5258b90060d04c6e97a3b7f80b59dc19fc55912956b4435b1fd09874
Sep 11 03:54:34.939184 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:34.939129    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26" event={"ID":"e588e2ad-f353-4156-a234-9efb24787236","Type":"ContainerStarted","Data":"860bfd9d5258b90060d04c6e97a3b7f80b59dc19fc55912956b4435b1fd09874"}
Sep 11 03:54:35.945252 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:35.945166    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26" event={"ID":"e588e2ad-f353-4156-a234-9efb24787236","Type":"ContainerStarted","Data":"d38ac9661e51ed14f0fcd3da1f63be56d6bc73b1acc8e6c48ed21a5819fc5957"}
Sep 11 03:54:35.997953 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:35.997910    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nxs26" podStartSLOduration=1.395321968 podStartE2EDuration="2.997893698s" totalImagesPullingTime="1.60257173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:35.995438454 +0000 UTC m=+281.873630756" watchObservedRunningTime="2026-09-11 03:54:35.997893698 +0000 UTC m=+281.876085998"
Sep 11 03:54:37.742846 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.742808    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"]
Sep 11 03:54:37.746181 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.746164    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:37.748857 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.748830    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 03:54:37.748971 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.748875    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 03:54:37.749034 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.749012    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qgwlc\""
Sep 11 03:54:37.756540 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.756517    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"]
Sep 11 03:54:37.885689 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.885659    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6xfp\" (UniqueName: \"kubernetes.io/projected/f944d96c-de06-482e-b1bb-007381276246-kube-api-access-d6xfp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:37.885854 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.885696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:37.885854 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.885771    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:37.986508 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.986479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:37.986685 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.986541    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6xfp\" (UniqueName: \"kubernetes.io/projected/f944d96c-de06-482e-b1bb-007381276246-kube-api-access-d6xfp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:37.986685 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.986576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:37.986951 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.986929    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:37.986990 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.986938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:37.995780 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:37.995725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6xfp\" (UniqueName: \"kubernetes.io/projected/f944d96c-de06-482e-b1bb-007381276246-kube-api-access-d6xfp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:38.054859 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:38.054832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:38.323225 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:38.323200    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"]
Sep 11 03:54:38.325429 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:54:38.325404    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf944d96c_de06_482e_b1bb_007381276246.slice/crio-5d8025a8fe75681215de9e459206da9ce67a2ad0ad1567e8e9e6ef8c6677a3f5 WatchSource:0}: Error finding container 5d8025a8fe75681215de9e459206da9ce67a2ad0ad1567e8e9e6ef8c6677a3f5: Status 404 returned error can't find the container with id 5d8025a8fe75681215de9e459206da9ce67a2ad0ad1567e8e9e6ef8c6677a3f5
Sep 11 03:54:38.958966 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:38.958936    2575 generic.go:356] "Generic (PLEG): container finished" podID="f944d96c-de06-482e-b1bb-007381276246" containerID="bb5957a11bd26f93c691c871c84444edbdb25c3f2fa81b2d880e1bb4a6d1e81b" exitCode=0
Sep 11 03:54:38.959372 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:38.959018    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn" event={"ID":"f944d96c-de06-482e-b1bb-007381276246","Type":"ContainerDied","Data":"bb5957a11bd26f93c691c871c84444edbdb25c3f2fa81b2d880e1bb4a6d1e81b"}
Sep 11 03:54:38.959372 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:38.959081    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn" event={"ID":"f944d96c-de06-482e-b1bb-007381276246","Type":"ContainerStarted","Data":"5d8025a8fe75681215de9e459206da9ce67a2ad0ad1567e8e9e6ef8c6677a3f5"}
Sep 11 03:54:41.975087 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:41.975048    2575 generic.go:356] "Generic (PLEG): container finished" podID="f944d96c-de06-482e-b1bb-007381276246" containerID="49a16c37c92d3ad28594dbe619691b8032c88f3a72742537d6d3ff82e87e2641" exitCode=0
Sep 11 03:54:41.975496 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:41.975107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn" event={"ID":"f944d96c-de06-482e-b1bb-007381276246","Type":"ContainerDied","Data":"49a16c37c92d3ad28594dbe619691b8032c88f3a72742537d6d3ff82e87e2641"}
Sep 11 03:54:42.981248 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:42.981214    2575 generic.go:356] "Generic (PLEG): container finished" podID="f944d96c-de06-482e-b1bb-007381276246" containerID="60599014ddc42f9c51fccea230c483500cc914843ce0d4d1e66b056372fe507a" exitCode=0
Sep 11 03:54:42.981633 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:42.981320    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn" event={"ID":"f944d96c-de06-482e-b1bb-007381276246","Type":"ContainerDied","Data":"60599014ddc42f9c51fccea230c483500cc914843ce0d4d1e66b056372fe507a"}
Sep 11 03:54:44.108538 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.108513    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:44.237484 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.237410    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-util\") pod \"f944d96c-de06-482e-b1bb-007381276246\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") "
Sep 11 03:54:44.237484 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.237444    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6xfp\" (UniqueName: \"kubernetes.io/projected/f944d96c-de06-482e-b1bb-007381276246-kube-api-access-d6xfp\") pod \"f944d96c-de06-482e-b1bb-007381276246\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") "
Sep 11 03:54:44.237682 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.237500    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-bundle\") pod \"f944d96c-de06-482e-b1bb-007381276246\" (UID: \"f944d96c-de06-482e-b1bb-007381276246\") "
Sep 11 03:54:44.237941 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.237909    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-bundle" (OuterVolumeSpecName: "bundle") pod "f944d96c-de06-482e-b1bb-007381276246" (UID: "f944d96c-de06-482e-b1bb-007381276246"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:54:44.239738 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.239712    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f944d96c-de06-482e-b1bb-007381276246-kube-api-access-d6xfp" (OuterVolumeSpecName: "kube-api-access-d6xfp") pod "f944d96c-de06-482e-b1bb-007381276246" (UID: "f944d96c-de06-482e-b1bb-007381276246"). InnerVolumeSpecName "kube-api-access-d6xfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:54:44.241807 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.241774    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-util" (OuterVolumeSpecName: "util") pod "f944d96c-de06-482e-b1bb-007381276246" (UID: "f944d96c-de06-482e-b1bb-007381276246"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:54:44.338750 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.338716    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6xfp\" (UniqueName: \"kubernetes.io/projected/f944d96c-de06-482e-b1bb-007381276246-kube-api-access-d6xfp\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:54:44.338750 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.338746    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:54:44.338750 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.338756    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f944d96c-de06-482e-b1bb-007381276246-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:54:44.991132 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.991104    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn"
Sep 11 03:54:44.991132 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.991119    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfqsn" event={"ID":"f944d96c-de06-482e-b1bb-007381276246","Type":"ContainerDied","Data":"5d8025a8fe75681215de9e459206da9ce67a2ad0ad1567e8e9e6ef8c6677a3f5"}
Sep 11 03:54:44.991303 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:44.991159    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d8025a8fe75681215de9e459206da9ce67a2ad0ad1567e8e9e6ef8c6677a3f5"
Sep 11 03:54:46.754923 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.754892    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4blhb"]
Sep 11 03:54:46.755291 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.755153    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f944d96c-de06-482e-b1bb-007381276246" containerName="extract"
Sep 11 03:54:46.755291 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.755164    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f944d96c-de06-482e-b1bb-007381276246" containerName="extract"
Sep 11 03:54:46.755291 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.755183    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f944d96c-de06-482e-b1bb-007381276246" containerName="util"
Sep 11 03:54:46.755291 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.755189    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f944d96c-de06-482e-b1bb-007381276246" containerName="util"
Sep 11 03:54:46.755291 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.755199    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f944d96c-de06-482e-b1bb-007381276246" containerName="pull"
Sep 11 03:54:46.755291 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.755205    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f944d96c-de06-482e-b1bb-007381276246" containerName="pull"
Sep 11 03:54:46.755291 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.755263    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f944d96c-de06-482e-b1bb-007381276246" containerName="extract"
Sep 11 03:54:46.759466 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.759450    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4blhb"
Sep 11 03:54:46.761994 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.761965    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 03:54:46.762129 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.762030    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 03:54:46.762898 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.762882    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ctm2d\""
Sep 11 03:54:46.767235 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.767212    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4blhb"]
Sep 11 03:54:46.857705 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.857676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97066000-9b39-4c95-a893-68ed7caa7032-bound-sa-token\") pod \"cert-manager-55b4d954d5-4blhb\" (UID: \"97066000-9b39-4c95-a893-68ed7caa7032\") " pod="cert-manager/cert-manager-55b4d954d5-4blhb"
Sep 11 03:54:46.857825 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.857724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lvs6\" (UniqueName: \"kubernetes.io/projected/97066000-9b39-4c95-a893-68ed7caa7032-kube-api-access-5lvs6\") pod \"cert-manager-55b4d954d5-4blhb\" (UID: \"97066000-9b39-4c95-a893-68ed7caa7032\") " pod="cert-manager/cert-manager-55b4d954d5-4blhb"
Sep 11 03:54:46.959040 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.959007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lvs6\" (UniqueName: \"kubernetes.io/projected/97066000-9b39-4c95-a893-68ed7caa7032-kube-api-access-5lvs6\") pod \"cert-manager-55b4d954d5-4blhb\" (UID: \"97066000-9b39-4c95-a893-68ed7caa7032\") " pod="cert-manager/cert-manager-55b4d954d5-4blhb"
Sep 11 03:54:46.959267 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.959074    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97066000-9b39-4c95-a893-68ed7caa7032-bound-sa-token\") pod \"cert-manager-55b4d954d5-4blhb\" (UID: \"97066000-9b39-4c95-a893-68ed7caa7032\") " pod="cert-manager/cert-manager-55b4d954d5-4blhb"
Sep 11 03:54:46.968947 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.968924    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97066000-9b39-4c95-a893-68ed7caa7032-bound-sa-token\") pod \"cert-manager-55b4d954d5-4blhb\" (UID: \"97066000-9b39-4c95-a893-68ed7caa7032\") " pod="cert-manager/cert-manager-55b4d954d5-4blhb"
Sep 11 03:54:46.969042 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:46.968996    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lvs6\" (UniqueName: \"kubernetes.io/projected/97066000-9b39-4c95-a893-68ed7caa7032-kube-api-access-5lvs6\") pod \"cert-manager-55b4d954d5-4blhb\" (UID: \"97066000-9b39-4c95-a893-68ed7caa7032\") " pod="cert-manager/cert-manager-55b4d954d5-4blhb"
Sep 11 03:54:47.068417 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:47.068344    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4blhb"
Sep 11 03:54:47.340200 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:47.340175    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4blhb"]
Sep 11 03:54:47.342789 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:54:47.342760    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97066000_9b39_4c95_a893_68ed7caa7032.slice/crio-7e6362bfa4324fd7bcaf0a621b94d7f335c5a36d8edc6941539cc3ee5512ab52 WatchSource:0}: Error finding container 7e6362bfa4324fd7bcaf0a621b94d7f335c5a36d8edc6941539cc3ee5512ab52: Status 404 returned error can't find the container with id 7e6362bfa4324fd7bcaf0a621b94d7f335c5a36d8edc6941539cc3ee5512ab52
Sep 11 03:54:48.006379 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:48.006330    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4blhb" event={"ID":"97066000-9b39-4c95-a893-68ed7caa7032","Type":"ContainerStarted","Data":"7e6362bfa4324fd7bcaf0a621b94d7f335c5a36d8edc6941539cc3ee5512ab52"}
Sep 11 03:54:50.018519 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:50.018487    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4blhb" event={"ID":"97066000-9b39-4c95-a893-68ed7caa7032","Type":"ContainerStarted","Data":"bf146a792d18a4944a3620344027128e337a3ee061d087c6b5d06c4498a0702a"}
Sep 11 03:54:50.036023 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:50.035975    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4blhb" podStartSLOduration=1.453064862 podStartE2EDuration="4.035960207s" totalImagesPullingTime="2.582895345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:54:50.034681204 +0000 UTC m=+295.912873506" watchObservedRunningTime="2026-09-11 03:54:50.035960207 +0000 UTC m=+295.914152508"
Sep 11 03:54:54.554249 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:54.554222    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 03:54:54.556925 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:54.556904    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 03:54:54.565563 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:54.565546    2575 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 03:54:57.391204 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.391171    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"]
Sep 11 03:54:57.393925 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.393909    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:54:57.396427 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.396410    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 03:54:57.397347 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.397321    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qgwlc\""
Sep 11 03:54:57.397438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.397324    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 03:54:57.407009 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.406987    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"]
Sep 11 03:54:57.439505 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.439479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57zmx\" (UniqueName: \"kubernetes.io/projected/5870c2e0-3664-4f5b-92cb-a248bf23f23f-kube-api-access-57zmx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:54:57.439595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.439539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:54:57.439595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.439568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:54:57.540268 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.540238    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57zmx\" (UniqueName: \"kubernetes.io/projected/5870c2e0-3664-4f5b-92cb-a248bf23f23f-kube-api-access-57zmx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:54:57.540409 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.540296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:54:57.540409 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.540325    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:54:57.540749 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.540729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:54:57.540819 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.540750    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:54:57.550743 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.550720    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57zmx\" (UniqueName: \"kubernetes.io/projected/5870c2e0-3664-4f5b-92cb-a248bf23f23f-kube-api-access-57zmx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:54:57.703169 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.703106    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:54:57.973574 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:57.973513    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"]
Sep 11 03:54:57.975847 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:54:57.975813    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5870c2e0_3664_4f5b_92cb_a248bf23f23f.slice/crio-5c17c733d7882c74bac602cc74969ae052763c59c8a40e63966eb685d485b85e WatchSource:0}: Error finding container 5c17c733d7882c74bac602cc74969ae052763c59c8a40e63966eb685d485b85e: Status 404 returned error can't find the container with id 5c17c733d7882c74bac602cc74969ae052763c59c8a40e63966eb685d485b85e
Sep 11 03:54:58.053931 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:58.053891    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8" event={"ID":"5870c2e0-3664-4f5b-92cb-a248bf23f23f","Type":"ContainerStarted","Data":"6e1c62c0307a5714c2e970ee51ccd036dae1c7286f2149fc4c4e284f31c4a1ac"}
Sep 11 03:54:58.054082 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:58.053969    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8" event={"ID":"5870c2e0-3664-4f5b-92cb-a248bf23f23f","Type":"ContainerStarted","Data":"5c17c733d7882c74bac602cc74969ae052763c59c8a40e63966eb685d485b85e"}
Sep 11 03:54:59.060289 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:59.060254    2575 generic.go:356] "Generic (PLEG): container finished" podID="5870c2e0-3664-4f5b-92cb-a248bf23f23f" containerID="6e1c62c0307a5714c2e970ee51ccd036dae1c7286f2149fc4c4e284f31c4a1ac" exitCode=0
Sep 11 03:54:59.060686 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:59.060355    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8" event={"ID":"5870c2e0-3664-4f5b-92cb-a248bf23f23f","Type":"ContainerDied","Data":"6e1c62c0307a5714c2e970ee51ccd036dae1c7286f2149fc4c4e284f31c4a1ac"}
Sep 11 03:54:59.060802 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:54:59.060787    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 03:55:00.066222 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:00.066187    2575 generic.go:356] "Generic (PLEG): container finished" podID="5870c2e0-3664-4f5b-92cb-a248bf23f23f" containerID="9eda64f07657272a0af6610533a4e68c694f286377bde4c9bf574ebd93e17716" exitCode=0
Sep 11 03:55:00.066700 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:00.066222    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8" event={"ID":"5870c2e0-3664-4f5b-92cb-a248bf23f23f","Type":"ContainerDied","Data":"9eda64f07657272a0af6610533a4e68c694f286377bde4c9bf574ebd93e17716"}
Sep 11 03:55:01.073081 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:01.073048    2575 generic.go:356] "Generic (PLEG): container finished" podID="5870c2e0-3664-4f5b-92cb-a248bf23f23f" containerID="3ef123281782d8e23aaa8db9762f67df9098698d6b607d7d7f0c97a6eeca108f" exitCode=0
Sep 11 03:55:01.073477 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:01.073107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8" event={"ID":"5870c2e0-3664-4f5b-92cb-a248bf23f23f","Type":"ContainerDied","Data":"3ef123281782d8e23aaa8db9762f67df9098698d6b607d7d7f0c97a6eeca108f"}
Sep 11 03:55:02.206049 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:02.206024    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:55:02.270580 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:02.270548    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-util\") pod \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") "
Sep 11 03:55:02.270773 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:02.270593    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57zmx\" (UniqueName: \"kubernetes.io/projected/5870c2e0-3664-4f5b-92cb-a248bf23f23f-kube-api-access-57zmx\") pod \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") "
Sep 11 03:55:02.270773 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:02.270675    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-bundle\") pod \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\" (UID: \"5870c2e0-3664-4f5b-92cb-a248bf23f23f\") "
Sep 11 03:55:02.271475 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:02.271445    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-bundle" (OuterVolumeSpecName: "bundle") pod "5870c2e0-3664-4f5b-92cb-a248bf23f23f" (UID: "5870c2e0-3664-4f5b-92cb-a248bf23f23f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:55:02.272989 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:02.272962    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5870c2e0-3664-4f5b-92cb-a248bf23f23f-kube-api-access-57zmx" (OuterVolumeSpecName: "kube-api-access-57zmx") pod "5870c2e0-3664-4f5b-92cb-a248bf23f23f" (UID: "5870c2e0-3664-4f5b-92cb-a248bf23f23f"). InnerVolumeSpecName "kube-api-access-57zmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:55:02.275877 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:02.275853    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-util" (OuterVolumeSpecName: "util") pod "5870c2e0-3664-4f5b-92cb-a248bf23f23f" (UID: "5870c2e0-3664-4f5b-92cb-a248bf23f23f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:55:02.371453 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:02.371370    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57zmx\" (UniqueName: \"kubernetes.io/projected/5870c2e0-3664-4f5b-92cb-a248bf23f23f-kube-api-access-57zmx\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:55:02.371453 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:02.371402    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:55:02.371453 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:02.371412    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5870c2e0-3664-4f5b-92cb-a248bf23f23f-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:55:03.086729 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:03.086691    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8" event={"ID":"5870c2e0-3664-4f5b-92cb-a248bf23f23f","Type":"ContainerDied","Data":"5c17c733d7882c74bac602cc74969ae052763c59c8a40e63966eb685d485b85e"}
Sep 11 03:55:03.086729 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:03.086731    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afncgr8"
Sep 11 03:55:03.086926 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:03.086745    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c17c733d7882c74bac602cc74969ae052763c59c8a40e63966eb685d485b85e"
Sep 11 03:55:08.752186 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.752155    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"]
Sep 11 03:55:08.752553 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.752443    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5870c2e0-3664-4f5b-92cb-a248bf23f23f" containerName="pull"
Sep 11 03:55:08.752553 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.752453    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5870c2e0-3664-4f5b-92cb-a248bf23f23f" containerName="pull"
Sep 11 03:55:08.752553 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.752462    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5870c2e0-3664-4f5b-92cb-a248bf23f23f" containerName="util"
Sep 11 03:55:08.752553 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.752467    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5870c2e0-3664-4f5b-92cb-a248bf23f23f" containerName="util"
Sep 11 03:55:08.752553 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.752481    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5870c2e0-3664-4f5b-92cb-a248bf23f23f" containerName="extract"
Sep 11 03:55:08.752553 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.752486    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5870c2e0-3664-4f5b-92cb-a248bf23f23f" containerName="extract"
Sep 11 03:55:08.752553 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.752539    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5870c2e0-3664-4f5b-92cb-a248bf23f23f" containerName="extract"
Sep 11 03:55:08.755828 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.755809    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:08.758471 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.758442    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 03:55:08.758614 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.758479    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qgwlc\""
Sep 11 03:55:08.758614 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.758516    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 03:55:08.764519 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.764495    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"]
Sep 11 03:55:08.812372 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.812342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:08.812520 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.812396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrfzw\" (UniqueName: \"kubernetes.io/projected/1c2dfecb-defe-4696-9adf-065c9c36fc00-kube-api-access-qrfzw\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:08.812520 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.812421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:08.913396 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.913362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:08.913575 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.913408    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:08.913575 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.913450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrfzw\" (UniqueName: \"kubernetes.io/projected/1c2dfecb-defe-4696-9adf-065c9c36fc00-kube-api-access-qrfzw\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:08.913791 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.913773    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:08.913829 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.913802    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:08.922249 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:08.922225    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrfzw\" (UniqueName: \"kubernetes.io/projected/1c2dfecb-defe-4696-9adf-065c9c36fc00-kube-api-access-qrfzw\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:09.065245 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:09.065183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:09.343482 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:09.343456    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"]
Sep 11 03:55:09.345158 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:55:09.345131    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2dfecb_defe_4696_9adf_065c9c36fc00.slice/crio-e9e627b091eb9839256635c502c3a8b1a5a874511f35881127523af173f2e688 WatchSource:0}: Error finding container e9e627b091eb9839256635c502c3a8b1a5a874511f35881127523af173f2e688: Status 404 returned error can't find the container with id e9e627b091eb9839256635c502c3a8b1a5a874511f35881127523af173f2e688
Sep 11 03:55:10.119116 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:10.119081    2575 generic.go:356] "Generic (PLEG): container finished" podID="1c2dfecb-defe-4696-9adf-065c9c36fc00" containerID="5e8b65871bab626b009aba4a6878446029427ba9f6d50877d2ec749bd4fc6321" exitCode=0
Sep 11 03:55:10.119520 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:10.119158    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt" event={"ID":"1c2dfecb-defe-4696-9adf-065c9c36fc00","Type":"ContainerDied","Data":"5e8b65871bab626b009aba4a6878446029427ba9f6d50877d2ec749bd4fc6321"}
Sep 11 03:55:10.119520 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:10.119203    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt" event={"ID":"1c2dfecb-defe-4696-9adf-065c9c36fc00","Type":"ContainerStarted","Data":"e9e627b091eb9839256635c502c3a8b1a5a874511f35881127523af173f2e688"}
Sep 11 03:55:11.126975 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.126941    2575 generic.go:356] "Generic (PLEG): container finished" podID="1c2dfecb-defe-4696-9adf-065c9c36fc00" containerID="2ae67cc652a623b7556e2dff680f78dfe87bd0cd6f96552df0a192861642a966" exitCode=0
Sep 11 03:55:11.127649 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.126979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt" event={"ID":"1c2dfecb-defe-4696-9adf-065c9c36fc00","Type":"ContainerDied","Data":"2ae67cc652a623b7556e2dff680f78dfe87bd0cd6f96552df0a192861642a966"}
Sep 11 03:55:11.279079 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.279053    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"]
Sep 11 03:55:11.282237 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.282207    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.285137 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.285114    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 03:55:11.285316 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.285294    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 03:55:11.285449 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.285342    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 03:55:11.285449 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.285415    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 03:55:11.285737 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.285679    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cm9z7\""
Sep 11 03:55:11.304478 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.304458    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"]
Sep 11 03:55:11.333005 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.332972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8172994-ce6a-44fc-aadc-075b1e9207d2-manifests\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.333121 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.333022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8172994-ce6a-44fc-aadc-075b1e9207d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.333121 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.333089    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8172994-ce6a-44fc-aadc-075b1e9207d2-tmp\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.333248 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.333137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8172994-ce6a-44fc-aadc-075b1e9207d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.333248 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.333182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlgdt\" (UniqueName: \"kubernetes.io/projected/d8172994-ce6a-44fc-aadc-075b1e9207d2-kube-api-access-mlgdt\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.433843 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.433745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8172994-ce6a-44fc-aadc-075b1e9207d2-manifests\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.433843 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.433796    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8172994-ce6a-44fc-aadc-075b1e9207d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.433843 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.433846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8172994-ce6a-44fc-aadc-075b1e9207d2-tmp\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.434064 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.433879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8172994-ce6a-44fc-aadc-075b1e9207d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.434064 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.433917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlgdt\" (UniqueName: \"kubernetes.io/projected/d8172994-ce6a-44fc-aadc-075b1e9207d2-kube-api-access-mlgdt\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.434137 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.434117    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8172994-ce6a-44fc-aadc-075b1e9207d2-manifests\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.436200 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.436171    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8172994-ce6a-44fc-aadc-075b1e9207d2-tmp\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.436399 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.436372    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8172994-ce6a-44fc-aadc-075b1e9207d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.436544 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.436523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8172994-ce6a-44fc-aadc-075b1e9207d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.446358 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.446334    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlgdt\" (UniqueName: \"kubernetes.io/projected/d8172994-ce6a-44fc-aadc-075b1e9207d2-kube-api-access-mlgdt\") pod \"opendatahub-operator-controller-manager-97cf4878d-dflqm\" (UID: \"d8172994-ce6a-44fc-aadc-075b1e9207d2\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.641295 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.641251    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:11.917575 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:11.917545    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"]
Sep 11 03:55:11.920521 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:55:11.920497    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8172994_ce6a_44fc_aadc_075b1e9207d2.slice/crio-f3b7663530423bd9b913fec5ede7192f4cf6779f3f104da7dbb9d62b459a4966 WatchSource:0}: Error finding container f3b7663530423bd9b913fec5ede7192f4cf6779f3f104da7dbb9d62b459a4966: Status 404 returned error can't find the container with id f3b7663530423bd9b913fec5ede7192f4cf6779f3f104da7dbb9d62b459a4966
Sep 11 03:55:12.134203 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:12.134169    2575 generic.go:356] "Generic (PLEG): container finished" podID="1c2dfecb-defe-4696-9adf-065c9c36fc00" containerID="2132d60a7bed8de92048f181263e0eb73f5dbac6093d80236b86f6e2e58f08e3" exitCode=0
Sep 11 03:55:12.134674 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:12.134250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt" event={"ID":"1c2dfecb-defe-4696-9adf-065c9c36fc00","Type":"ContainerDied","Data":"2132d60a7bed8de92048f181263e0eb73f5dbac6093d80236b86f6e2e58f08e3"}
Sep 11 03:55:12.135679 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:12.135657    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm" event={"ID":"d8172994-ce6a-44fc-aadc-075b1e9207d2","Type":"ContainerStarted","Data":"f3b7663530423bd9b913fec5ede7192f4cf6779f3f104da7dbb9d62b459a4966"}
Sep 11 03:55:13.294948 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:13.294922    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:13.351846 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:13.351809    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-bundle\") pod \"1c2dfecb-defe-4696-9adf-065c9c36fc00\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") "
Sep 11 03:55:13.352016 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:13.351866    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-util\") pod \"1c2dfecb-defe-4696-9adf-065c9c36fc00\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") "
Sep 11 03:55:13.352016 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:13.351960    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrfzw\" (UniqueName: \"kubernetes.io/projected/1c2dfecb-defe-4696-9adf-065c9c36fc00-kube-api-access-qrfzw\") pod \"1c2dfecb-defe-4696-9adf-065c9c36fc00\" (UID: \"1c2dfecb-defe-4696-9adf-065c9c36fc00\") "
Sep 11 03:55:13.352727 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:13.352697    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-bundle" (OuterVolumeSpecName: "bundle") pod "1c2dfecb-defe-4696-9adf-065c9c36fc00" (UID: "1c2dfecb-defe-4696-9adf-065c9c36fc00"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:55:13.355036 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:13.355007    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c2dfecb-defe-4696-9adf-065c9c36fc00-kube-api-access-qrfzw" (OuterVolumeSpecName: "kube-api-access-qrfzw") pod "1c2dfecb-defe-4696-9adf-065c9c36fc00" (UID: "1c2dfecb-defe-4696-9adf-065c9c36fc00"). InnerVolumeSpecName "kube-api-access-qrfzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:55:13.359595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:13.359544    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-util" (OuterVolumeSpecName: "util") pod "1c2dfecb-defe-4696-9adf-065c9c36fc00" (UID: "1c2dfecb-defe-4696-9adf-065c9c36fc00"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:55:13.453755 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:13.453644    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:55:13.453755 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:13.453676    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c2dfecb-defe-4696-9adf-065c9c36fc00-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:55:13.453755 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:13.453690    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrfzw\" (UniqueName: \"kubernetes.io/projected/1c2dfecb-defe-4696-9adf-065c9c36fc00-kube-api-access-qrfzw\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:55:14.149416 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:14.149380    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt" event={"ID":"1c2dfecb-defe-4696-9adf-065c9c36fc00","Type":"ContainerDied","Data":"e9e627b091eb9839256635c502c3a8b1a5a874511f35881127523af173f2e688"}
Sep 11 03:55:14.149416 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:14.149404    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04r2jt"
Sep 11 03:55:14.149658 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:14.149432    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9e627b091eb9839256635c502c3a8b1a5a874511f35881127523af173f2e688"
Sep 11 03:55:15.156568 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:15.156536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm" event={"ID":"d8172994-ce6a-44fc-aadc-075b1e9207d2","Type":"ContainerStarted","Data":"6c93e8db6e9e16afb879e40529fefd28d8fd0fdde60e1f0ef9b7a541d0ca7384"}
Sep 11 03:55:16.167656 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:16.167626    2575 generic.go:356] "Generic (PLEG): container finished" podID="d8172994-ce6a-44fc-aadc-075b1e9207d2" containerID="6c93e8db6e9e16afb879e40529fefd28d8fd0fdde60e1f0ef9b7a541d0ca7384" exitCode=0
Sep 11 03:55:16.168065 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:16.167673    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm" event={"ID":"d8172994-ce6a-44fc-aadc-075b1e9207d2","Type":"ContainerDied","Data":"6c93e8db6e9e16afb879e40529fefd28d8fd0fdde60e1f0ef9b7a541d0ca7384"}
Sep 11 03:55:17.174515 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:17.174481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm" event={"ID":"d8172994-ce6a-44fc-aadc-075b1e9207d2","Type":"ContainerStarted","Data":"512650142cccafd5f62f4f00ddd580915bc1371afa44e7dea32155a8423e88a5"}
Sep 11 03:55:17.175007 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:17.174670    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:17.199252 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:17.199200    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm" podStartSLOduration=1.639384143 podStartE2EDuration="6.199181051s" totalImagesPullingTime="3.490857842s" totalInitContainerRuntime="1.068939066s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:55:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:55:17.197440768 +0000 UTC m=+323.075633080" watchObservedRunningTime="2026-09-11 03:55:17.199181051 +0000 UTC m=+323.077373353"
Sep 11 03:55:28.181229 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:28.181196    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-97cf4878d-dflqm"
Sep 11 03:55:29.576823 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.576787    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"]
Sep 11 03:55:29.577189 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.577085    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2dfecb-defe-4696-9adf-065c9c36fc00" containerName="extract"
Sep 11 03:55:29.577189 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.577097    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2dfecb-defe-4696-9adf-065c9c36fc00" containerName="extract"
Sep 11 03:55:29.577189 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.577114    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2dfecb-defe-4696-9adf-065c9c36fc00" containerName="util"
Sep 11 03:55:29.577189 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.577119    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2dfecb-defe-4696-9adf-065c9c36fc00" containerName="util"
Sep 11 03:55:29.577189 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.577129    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2dfecb-defe-4696-9adf-065c9c36fc00" containerName="pull"
Sep 11 03:55:29.577189 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.577134    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2dfecb-defe-4696-9adf-065c9c36fc00" containerName="pull"
Sep 11 03:55:29.577189 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.577180    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c2dfecb-defe-4696-9adf-065c9c36fc00" containerName="extract"
Sep 11 03:55:29.585060 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.585036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.588767 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.588749    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 03:55:29.590290 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.590261    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 03:55:29.590290 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.590283    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 03:55:29.590443 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.590344    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5d9k8\""
Sep 11 03:55:29.590443 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.590343    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 03:55:29.592865 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.592848    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 03:55:29.618224 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.618192    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"]
Sep 11 03:55:29.680339 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.680308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb53c7e2-d340-46bb-972e-97b164fa45d2-metrics-cert\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.680453 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.680348    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb53c7e2-d340-46bb-972e-97b164fa45d2-cert\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.680453 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.680410    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb53c7e2-d340-46bb-972e-97b164fa45d2-manager-config\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.680453 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.680435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfdwq\" (UniqueName: \"kubernetes.io/projected/eb53c7e2-d340-46bb-972e-97b164fa45d2-kube-api-access-pfdwq\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.780968 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.780938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb53c7e2-d340-46bb-972e-97b164fa45d2-metrics-cert\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.781095 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.780983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb53c7e2-d340-46bb-972e-97b164fa45d2-cert\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.781095 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.781056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb53c7e2-d340-46bb-972e-97b164fa45d2-manager-config\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.781179 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.781092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfdwq\" (UniqueName: \"kubernetes.io/projected/eb53c7e2-d340-46bb-972e-97b164fa45d2-kube-api-access-pfdwq\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.781746 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.781727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb53c7e2-d340-46bb-972e-97b164fa45d2-manager-config\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.783639 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.783594    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb53c7e2-d340-46bb-972e-97b164fa45d2-metrics-cert\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.783769 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.783752    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb53c7e2-d340-46bb-972e-97b164fa45d2-cert\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.804592 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.804566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfdwq\" (UniqueName: \"kubernetes.io/projected/eb53c7e2-d340-46bb-972e-97b164fa45d2-kube-api-access-pfdwq\") pod \"lws-controller-manager-67f66d78bd-lnvdn\" (UID: \"eb53c7e2-d340-46bb-972e-97b164fa45d2\") " pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:29.893681 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:29.893590    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:30.179280 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:30.179251    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"]
Sep 11 03:55:30.179831 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:55:30.179804    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb53c7e2_d340_46bb_972e_97b164fa45d2.slice/crio-7b65888c5362cd1e622bc2bfd674163ea245a59163ec52e21cd8906607c3344c WatchSource:0}: Error finding container 7b65888c5362cd1e622bc2bfd674163ea245a59163ec52e21cd8906607c3344c: Status 404 returned error can't find the container with id 7b65888c5362cd1e622bc2bfd674163ea245a59163ec52e21cd8906607c3344c
Sep 11 03:55:30.237659 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:30.237631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn" event={"ID":"eb53c7e2-d340-46bb-972e-97b164fa45d2","Type":"ContainerStarted","Data":"7b65888c5362cd1e622bc2bfd674163ea245a59163ec52e21cd8906607c3344c"}
Sep 11 03:55:32.247497 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:32.247411    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn" event={"ID":"eb53c7e2-d340-46bb-972e-97b164fa45d2","Type":"ContainerStarted","Data":"4a93bdda1dbc2094d65c0d197adb3f72fbd065641826dd76a0859a2616f20a33"}
Sep 11 03:55:32.247497 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:32.247483    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:32.265493 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:32.265441    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn" podStartSLOduration=1.8428952299999999 podStartE2EDuration="3.26542469s" totalImagesPullingTime="1.42252946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:55:32.264064639 +0000 UTC m=+338.142256942" watchObservedRunningTime="2026-09-11 03:55:32.26542469 +0000 UTC m=+338.143616991"
Sep 11 03:55:40.178692 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.178660    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"]
Sep 11 03:55:40.183105 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.183086    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.185805 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.185783    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 03:55:40.185895 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.185783    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b5gl7\""
Sep 11 03:55:40.195418 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.195396    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"]
Sep 11 03:55:40.272095 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.272060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.272254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.272099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.272254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.272133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.272254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.272173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.272254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.272220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.272254 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.272249    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.272466 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.272271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jkxl\" (UniqueName: \"kubernetes.io/projected/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-kube-api-access-6jkxl\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.272466 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.272290    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.272466 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.272371    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373107 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373069    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373107 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373356 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373136    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jkxl\" (UniqueName: \"kubernetes.io/projected/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-kube-api-access-6jkxl\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373356 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373356 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373356 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373206    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373356 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373225    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373356 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373246    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373753 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373753 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373538    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373753 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373624    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373753 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373694    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373891 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.373926 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.373889    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.375761 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.375739    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.375954 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.375938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.387880 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.387852    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.395234 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.395206    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jkxl\" (UniqueName: \"kubernetes.io/projected/676347ce-3e97-44ad-9fd2-c3299b3ad6ff-kube-api-access-6jkxl\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx\" (UID: \"676347ce-3e97-44ad-9fd2-c3299b3ad6ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.492967 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.492935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:40.777400 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:40.777368    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"]
Sep 11 03:55:40.777714 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:55:40.777690    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676347ce_3e97_44ad_9fd2_c3299b3ad6ff.slice/crio-82370a0aaafc590ea989e45bf2b8de4be456844bc7f7bfbf049642bc98a25cf6 WatchSource:0}: Error finding container 82370a0aaafc590ea989e45bf2b8de4be456844bc7f7bfbf049642bc98a25cf6: Status 404 returned error can't find the container with id 82370a0aaafc590ea989e45bf2b8de4be456844bc7f7bfbf049642bc98a25cf6
Sep 11 03:55:41.030235 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.030153    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zxsl5"]
Sep 11 03:55:41.034588 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.034568    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5"
Sep 11 03:55:41.037082 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.037052    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 03:55:41.037536 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.037520    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xqh85\""
Sep 11 03:55:41.048098 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.048076    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zxsl5"]
Sep 11 03:55:41.179362 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.179327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8726381-d9fe-40b3-b4ea-677fc71462c1-cert\") pod \"odh-model-controller-7998c67dc4-zxsl5\" (UID: \"c8726381-d9fe-40b3-b4ea-677fc71462c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5"
Sep 11 03:55:41.179767 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.179444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fdfw\" (UniqueName: \"kubernetes.io/projected/c8726381-d9fe-40b3-b4ea-677fc71462c1-kube-api-access-7fdfw\") pod \"odh-model-controller-7998c67dc4-zxsl5\" (UID: \"c8726381-d9fe-40b3-b4ea-677fc71462c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5"
Sep 11 03:55:41.279959 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.279922    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdfw\" (UniqueName: \"kubernetes.io/projected/c8726381-d9fe-40b3-b4ea-677fc71462c1-kube-api-access-7fdfw\") pod \"odh-model-controller-7998c67dc4-zxsl5\" (UID: \"c8726381-d9fe-40b3-b4ea-677fc71462c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5"
Sep 11 03:55:41.280128 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.279985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8726381-d9fe-40b3-b4ea-677fc71462c1-cert\") pod \"odh-model-controller-7998c67dc4-zxsl5\" (UID: \"c8726381-d9fe-40b3-b4ea-677fc71462c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5"
Sep 11 03:55:41.280188 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:55:41.280127    2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 11 03:55:41.280223 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:55:41.280193    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8726381-d9fe-40b3-b4ea-677fc71462c1-cert podName:c8726381-d9fe-40b3-b4ea-677fc71462c1 nodeName:}" failed. No retries permitted until 2026-09-11 03:55:41.780173817 +0000 UTC m=+347.658366104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c8726381-d9fe-40b3-b4ea-677fc71462c1-cert") pod "odh-model-controller-7998c67dc4-zxsl5" (UID: "c8726381-d9fe-40b3-b4ea-677fc71462c1") : secret "odh-model-controller-webhook-cert" not found
Sep 11 03:55:41.290095 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.290020    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx" event={"ID":"676347ce-3e97-44ad-9fd2-c3299b3ad6ff","Type":"ContainerStarted","Data":"82370a0aaafc590ea989e45bf2b8de4be456844bc7f7bfbf049642bc98a25cf6"}
Sep 11 03:55:41.290498 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.290480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fdfw\" (UniqueName: \"kubernetes.io/projected/c8726381-d9fe-40b3-b4ea-677fc71462c1-kube-api-access-7fdfw\") pod \"odh-model-controller-7998c67dc4-zxsl5\" (UID: \"c8726381-d9fe-40b3-b4ea-677fc71462c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5"
Sep 11 03:55:41.784113 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.784075    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8726381-d9fe-40b3-b4ea-677fc71462c1-cert\") pod \"odh-model-controller-7998c67dc4-zxsl5\" (UID: \"c8726381-d9fe-40b3-b4ea-677fc71462c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5"
Sep 11 03:55:41.787021 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.786986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8726381-d9fe-40b3-b4ea-677fc71462c1-cert\") pod \"odh-model-controller-7998c67dc4-zxsl5\" (UID: \"c8726381-d9fe-40b3-b4ea-677fc71462c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5"
Sep 11 03:55:41.945028 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:41.944996    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5"
Sep 11 03:55:42.230655 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:42.230627    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zxsl5"]
Sep 11 03:55:42.233208 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:55:42.233177    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8726381_d9fe_40b3_b4ea_677fc71462c1.slice/crio-ad6dd055d0999d2fb114327f7553d410ba591d2fe82e1931afac2100b5243579 WatchSource:0}: Error finding container ad6dd055d0999d2fb114327f7553d410ba591d2fe82e1931afac2100b5243579: Status 404 returned error can't find the container with id ad6dd055d0999d2fb114327f7553d410ba591d2fe82e1931afac2100b5243579
Sep 11 03:55:42.296490 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:42.296440    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5" event={"ID":"c8726381-d9fe-40b3-b4ea-677fc71462c1","Type":"ContainerStarted","Data":"ad6dd055d0999d2fb114327f7553d410ba591d2fe82e1931afac2100b5243579"}
Sep 11 03:55:43.254419 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:43.254391    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67f66d78bd-lnvdn"
Sep 11 03:55:43.525549 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:43.525505    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 03:55:43.525682 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:43.525630    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 03:55:43.525777 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:43.525681    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 03:55:44.310755 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:44.310716    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx" event={"ID":"676347ce-3e97-44ad-9fd2-c3299b3ad6ff","Type":"ContainerStarted","Data":"c33939dd7d039aebed88bb48a3db2a7efa97dbefa389e29bc99e3091d89739eb"}
Sep 11 03:55:44.332495 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:44.332445    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx" podStartSLOduration=1.586791173 podStartE2EDuration="4.332407767s" totalImagesPullingTime="2.745616594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:55:44.33073649 +0000 UTC m=+350.208928815" watchObservedRunningTime="2026-09-11 03:55:44.332407767 +0000 UTC m=+350.210600070"
Sep 11 03:55:44.493748 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:44.493717    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:44.498318 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:44.498295    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:45.320460 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:45.317643    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:45.321755 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:45.321730    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx"
Sep 11 03:55:46.322754 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:46.322714    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5" event={"ID":"c8726381-d9fe-40b3-b4ea-677fc71462c1","Type":"ContainerStarted","Data":"c47f3cd742456727dc929fb5504876d9560aa153edbb89a478d885abdc8d7687"}
Sep 11 03:55:46.323130 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:46.322796    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5"
Sep 11 03:55:46.340264 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:46.340221    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5" podStartSLOduration=1.801079002 podStartE2EDuration="5.340208122s" totalImagesPullingTime="3.53912912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:55:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:55:46.338445403 +0000 UTC m=+352.216637705" watchObservedRunningTime="2026-09-11 03:55:46.340208122 +0000 UTC m=+352.218400424"
Sep 11 03:55:47.937242 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:47.937209    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"]
Sep 11 03:55:47.944034 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:47.944017    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:47.946649 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:47.946617    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 03:55:47.946805 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:47.946646    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 03:55:47.946931 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:47.946830    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 03:55:47.946931 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:47.946721    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-khghr\""
Sep 11 03:55:47.956258 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:47.956232    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"]
Sep 11 03:55:48.047992 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.047958    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.048182 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.048007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.048182 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.048025    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.048182 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.048058    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.048182 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.048076    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.048182 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.048144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.048182 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.048169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmmkj\" (UniqueName: \"kubernetes.io/projected/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-kube-api-access-bmmkj\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.149253 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.149223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.149402 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.149262    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.149402 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.149279    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.149402 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.149300    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.149402 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.149315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.149402 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.149342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.149692 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.149417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmmkj\" (UniqueName: \"kubernetes.io/projected/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-kube-api-access-bmmkj\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.150333 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.150307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.151900 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.151875    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.151900 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.151889    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.152055 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.151998    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.152055 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.152045    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.158082 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.158061    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.158184 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.158099    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmmkj\" (UniqueName: \"kubernetes.io/projected/3158cdd9-d64c-4ffc-8a87-6257c3f82e56-kube-api-access-bmmkj\") pod \"istiod-openshift-gateway-5677ccb49b-gwjck\" (UID: \"3158cdd9-d64c-4ffc-8a87-6257c3f82e56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.254082 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.254054    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:48.597643 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:48.597586    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"]
Sep 11 03:55:48.598934 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:55:48.598910    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3158cdd9_d64c_4ffc_8a87_6257c3f82e56.slice/crio-d13613cc8acd1bb2abd559b578b7e72f953cafcf8fa3427d2978c7cf8c9d9274 WatchSource:0}: Error finding container d13613cc8acd1bb2abd559b578b7e72f953cafcf8fa3427d2978c7cf8c9d9274: Status 404 returned error can't find the container with id d13613cc8acd1bb2abd559b578b7e72f953cafcf8fa3427d2978c7cf8c9d9274
Sep 11 03:55:49.338082 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:49.338049    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck" event={"ID":"3158cdd9-d64c-4ffc-8a87-6257c3f82e56","Type":"ContainerStarted","Data":"d13613cc8acd1bb2abd559b578b7e72f953cafcf8fa3427d2978c7cf8c9d9274"}
Sep 11 03:55:51.510274 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:51.510235    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 03:55:51.510652 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:51.510314    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 03:55:52.356240 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:52.356199    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck" event={"ID":"3158cdd9-d64c-4ffc-8a87-6257c3f82e56","Type":"ContainerStarted","Data":"3dce764d02d01895c49e8e32d24165038c40887cf54df3c6dbd6e4638c2d0277"}
Sep 11 03:55:52.356430 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:52.356407    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:52.358158 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:52.358139    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck"
Sep 11 03:55:52.379980 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:52.379931    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck" podStartSLOduration=2.471272368 podStartE2EDuration="5.379916378s" totalImagesPullingTime="2.90864401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:55:52.377712281 +0000 UTC m=+358.255904584" watchObservedRunningTime="2026-09-11 03:55:52.379916378 +0000 UTC m=+358.258108681"
Sep 11 03:55:57.330114 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:55:57.330082    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-zxsl5"
Sep 11 03:56:15.568012 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:15.567980    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f4bb5d7d5-rblx6"]
Sep 11 03:56:40.590972 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.590918    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f4bb5d7d5-rblx6" podUID="ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" containerName="console" containerID="cri-o://16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28" gracePeriod=15
Sep 11 03:56:40.830724 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.830701    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:56:40.988015 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.987975    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-trusted-ca-bundle\") pod \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") "
Sep 11 03:56:40.988180 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.988027    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-oauth-config\") pod \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") "
Sep 11 03:56:40.988180 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.988062    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-config\") pod \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") "
Sep 11 03:56:40.988180 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.988097    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-service-ca\") pod \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") "
Sep 11 03:56:40.988180 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.988134    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb57l\" (UniqueName: \"kubernetes.io/projected/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-kube-api-access-kb57l\") pod \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") "
Sep 11 03:56:40.988370 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.988190    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-serving-cert\") pod \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") "
Sep 11 03:56:40.988370 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.988221    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-oauth-serving-cert\") pod \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\" (UID: \"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6\") "
Sep 11 03:56:40.988508 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.988483    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" (UID: "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:56:40.988572 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.988526    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-config" (OuterVolumeSpecName: "console-config") pod "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" (UID: "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:56:40.988572 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.988522    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-service-ca" (OuterVolumeSpecName: "service-ca") pod "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" (UID: "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:56:40.988774 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.988752    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" (UID: "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 03:56:40.990406 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.990382    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" (UID: "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 03:56:40.990506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.990417    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-kube-api-access-kb57l" (OuterVolumeSpecName: "kube-api-access-kb57l") pod "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" (UID: "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6"). InnerVolumeSpecName "kube-api-access-kb57l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:56:40.990506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:40.990416    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" (UID: "ae6bf9b1-aa97-4938-a0fb-1091cacdfed6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 03:56:41.089814 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.089781    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-trusted-ca-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:41.089814 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.089808    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-oauth-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:41.089986 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.089821    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-config\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:41.089986 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.089834    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:41.089986 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.089844    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb57l\" (UniqueName: \"kubernetes.io/projected/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-kube-api-access-kb57l\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:41.089986 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.089856    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-console-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:41.089986 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.089866    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6-oauth-serving-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:41.580613 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.580579    2575 generic.go:356] "Generic (PLEG): container finished" podID="ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" containerID="16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28" exitCode=0
Sep 11 03:56:41.580778 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.580637    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f4bb5d7d5-rblx6"
Sep 11 03:56:41.580778 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.580659    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f4bb5d7d5-rblx6" event={"ID":"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6","Type":"ContainerDied","Data":"16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28"}
Sep 11 03:56:41.580778 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.580707    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f4bb5d7d5-rblx6" event={"ID":"ae6bf9b1-aa97-4938-a0fb-1091cacdfed6","Type":"ContainerDied","Data":"8b7dc2422629988505d7d69a927d3650a63e2acfbedc367df15476f114461c9b"}
Sep 11 03:56:41.580778 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.580726    2575 scope.go:117] "RemoveContainer" containerID="16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28"
Sep 11 03:56:41.591735 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.591564    2575 scope.go:117] "RemoveContainer" containerID="16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28"
Sep 11 03:56:41.591963 ip-10-0-140-70 kubenswrapper[2575]: E0911 03:56:41.591890    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28\": container with ID starting with 16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28 not found: ID does not exist" containerID="16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28"
Sep 11 03:56:41.591963 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.591913    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28"} err="failed to get container status \"16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28\": rpc error: code = NotFound desc = could not find container \"16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28\": container with ID starting with 16439ad3eb453f0113f28f30c3136e4a9420d847983a91b6419f0047c4e58d28 not found: ID does not exist"
Sep 11 03:56:41.604997 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.604975    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f4bb5d7d5-rblx6"]
Sep 11 03:56:41.606717 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:41.606699    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f4bb5d7d5-rblx6"]
Sep 11 03:56:42.631067 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:42.631026    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" path="/var/lib/kubelet/pods/ae6bf9b1-aa97-4938-a0fb-1091cacdfed6/volumes"
Sep 11 03:56:45.601463 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.601434    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"]
Sep 11 03:56:45.601852 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.601776    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" containerName="console"
Sep 11 03:56:45.601852 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.601788    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" containerName="console"
Sep 11 03:56:45.601926 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.601858    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae6bf9b1-aa97-4938-a0fb-1091cacdfed6" containerName="console"
Sep 11 03:56:45.606567 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.606551    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:45.608974 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.608953    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 03:56:45.609962 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.609913    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qgwlc\""
Sep 11 03:56:45.610591 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.609927    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 03:56:45.612676 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.612633    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"]
Sep 11 03:56:45.701762 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.701728    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"]
Sep 11 03:56:45.705341 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.705325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:45.713438 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.713414    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"]
Sep 11 03:56:45.724230 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.724006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:45.724230 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.724055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:45.724230 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.724099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdfnm\" (UniqueName: \"kubernetes.io/projected/b493204a-4077-4682-9971-458508c5ab78-kube-api-access-sdfnm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:45.797938 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.797903    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"]
Sep 11 03:56:45.801506 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.801485    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:45.810428 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.810405    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"]
Sep 11 03:56:45.825232 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.825210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:45.825354 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.825239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:45.825354 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.825262    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2p72\" (UniqueName: \"kubernetes.io/projected/8b07d6f4-334c-44d6-a09b-d97aaff63291-kube-api-access-s2p72\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:45.825354 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.825290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:45.825526 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.825369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdfnm\" (UniqueName: \"kubernetes.io/projected/b493204a-4077-4682-9971-458508c5ab78-kube-api-access-sdfnm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:45.825526 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.825439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:45.825671 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.825624    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:45.825671 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.825627    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:45.833997 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.833979    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdfnm\" (UniqueName: \"kubernetes.io/projected/b493204a-4077-4682-9971-458508c5ab78-kube-api-access-sdfnm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:45.905641 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.905558    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"]
Sep 11 03:56:45.909163 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.909148    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:45.916727 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.916705    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:45.917150 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.917127    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"]
Sep 11 03:56:45.926149 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.926124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:45.926292 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.926202    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:45.926292 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.926264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:45.926421 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.926302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2p72\" (UniqueName: \"kubernetes.io/projected/8b07d6f4-334c-44d6-a09b-d97aaff63291-kube-api-access-s2p72\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:45.926421 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.926335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhqtq\" (UniqueName: \"kubernetes.io/projected/bee18701-1e6c-4775-a308-1b0f8c658502-kube-api-access-jhqtq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:45.926421 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.926386    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:45.926797 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.926759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:45.927052 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.926909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:45.935046 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:45.935027    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2p72\" (UniqueName: \"kubernetes.io/projected/8b07d6f4-334c-44d6-a09b-d97aaff63291-kube-api-access-s2p72\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:46.015072 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.015039    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:46.027198 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.027168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:46.027312 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.027211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhqtq\" (UniqueName: \"kubernetes.io/projected/bee18701-1e6c-4775-a308-1b0f8c658502-kube-api-access-jhqtq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:46.027312 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.027282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:46.027457 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.027360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:46.027457 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.027384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:46.027457 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.027419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw6mv\" (UniqueName: \"kubernetes.io/projected/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-kube-api-access-xw6mv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:46.027695 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.027673    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:46.027797 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.027741    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:46.037370 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.037332    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhqtq\" (UniqueName: \"kubernetes.io/projected/bee18701-1e6c-4775-a308-1b0f8c658502-kube-api-access-jhqtq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:46.110915 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.110884    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:46.128098 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.128074    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:46.128195 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.128168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:46.128255 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.128200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw6mv\" (UniqueName: \"kubernetes.io/projected/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-kube-api-access-xw6mv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:46.128494 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.128475    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:46.128579 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.128512    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:46.136678 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.136651    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw6mv\" (UniqueName: \"kubernetes.io/projected/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-kube-api-access-xw6mv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:46.191448 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.191413    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"]
Sep 11 03:56:46.192980 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:56:46.192953    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb493204a_4077_4682_9971_458508c5ab78.slice/crio-5cf058d1a8e1ec0cffa6ac61c29c27d3652d0f384d8168e3785562c6a88ad893 WatchSource:0}: Error finding container 5cf058d1a8e1ec0cffa6ac61c29c27d3652d0f384d8168e3785562c6a88ad893: Status 404 returned error can't find the container with id 5cf058d1a8e1ec0cffa6ac61c29c27d3652d0f384d8168e3785562c6a88ad893
Sep 11 03:56:46.218892 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.218870    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:46.288282 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.288198    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"]
Sep 11 03:56:46.379045 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.379017    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"]
Sep 11 03:56:46.390626 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:56:46.390582    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee18701_1e6c_4775_a308_1b0f8c658502.slice/crio-9a9531cba0a2e06d1e24d1f8128cd5c0f293d618c3edbfb8f079a4330c456897 WatchSource:0}: Error finding container 9a9531cba0a2e06d1e24d1f8128cd5c0f293d618c3edbfb8f079a4330c456897: Status 404 returned error can't find the container with id 9a9531cba0a2e06d1e24d1f8128cd5c0f293d618c3edbfb8f079a4330c456897
Sep 11 03:56:46.499238 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.499213    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"]
Sep 11 03:56:46.546421 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:56:46.546382    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630ab326_8c84_4f33_99f8_ec1e6dec9ce5.slice/crio-4ec8c6fc2be08741ede6b8df0a0f699c7fbdc963d8ca8c9ce79a64fbe6117138 WatchSource:0}: Error finding container 4ec8c6fc2be08741ede6b8df0a0f699c7fbdc963d8ca8c9ce79a64fbe6117138: Status 404 returned error can't find the container with id 4ec8c6fc2be08741ede6b8df0a0f699c7fbdc963d8ca8c9ce79a64fbe6117138
Sep 11 03:56:46.607388 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.607350    2575 generic.go:356] "Generic (PLEG): container finished" podID="8b07d6f4-334c-44d6-a09b-d97aaff63291" containerID="c22bc8faa4c7e6cb2ca352dafb8ca139058430025959c79acd4011f9ae1a6537" exitCode=0
Sep 11 03:56:46.607806 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.607416    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz" event={"ID":"8b07d6f4-334c-44d6-a09b-d97aaff63291","Type":"ContainerDied","Data":"c22bc8faa4c7e6cb2ca352dafb8ca139058430025959c79acd4011f9ae1a6537"}
Sep 11 03:56:46.607806 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.607481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz" event={"ID":"8b07d6f4-334c-44d6-a09b-d97aaff63291","Type":"ContainerStarted","Data":"82b34457605161aa39c4f63bad93600dbf93feee94b76688e58fe479a61cf238"}
Sep 11 03:56:46.609136 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.609115    2575 generic.go:356] "Generic (PLEG): container finished" podID="bee18701-1e6c-4775-a308-1b0f8c658502" containerID="7159c5406ce0dbaad0b8de8dfff9c4843912a242cfc48ae6191224cd3c1a5e15" exitCode=0
Sep 11 03:56:46.609252 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.609142    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc" event={"ID":"bee18701-1e6c-4775-a308-1b0f8c658502","Type":"ContainerDied","Data":"7159c5406ce0dbaad0b8de8dfff9c4843912a242cfc48ae6191224cd3c1a5e15"}
Sep 11 03:56:46.609252 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.609190    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc" event={"ID":"bee18701-1e6c-4775-a308-1b0f8c658502","Type":"ContainerStarted","Data":"9a9531cba0a2e06d1e24d1f8128cd5c0f293d618c3edbfb8f079a4330c456897"}
Sep 11 03:56:46.610841 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.610823    2575 generic.go:356] "Generic (PLEG): container finished" podID="b493204a-4077-4682-9971-458508c5ab78" containerID="90a4055634c20578dbcdc3dcdf6cf94644b8724574195fd6506165367be921d5" exitCode=0
Sep 11 03:56:46.610920 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.610866    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk" event={"ID":"b493204a-4077-4682-9971-458508c5ab78","Type":"ContainerDied","Data":"90a4055634c20578dbcdc3dcdf6cf94644b8724574195fd6506165367be921d5"}
Sep 11 03:56:46.610920 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.610902    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk" event={"ID":"b493204a-4077-4682-9971-458508c5ab78","Type":"ContainerStarted","Data":"5cf058d1a8e1ec0cffa6ac61c29c27d3652d0f384d8168e3785562c6a88ad893"}
Sep 11 03:56:46.612720 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:46.612703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g" event={"ID":"630ab326-8c84-4f33-99f8-ec1e6dec9ce5","Type":"ContainerStarted","Data":"4ec8c6fc2be08741ede6b8df0a0f699c7fbdc963d8ca8c9ce79a64fbe6117138"}
Sep 11 03:56:47.619994 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:47.619961    2575 generic.go:356] "Generic (PLEG): container finished" podID="630ab326-8c84-4f33-99f8-ec1e6dec9ce5" containerID="6a7f96295e687f33d99987db14f45295fba1c51f2932311228a7f22726856aba" exitCode=0
Sep 11 03:56:47.620404 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:47.620043    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g" event={"ID":"630ab326-8c84-4f33-99f8-ec1e6dec9ce5","Type":"ContainerDied","Data":"6a7f96295e687f33d99987db14f45295fba1c51f2932311228a7f22726856aba"}
Sep 11 03:56:47.622081 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:47.622060    2575 generic.go:356] "Generic (PLEG): container finished" podID="bee18701-1e6c-4775-a308-1b0f8c658502" containerID="cbc9cca8294a5ddbac53eca94e081740299941beaaee6263747251c5c787f15b" exitCode=0
Sep 11 03:56:47.622170 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:47.622106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc" event={"ID":"bee18701-1e6c-4775-a308-1b0f8c658502","Type":"ContainerDied","Data":"cbc9cca8294a5ddbac53eca94e081740299941beaaee6263747251c5c787f15b"}
Sep 11 03:56:48.629187 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:48.629144    2575 generic.go:356] "Generic (PLEG): container finished" podID="630ab326-8c84-4f33-99f8-ec1e6dec9ce5" containerID="db3b533279ae7b139bcaeb4a8a831005411e02caf76f606df824f0e851012102" exitCode=0
Sep 11 03:56:48.631286 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:48.631259    2575 generic.go:356] "Generic (PLEG): container finished" podID="8b07d6f4-334c-44d6-a09b-d97aaff63291" containerID="724ac15a3dd575afc2867cedb2032aa79a0de5d4a7a4096a92c787c2fcbc1750" exitCode=0
Sep 11 03:56:48.632352 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:48.632317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g" event={"ID":"630ab326-8c84-4f33-99f8-ec1e6dec9ce5","Type":"ContainerDied","Data":"db3b533279ae7b139bcaeb4a8a831005411e02caf76f606df824f0e851012102"}
Sep 11 03:56:48.632462 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:48.632373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz" event={"ID":"8b07d6f4-334c-44d6-a09b-d97aaff63291","Type":"ContainerDied","Data":"724ac15a3dd575afc2867cedb2032aa79a0de5d4a7a4096a92c787c2fcbc1750"}
Sep 11 03:56:48.633725 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:48.633708    2575 generic.go:356] "Generic (PLEG): container finished" podID="bee18701-1e6c-4775-a308-1b0f8c658502" containerID="611b632bb76332994be26d4dd3b691d607feaf8a3e78d5aa8885848aad7aa6dc" exitCode=0
Sep 11 03:56:48.633810 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:48.633784    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc" event={"ID":"bee18701-1e6c-4775-a308-1b0f8c658502","Type":"ContainerDied","Data":"611b632bb76332994be26d4dd3b691d607feaf8a3e78d5aa8885848aad7aa6dc"}
Sep 11 03:56:48.635549 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:48.635522    2575 generic.go:356] "Generic (PLEG): container finished" podID="b493204a-4077-4682-9971-458508c5ab78" containerID="88d873e1a0a154d2bf776cf16e9da8d8303f3cda7a5d13395e1f6af621cb835c" exitCode=0
Sep 11 03:56:48.635665 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:48.635566    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk" event={"ID":"b493204a-4077-4682-9971-458508c5ab78","Type":"ContainerDied","Data":"88d873e1a0a154d2bf776cf16e9da8d8303f3cda7a5d13395e1f6af621cb835c"}
Sep 11 03:56:49.647698 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.647666    2575 generic.go:356] "Generic (PLEG): container finished" podID="8b07d6f4-334c-44d6-a09b-d97aaff63291" containerID="b0c2fb0cfbacef1f2fa4b9fce5f1c79112158bb69d98d4d8cae0221bac2a7b98" exitCode=0
Sep 11 03:56:49.648155 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.647749    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz" event={"ID":"8b07d6f4-334c-44d6-a09b-d97aaff63291","Type":"ContainerDied","Data":"b0c2fb0cfbacef1f2fa4b9fce5f1c79112158bb69d98d4d8cae0221bac2a7b98"}
Sep 11 03:56:49.649854 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.649834    2575 generic.go:356] "Generic (PLEG): container finished" podID="b493204a-4077-4682-9971-458508c5ab78" containerID="23a3b6fdf63e488663854ca721d4bdf4f910d24c8c530901c39a3885b82323ab" exitCode=0
Sep 11 03:56:49.649972 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.649914    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk" event={"ID":"b493204a-4077-4682-9971-458508c5ab78","Type":"ContainerDied","Data":"23a3b6fdf63e488663854ca721d4bdf4f910d24c8c530901c39a3885b82323ab"}
Sep 11 03:56:49.652068 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.652044    2575 generic.go:356] "Generic (PLEG): container finished" podID="630ab326-8c84-4f33-99f8-ec1e6dec9ce5" containerID="9cfa83d41ea4a3db02e833e3ef1e9d0eb1c07fb9bafcca648c335721034cc723" exitCode=0
Sep 11 03:56:49.652170 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.652108    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g" event={"ID":"630ab326-8c84-4f33-99f8-ec1e6dec9ce5","Type":"ContainerDied","Data":"9cfa83d41ea4a3db02e833e3ef1e9d0eb1c07fb9bafcca648c335721034cc723"}
Sep 11 03:56:49.775660 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.775637    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:49.963235 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.963143    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-util\") pod \"bee18701-1e6c-4775-a308-1b0f8c658502\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") "
Sep 11 03:56:49.963235 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.963187    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhqtq\" (UniqueName: \"kubernetes.io/projected/bee18701-1e6c-4775-a308-1b0f8c658502-kube-api-access-jhqtq\") pod \"bee18701-1e6c-4775-a308-1b0f8c658502\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") "
Sep 11 03:56:49.963476 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.963270    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-bundle\") pod \"bee18701-1e6c-4775-a308-1b0f8c658502\" (UID: \"bee18701-1e6c-4775-a308-1b0f8c658502\") "
Sep 11 03:56:49.963947 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.963913    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-bundle" (OuterVolumeSpecName: "bundle") pod "bee18701-1e6c-4775-a308-1b0f8c658502" (UID: "bee18701-1e6c-4775-a308-1b0f8c658502"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:56:49.965402 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.965371    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bee18701-1e6c-4775-a308-1b0f8c658502-kube-api-access-jhqtq" (OuterVolumeSpecName: "kube-api-access-jhqtq") pod "bee18701-1e6c-4775-a308-1b0f8c658502" (UID: "bee18701-1e6c-4775-a308-1b0f8c658502"). InnerVolumeSpecName "kube-api-access-jhqtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:56:49.970241 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:49.970214    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-util" (OuterVolumeSpecName: "util") pod "bee18701-1e6c-4775-a308-1b0f8c658502" (UID: "bee18701-1e6c-4775-a308-1b0f8c658502"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:56:50.064223 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.064191    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:50.064223 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.064219    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bee18701-1e6c-4775-a308-1b0f8c658502-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:50.064223 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.064230    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhqtq\" (UniqueName: \"kubernetes.io/projected/bee18701-1e6c-4775-a308-1b0f8c658502-kube-api-access-jhqtq\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:50.658278 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.658243    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc"
Sep 11 03:56:50.658723 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.658281    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7nrpc" event={"ID":"bee18701-1e6c-4775-a308-1b0f8c658502","Type":"ContainerDied","Data":"9a9531cba0a2e06d1e24d1f8128cd5c0f293d618c3edbfb8f079a4330c456897"}
Sep 11 03:56:50.658723 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.658324    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a9531cba0a2e06d1e24d1f8128cd5c0f293d618c3edbfb8f079a4330c456897"
Sep 11 03:56:50.798108 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.798083    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:50.840308 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.840286    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:50.843143 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.843123    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:50.971612 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.971564    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-util\") pod \"b493204a-4077-4682-9971-458508c5ab78\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") "
Sep 11 03:56:50.971768 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.971627    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-util\") pod \"8b07d6f4-334c-44d6-a09b-d97aaff63291\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") "
Sep 11 03:56:50.971768 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.971670    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-bundle\") pod \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") "
Sep 11 03:56:50.971768 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.971701    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdfnm\" (UniqueName: \"kubernetes.io/projected/b493204a-4077-4682-9971-458508c5ab78-kube-api-access-sdfnm\") pod \"b493204a-4077-4682-9971-458508c5ab78\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") "
Sep 11 03:56:50.971768 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.971726    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-bundle\") pod \"b493204a-4077-4682-9971-458508c5ab78\" (UID: \"b493204a-4077-4682-9971-458508c5ab78\") "
Sep 11 03:56:50.971768 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.971764    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw6mv\" (UniqueName: \"kubernetes.io/projected/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-kube-api-access-xw6mv\") pod \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") "
Sep 11 03:56:50.972107 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.971792    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2p72\" (UniqueName: \"kubernetes.io/projected/8b07d6f4-334c-44d6-a09b-d97aaff63291-kube-api-access-s2p72\") pod \"8b07d6f4-334c-44d6-a09b-d97aaff63291\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") "
Sep 11 03:56:50.972107 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.971814    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-bundle\") pod \"8b07d6f4-334c-44d6-a09b-d97aaff63291\" (UID: \"8b07d6f4-334c-44d6-a09b-d97aaff63291\") "
Sep 11 03:56:50.972107 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.971865    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-util\") pod \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\" (UID: \"630ab326-8c84-4f33-99f8-ec1e6dec9ce5\") "
Sep 11 03:56:50.972770 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.972735    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-bundle" (OuterVolumeSpecName: "bundle") pod "630ab326-8c84-4f33-99f8-ec1e6dec9ce5" (UID: "630ab326-8c84-4f33-99f8-ec1e6dec9ce5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:56:50.973181 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.973133    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-bundle" (OuterVolumeSpecName: "bundle") pod "b493204a-4077-4682-9971-458508c5ab78" (UID: "b493204a-4077-4682-9971-458508c5ab78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:56:50.973806 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.973769    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-bundle" (OuterVolumeSpecName: "bundle") pod "8b07d6f4-334c-44d6-a09b-d97aaff63291" (UID: "8b07d6f4-334c-44d6-a09b-d97aaff63291"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:56:50.975280 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.975220    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-kube-api-access-xw6mv" (OuterVolumeSpecName: "kube-api-access-xw6mv") pod "630ab326-8c84-4f33-99f8-ec1e6dec9ce5" (UID: "630ab326-8c84-4f33-99f8-ec1e6dec9ce5"). InnerVolumeSpecName "kube-api-access-xw6mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:56:50.975379 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.975355    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b07d6f4-334c-44d6-a09b-d97aaff63291-kube-api-access-s2p72" (OuterVolumeSpecName: "kube-api-access-s2p72") pod "8b07d6f4-334c-44d6-a09b-d97aaff63291" (UID: "8b07d6f4-334c-44d6-a09b-d97aaff63291"). InnerVolumeSpecName "kube-api-access-s2p72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:56:50.975574 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.975545    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b493204a-4077-4682-9971-458508c5ab78-kube-api-access-sdfnm" (OuterVolumeSpecName: "kube-api-access-sdfnm") pod "b493204a-4077-4682-9971-458508c5ab78" (UID: "b493204a-4077-4682-9971-458508c5ab78"). InnerVolumeSpecName "kube-api-access-sdfnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 03:56:50.979297 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.979262    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-util" (OuterVolumeSpecName: "util") pod "8b07d6f4-334c-44d6-a09b-d97aaff63291" (UID: "8b07d6f4-334c-44d6-a09b-d97aaff63291"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:56:50.980744 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.980714    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-util" (OuterVolumeSpecName: "util") pod "b493204a-4077-4682-9971-458508c5ab78" (UID: "b493204a-4077-4682-9971-458508c5ab78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:56:50.981435 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:50.981412    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-util" (OuterVolumeSpecName: "util") pod "630ab326-8c84-4f33-99f8-ec1e6dec9ce5" (UID: "630ab326-8c84-4f33-99f8-ec1e6dec9ce5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 03:56:51.072540 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.072506    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw6mv\" (UniqueName: \"kubernetes.io/projected/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-kube-api-access-xw6mv\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:51.072540 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.072534    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2p72\" (UniqueName: \"kubernetes.io/projected/8b07d6f4-334c-44d6-a09b-d97aaff63291-kube-api-access-s2p72\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:51.072540 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.072544    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:51.072784 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.072554    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:51.072784 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.072562    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:51.072784 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.072568    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b07d6f4-334c-44d6-a09b-d97aaff63291-util\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:51.072784 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.072576    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/630ab326-8c84-4f33-99f8-ec1e6dec9ce5-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:51.072784 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.072584    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdfnm\" (UniqueName: \"kubernetes.io/projected/b493204a-4077-4682-9971-458508c5ab78-kube-api-access-sdfnm\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:51.072784 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.072593    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b493204a-4077-4682-9971-458508c5ab78-bundle\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 03:56:51.665519 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.665486    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk"
Sep 11 03:56:51.665519 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.665502    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atf8tk" event={"ID":"b493204a-4077-4682-9971-458508c5ab78","Type":"ContainerDied","Data":"5cf058d1a8e1ec0cffa6ac61c29c27d3652d0f384d8168e3785562c6a88ad893"}
Sep 11 03:56:51.665975 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.665545    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cf058d1a8e1ec0cffa6ac61c29c27d3652d0f384d8168e3785562c6a88ad893"
Sep 11 03:56:51.667629 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.667592    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g"
Sep 11 03:56:51.667753 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.667626    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv75g" event={"ID":"630ab326-8c84-4f33-99f8-ec1e6dec9ce5","Type":"ContainerDied","Data":"4ec8c6fc2be08741ede6b8df0a0f699c7fbdc963d8ca8c9ce79a64fbe6117138"}
Sep 11 03:56:51.667753 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.667661    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ec8c6fc2be08741ede6b8df0a0f699c7fbdc963d8ca8c9ce79a64fbe6117138"
Sep 11 03:56:51.669508 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.669485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz" event={"ID":"8b07d6f4-334c-44d6-a09b-d97aaff63291","Type":"ContainerDied","Data":"82b34457605161aa39c4f63bad93600dbf93feee94b76688e58fe479a61cf238"}
Sep 11 03:56:51.669595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.669517    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wzzpz"
Sep 11 03:56:51.669595 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:56:51.669526    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82b34457605161aa39c4f63bad93600dbf93feee94b76688e58fe479a61cf238"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066100    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"]
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066807    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b493204a-4077-4682-9971-458508c5ab78" containerName="pull"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066829    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b493204a-4077-4682-9971-458508c5ab78" containerName="pull"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066849    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="630ab326-8c84-4f33-99f8-ec1e6dec9ce5" containerName="pull"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066858    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="630ab326-8c84-4f33-99f8-ec1e6dec9ce5" containerName="pull"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066877    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b07d6f4-334c-44d6-a09b-d97aaff63291" containerName="util"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066885    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b07d6f4-334c-44d6-a09b-d97aaff63291" containerName="util"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066896    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee18701-1e6c-4775-a308-1b0f8c658502" containerName="extract"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066904    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee18701-1e6c-4775-a308-1b0f8c658502" containerName="extract"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066916    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee18701-1e6c-4775-a308-1b0f8c658502" containerName="util"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066924    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee18701-1e6c-4775-a308-1b0f8c658502" containerName="util"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066939    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b07d6f4-334c-44d6-a09b-d97aaff63291" containerName="pull"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066948    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b07d6f4-334c-44d6-a09b-d97aaff63291" containerName="pull"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066963    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b07d6f4-334c-44d6-a09b-d97aaff63291" containerName="extract"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066973    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b07d6f4-334c-44d6-a09b-d97aaff63291" containerName="extract"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.066997    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee18701-1e6c-4775-a308-1b0f8c658502" containerName="pull"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067005    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee18701-1e6c-4775-a308-1b0f8c658502" containerName="pull"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067027    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b493204a-4077-4682-9971-458508c5ab78" containerName="util"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067035    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b493204a-4077-4682-9971-458508c5ab78" containerName="util"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067042    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b493204a-4077-4682-9971-458508c5ab78" containerName="extract"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067050    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b493204a-4077-4682-9971-458508c5ab78" containerName="extract"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067062    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="630ab326-8c84-4f33-99f8-ec1e6dec9ce5" containerName="util"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067070    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="630ab326-8c84-4f33-99f8-ec1e6dec9ce5" containerName="util"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067102    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="630ab326-8c84-4f33-99f8-ec1e6dec9ce5" containerName="extract"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067110    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="630ab326-8c84-4f33-99f8-ec1e6dec9ce5" containerName="extract"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067244    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b07d6f4-334c-44d6-a09b-d97aaff63291" containerName="extract"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067261    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b493204a-4077-4682-9971-458508c5ab78" containerName="extract"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067272    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="630ab326-8c84-4f33-99f8-ec1e6dec9ce5" containerName="extract"
Sep 11 03:58:16.067878 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.067288    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bee18701-1e6c-4775-a308-1b0f8c658502" containerName="extract"
Sep 11 03:58:16.075142 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.075115    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"
Sep 11 03:58:16.078049 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.078027    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-bbfrv\""
Sep 11 03:58:16.078165 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.078028    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 03:58:16.078249 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.078225    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"]
Sep 11 03:58:16.078996 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.078978    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 03:58:16.079122 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.079053    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 03:58:16.147877 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.147844    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqkwl\" (UniqueName: \"kubernetes.io/projected/04757256-742a-4373-b6e9-620e64fa64bd-kube-api-access-jqkwl\") pod \"postgres-69fb4594cf-vbnvw\" (UID: \"04757256-742a-4373-b6e9-620e64fa64bd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"
Sep 11 03:58:16.148011 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.147898    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/04757256-742a-4373-b6e9-620e64fa64bd-data\") pod \"postgres-69fb4594cf-vbnvw\" (UID: \"04757256-742a-4373-b6e9-620e64fa64bd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"
Sep 11 03:58:16.249201 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.249168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqkwl\" (UniqueName: \"kubernetes.io/projected/04757256-742a-4373-b6e9-620e64fa64bd-kube-api-access-jqkwl\") pod \"postgres-69fb4594cf-vbnvw\" (UID: \"04757256-742a-4373-b6e9-620e64fa64bd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"
Sep 11 03:58:16.249359 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.249232    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/04757256-742a-4373-b6e9-620e64fa64bd-data\") pod \"postgres-69fb4594cf-vbnvw\" (UID: \"04757256-742a-4373-b6e9-620e64fa64bd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"
Sep 11 03:58:16.249568 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.249552    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/04757256-742a-4373-b6e9-620e64fa64bd-data\") pod \"postgres-69fb4594cf-vbnvw\" (UID: \"04757256-742a-4373-b6e9-620e64fa64bd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"
Sep 11 03:58:16.258497 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.258468    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqkwl\" (UniqueName: \"kubernetes.io/projected/04757256-742a-4373-b6e9-620e64fa64bd-kube-api-access-jqkwl\") pod \"postgres-69fb4594cf-vbnvw\" (UID: \"04757256-742a-4373-b6e9-620e64fa64bd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"
Sep 11 03:58:16.386853 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.386778    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"
Sep 11 03:58:16.658151 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:16.658072    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"]
Sep 11 03:58:16.661521 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:58:16.661496    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04757256_742a_4373_b6e9_620e64fa64bd.slice/crio-21db8b5ea194a262e4d46fcf7b4fd1b90e782319f6bf1bbe484985ee59ba58f8 WatchSource:0}: Error finding container 21db8b5ea194a262e4d46fcf7b4fd1b90e782319f6bf1bbe484985ee59ba58f8: Status 404 returned error can't find the container with id 21db8b5ea194a262e4d46fcf7b4fd1b90e782319f6bf1bbe484985ee59ba58f8
Sep 11 03:58:17.096480 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:17.096442    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw" event={"ID":"04757256-742a-4373-b6e9-620e64fa64bd","Type":"ContainerStarted","Data":"21db8b5ea194a262e4d46fcf7b4fd1b90e782319f6bf1bbe484985ee59ba58f8"}
Sep 11 03:58:23.133592 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:23.133550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw" event={"ID":"04757256-742a-4373-b6e9-620e64fa64bd","Type":"ContainerStarted","Data":"118780e86ae4d0a5cea12ba2171809d1087b6d1944720d4146cf9bfdd2740c12"}
Sep 11 03:58:23.133965 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:23.133645    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"
Sep 11 03:58:23.150395 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:23.150349    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw" podStartSLOduration=1.333332475 podStartE2EDuration="7.150334424s" totalImagesPullingTime="5.817001949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:58:23.148747563 +0000 UTC m=+509.026939865" watchObservedRunningTime="2026-09-11 03:58:23.150334424 +0000 UTC m=+509.028526783"
Sep 11 03:58:29.167810 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:58:29.167766    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbnvw"
Sep 11 03:59:14.470100 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.470063    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"]
Sep 11 03:59:14.473478 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.473461    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"
Sep 11 03:59:14.476249 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.476220    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-t52vh\""
Sep 11 03:59:14.476249 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.476224    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 03:59:14.482416 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.482394    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"]
Sep 11 03:59:14.525881 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.525852    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3834af05-e173-4891-9010-7f2f4f39b28f-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2z4lv\" (UID: \"3834af05-e173-4891-9010-7f2f4f39b28f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"
Sep 11 03:59:14.526011 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.525994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xp5f\" (UniqueName: \"kubernetes.io/projected/3834af05-e173-4891-9010-7f2f4f39b28f-kube-api-access-8xp5f\") pod \"payload-pre-processing-59fbc47bf8-2z4lv\" (UID: \"3834af05-e173-4891-9010-7f2f4f39b28f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"
Sep 11 03:59:14.627170 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.627132    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3834af05-e173-4891-9010-7f2f4f39b28f-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2z4lv\" (UID: \"3834af05-e173-4891-9010-7f2f4f39b28f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"
Sep 11 03:59:14.627342 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.627196    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xp5f\" (UniqueName: \"kubernetes.io/projected/3834af05-e173-4891-9010-7f2f4f39b28f-kube-api-access-8xp5f\") pod \"payload-pre-processing-59fbc47bf8-2z4lv\" (UID: \"3834af05-e173-4891-9010-7f2f4f39b28f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"
Sep 11 03:59:14.627904 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.627880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3834af05-e173-4891-9010-7f2f4f39b28f-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2z4lv\" (UID: \"3834af05-e173-4891-9010-7f2f4f39b28f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"
Sep 11 03:59:14.638732 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.638709    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xp5f\" (UniqueName: \"kubernetes.io/projected/3834af05-e173-4891-9010-7f2f4f39b28f-kube-api-access-8xp5f\") pod \"payload-pre-processing-59fbc47bf8-2z4lv\" (UID: \"3834af05-e173-4891-9010-7f2f4f39b28f\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"
Sep 11 03:59:14.784524 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:14.784445    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"
Sep 11 03:59:15.073617 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:15.073575    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"]
Sep 11 03:59:15.074568 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:59:15.074540    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3834af05_e173_4891_9010_7f2f4f39b28f.slice/crio-a5a2698293356d4c8d9a33cf25f8c18a990cbc0718257d8ca9c6674b640ee3d0 WatchSource:0}: Error finding container a5a2698293356d4c8d9a33cf25f8c18a990cbc0718257d8ca9c6674b640ee3d0: Status 404 returned error can't find the container with id a5a2698293356d4c8d9a33cf25f8c18a990cbc0718257d8ca9c6674b640ee3d0
Sep 11 03:59:15.399115 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:15.399029    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv" event={"ID":"3834af05-e173-4891-9010-7f2f4f39b28f","Type":"ContainerStarted","Data":"a5a2698293356d4c8d9a33cf25f8c18a990cbc0718257d8ca9c6674b640ee3d0"}
Sep 11 03:59:17.410897 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:17.410860    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv" event={"ID":"3834af05-e173-4891-9010-7f2f4f39b28f","Type":"ContainerStarted","Data":"c7e4a1e11cfe536b8362d930a49f1a3514f4b280587d14309012ebb2dc5b4faa"}
Sep 11 03:59:17.411357 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:17.410919    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"
Sep 11 03:59:17.428029 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:17.427978    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv" podStartSLOduration=1.750490997 podStartE2EDuration="3.427959736s" totalImagesPullingTime="1.677468739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:59:17.426156097 +0000 UTC m=+563.304348436" watchObservedRunningTime="2026-09-11 03:59:17.427959736 +0000 UTC m=+563.306152071"
Sep 11 03:59:28.418109 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:28.418080    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv"
Sep 11 03:59:46.791987 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.791952    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"]
Sep 11 03:59:46.796492 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.796467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.798976 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.798954    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 03:59:46.798976 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.798962    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jkjzv\""
Sep 11 03:59:46.799175 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.799083    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 03:59:46.799240 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.799221    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 03:59:46.804829 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.804805    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"]
Sep 11 03:59:46.892407 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.892376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.892576 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.892416    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.892576 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.892450    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.892576 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.892505    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwvs\" (UniqueName: \"kubernetes.io/projected/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-kube-api-access-lgwvs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.892576 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.892568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.892780 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.892596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.993663 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.993596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.993832 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.993672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.993832 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.993700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.993832 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.993728    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.993832 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.993795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.993832 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.993828    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwvs\" (UniqueName: \"kubernetes.io/projected/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-kube-api-access-lgwvs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.994105 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.994080    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.994164 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.994135    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.994205 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.994168    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.995966 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.995945    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:46.996231 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:46.996215    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:47.002115 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:47.002092    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwvs\" (UniqueName: \"kubernetes.io/projected/b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598-kube-api-access-lgwvs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt\" (UID: \"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:47.109125 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:47.109059    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:47.419343 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:47.419168    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"]
Sep 11 03:59:47.421380 ip-10-0-140-70 kubenswrapper[2575]: W0911 03:59:47.421351    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12c7ed0_b0c2_46ca_8bdf_8e8f253a5598.slice/crio-efdf7b58bea1d740489962400005814d2448add0d517b6c3daefebe349379d24 WatchSource:0}: Error finding container efdf7b58bea1d740489962400005814d2448add0d517b6c3daefebe349379d24: Status 404 returned error can't find the container with id efdf7b58bea1d740489962400005814d2448add0d517b6c3daefebe349379d24
Sep 11 03:59:47.555946 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:47.555911    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt" event={"ID":"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598","Type":"ContainerStarted","Data":"efdf7b58bea1d740489962400005814d2448add0d517b6c3daefebe349379d24"}
Sep 11 03:59:48.562286 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:48.562250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt" event={"ID":"b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598","Type":"ContainerStarted","Data":"ec3d04a5f9aa050de6359bfee791471fbf9af11c061ba43378cd638db6220266"}
Sep 11 03:59:48.585724 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:48.585668    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt" podStartSLOduration=1.644989126 podStartE2EDuration="2.585647384s" totalImagesPullingTime="940.658258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:59:48.582883817 +0000 UTC m=+594.461076121" watchObservedRunningTime="2026-09-11 03:59:48.585647384 +0000 UTC m=+594.463839687"
Sep 11 03:59:54.596732 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:54.596705    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 03:59:54.600623 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:54.600588    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 03:59:57.109418 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:57.109386    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:57.109818 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:57.109441    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:57.121882 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:57.121853    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 03:59:57.620318 ip-10-0-140-70 kubenswrapper[2575]: I0911 03:59:57.620284    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt"
Sep 11 04:00:02.935908 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:02.935878    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"]
Sep 11 04:00:02.939158 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:02.939140    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:02.942044 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:02.942026    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 04:00:02.954267 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:02.954246    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"]
Sep 11 04:00:03.129301 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.129268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d8dp\" (UniqueName: \"kubernetes.io/projected/4834295e-fda2-4709-aebc-87ad9e7a38eb-kube-api-access-4d8dp\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.129301 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.129309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.129529 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.129392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.129529 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.129426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.129529 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.129509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4834295e-fda2-4709-aebc-87ad9e7a38eb-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.129697 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.129535    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.230612 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.230574    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4834295e-fda2-4709-aebc-87ad9e7a38eb-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.230867 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.230659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.230867 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.230723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d8dp\" (UniqueName: \"kubernetes.io/projected/4834295e-fda2-4709-aebc-87ad9e7a38eb-kube-api-access-4d8dp\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.230867 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.230748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.230867 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.230790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.230867 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.230816    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.234428 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.231341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.234428 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.231476    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.234428 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.231632    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.234428 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.234356    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4834295e-fda2-4709-aebc-87ad9e7a38eb-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.238197 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.238158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4834295e-fda2-4709-aebc-87ad9e7a38eb-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.252719 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.252700    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d8dp\" (UniqueName: \"kubernetes.io/projected/4834295e-fda2-4709-aebc-87ad9e7a38eb-kube-api-access-4d8dp\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2\" (UID: \"4834295e-fda2-4709-aebc-87ad9e7a38eb\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.549165 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.549080    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:03.824191 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.824163    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"]
Sep 11 04:00:03.826140 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:00:03.826112    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4834295e_fda2_4709_aebc_87ad9e7a38eb.slice/crio-1552780557b12000a147261a2aaa6df07f1fafe1d79495dbedb2711b34a540e2 WatchSource:0}: Error finding container 1552780557b12000a147261a2aaa6df07f1fafe1d79495dbedb2711b34a540e2: Status 404 returned error can't find the container with id 1552780557b12000a147261a2aaa6df07f1fafe1d79495dbedb2711b34a540e2
Sep 11 04:00:03.827575 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:03.827555    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 04:00:04.643937 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:04.643904    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2" event={"ID":"4834295e-fda2-4709-aebc-87ad9e7a38eb","Type":"ContainerStarted","Data":"1552780557b12000a147261a2aaa6df07f1fafe1d79495dbedb2711b34a540e2"}
Sep 11 04:00:05.650758 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:05.650669    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2" event={"ID":"4834295e-fda2-4709-aebc-87ad9e7a38eb","Type":"ContainerStarted","Data":"08692c0a998041296be5d3b464a8c35fc6ab2ea5384e7978869edc6c74afcac1"}
Sep 11 04:00:05.674084 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:05.674030    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2" podStartSLOduration=2.173248378 podStartE2EDuration="3.674013674s" totalImagesPullingTime="1.500765296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:00:05.671653907 +0000 UTC m=+611.549846212" watchObservedRunningTime="2026-09-11 04:00:05.674013674 +0000 UTC m=+611.552206029"
Sep 11 04:00:13.549211 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:13.549176    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:13.549728 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:13.549241    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:13.562223 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:13.562198    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:00:13.703252 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:00:13.703222    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2"
Sep 11 04:01:45.917623 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:45.917519    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"]
Sep 11 04:01:45.921086 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:45.921065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:45.923876 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:45.923858    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-00a938-openshift-default-dockercfg-sqqhh\""
Sep 11 04:01:45.934529 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:45.934509    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"]
Sep 11 04:01:46.095292 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.095260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-socket\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.095482 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.095304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rj52\" (UniqueName: \"kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-kube-api-access-5rj52\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.095482 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.095329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-istio-token\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.095482 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.095378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd6c7967-b078-41d5-830f-a66e88e62116-istiod-ca-cert\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.095482 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.095448    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-credential-socket\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.095482 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.095480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-data\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.095767 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.095513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd6c7967-b078-41d5-830f-a66e88e62116-istio-podinfo\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.095767 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.095590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-certs\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.095767 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.095655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-envoy\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.196766 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.196676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-credential-socket\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.196766 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.196721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-data\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.196766 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.196753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd6c7967-b078-41d5-830f-a66e88e62116-istio-podinfo\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.197028 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.196805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-certs\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.197028 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.196835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-envoy\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.197028 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.196873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-socket\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.197028 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.196915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rj52\" (UniqueName: \"kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-kube-api-access-5rj52\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.197028 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.196945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-istio-token\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.197028 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.197026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd6c7967-b078-41d5-830f-a66e88e62116-istiod-ca-cert\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.197345 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.197145    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-data\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.197345 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.197162    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-credential-socket\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.197345 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.197264    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-socket\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.197497 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.197430    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-certs\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.197812 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.197790    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd6c7967-b078-41d5-830f-a66e88e62116-istiod-ca-cert\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.199401 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.199373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-envoy\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.199523 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.199506    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd6c7967-b078-41d5-830f-a66e88e62116-istio-podinfo\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.208062 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.208035    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-istio-token\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.208062 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.208050    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rj52\" (UniqueName: \"kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-kube-api-access-5rj52\") pod \"e2e-inf-a-00a938-openshift-default-678576d748-nz8ht\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") " pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.232145 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.232123    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:46.509299 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.509269    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"]
Sep 11 04:01:46.510797 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:01:46.510771    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6c7967_b078_41d5_830f_a66e88e62116.slice/crio-373f541fb29f1be39468863f5223ed1462e69d74d0c6207eee6bf80aed1fa5ec WatchSource:0}: Error finding container 373f541fb29f1be39468863f5223ed1462e69d74d0c6207eee6bf80aed1fa5ec: Status 404 returned error can't find the container with id 373f541fb29f1be39468863f5223ed1462e69d74d0c6207eee6bf80aed1fa5ec
Sep 11 04:01:46.512846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.512817    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:01:46.512906 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.512882    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:01:46.512943 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:46.512912    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:01:47.171297 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:47.171264    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" event={"ID":"fd6c7967-b078-41d5-830f-a66e88e62116","Type":"ContainerStarted","Data":"0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb"}
Sep 11 04:01:47.171797 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:47.171324    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" event={"ID":"fd6c7967-b078-41d5-830f-a66e88e62116","Type":"ContainerStarted","Data":"373f541fb29f1be39468863f5223ed1462e69d74d0c6207eee6bf80aed1fa5ec"}
Sep 11 04:01:47.225080 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:47.225034    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" podStartSLOduration=2.225010165 podStartE2EDuration="2.225010165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:01:47.223630847 +0000 UTC m=+713.101823150" watchObservedRunningTime="2026-09-11 04:01:47.225010165 +0000 UTC m=+713.103202467"
Sep 11 04:01:47.233313 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:47.233288    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:47.238703 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:47.238684    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:48.176806 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:48.176774    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:48.177902 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:48.177883    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:01:51.139626 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.139563    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"]
Sep 11 04:01:51.143032 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.143012    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:01:51.144504 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.144481    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d09018e-3e72-4d00-a904-2a2341d22bf7-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s\" (UID: \"7d09018e-3e72-4d00-a904-2a2341d22bf7\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:01:51.144633 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.144552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkdjj\" (UniqueName: \"kubernetes.io/projected/7d09018e-3e72-4d00-a904-2a2341d22bf7-kube-api-access-wkdjj\") pod \"payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s\" (UID: \"7d09018e-3e72-4d00-a904-2a2341d22bf7\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:01:51.146238 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.146215    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-00a938-dockercfg-5gwzs\""
Sep 11 04:01:51.146314 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.146221    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-00a938\""
Sep 11 04:01:51.158751 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.158728    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"]
Sep 11 04:01:51.244961 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.244924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkdjj\" (UniqueName: \"kubernetes.io/projected/7d09018e-3e72-4d00-a904-2a2341d22bf7-kube-api-access-wkdjj\") pod \"payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s\" (UID: \"7d09018e-3e72-4d00-a904-2a2341d22bf7\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:01:51.245137 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.244984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d09018e-3e72-4d00-a904-2a2341d22bf7-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s\" (UID: \"7d09018e-3e72-4d00-a904-2a2341d22bf7\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:01:51.245683 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.245661    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d09018e-3e72-4d00-a904-2a2341d22bf7-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s\" (UID: \"7d09018e-3e72-4d00-a904-2a2341d22bf7\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:01:51.257553 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.257528    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkdjj\" (UniqueName: \"kubernetes.io/projected/7d09018e-3e72-4d00-a904-2a2341d22bf7-kube-api-access-wkdjj\") pod \"payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s\" (UID: \"7d09018e-3e72-4d00-a904-2a2341d22bf7\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:01:51.454187 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.454097    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:01:51.738544 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:51.738523    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"]
Sep 11 04:01:51.740707 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:01:51.740675    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d09018e_3e72_4d00_a904_2a2341d22bf7.slice/crio-000b1e230eccac914ba37df0d842819c7ec37f9dff46400e343e82ea47c21a3f WatchSource:0}: Error finding container 000b1e230eccac914ba37df0d842819c7ec37f9dff46400e343e82ea47c21a3f: Status 404 returned error can't find the container with id 000b1e230eccac914ba37df0d842819c7ec37f9dff46400e343e82ea47c21a3f
Sep 11 04:01:52.200040 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:52.199954    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s" event={"ID":"7d09018e-3e72-4d00-a904-2a2341d22bf7","Type":"ContainerStarted","Data":"d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f"}
Sep 11 04:01:52.200040 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:52.200021    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s" event={"ID":"7d09018e-3e72-4d00-a904-2a2341d22bf7","Type":"ContainerStarted","Data":"000b1e230eccac914ba37df0d842819c7ec37f9dff46400e343e82ea47c21a3f"}
Sep 11 04:01:52.200458 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:52.200051    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:01:52.219428 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:52.219370    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s" podStartSLOduration=1.219351839 podStartE2EDuration="1.219351839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:01:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:01:52.217689678 +0000 UTC m=+718.095881981" watchObservedRunningTime="2026-09-11 04:01:52.219351839 +0000 UTC m=+718.097544146"
Sep 11 04:01:54.227646 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.227612    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"]
Sep 11 04:01:54.231245 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.231221    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.234066 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.234042    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f547da13-openshift-default-dockercfg-qc89w\""
Sep 11 04:01:54.248853 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.248826    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"]
Sep 11 04:01:54.272584 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.272557    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-data\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.272739 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.272615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-socket\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.272739 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.272661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-credential-socket\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.272739 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.272693    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-envoy\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.272911 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.272767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-token\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.272911 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.272821    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-podinfo\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.272911 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.272855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t7z8\" (UniqueName: \"kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-kube-api-access-6t7z8\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.272911 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.272890    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7390518d-06a9-47a0-9c7c-1853cfd2c761-istiod-ca-cert\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.273082 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.272932    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-certs\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.374150 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.374117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-token\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.374351 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.374169    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-podinfo\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.374351 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.374198    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t7z8\" (UniqueName: \"kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-kube-api-access-6t7z8\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.374351 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.374227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7390518d-06a9-47a0-9c7c-1853cfd2c761-istiod-ca-cert\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.374351 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.374255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-certs\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.374351 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.374337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-data\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.374656 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.374391    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-socket\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.374656 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.374416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-credential-socket\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.374656 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.374436    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-envoy\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.374953 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.374926    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-credential-socket\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.375240 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.375189    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-socket\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.375240 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.375270    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7390518d-06a9-47a0-9c7c-1853cfd2c761-istiod-ca-cert\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.375494 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.375477    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-certs\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.375557 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.375540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-data\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.376910 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.376887    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-envoy\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.377445 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.377420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-podinfo\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.384082 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.384060    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-token\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.384202 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.384177    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t7z8\" (UniqueName: \"kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-kube-api-access-6t7z8\") pod \"e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") " pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.546411 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.546330    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f547da13-openshift-default-dockercfg-qc89w\""
Sep 11 04:01:54.554707 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.554677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:54.847697 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.847675    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"]
Sep 11 04:01:54.848102 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:01:54.848079    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7390518d_06a9_47a0_9c7c_1853cfd2c761.slice/crio-9c9b45c898547d18cff908072e02260fa6a4ba775cf907a4381f5e52f190de1e WatchSource:0}: Error finding container 9c9b45c898547d18cff908072e02260fa6a4ba775cf907a4381f5e52f190de1e: Status 404 returned error can't find the container with id 9c9b45c898547d18cff908072e02260fa6a4ba775cf907a4381f5e52f190de1e
Sep 11 04:01:54.850374 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.850340    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:01:54.850486 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.850412    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:01:54.850486 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:54.850457    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:01:55.219433 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:55.219403    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" event={"ID":"7390518d-06a9-47a0-9c7c-1853cfd2c761","Type":"ContainerStarted","Data":"1f8b47557a50066ef6b8ad1805cfe0a301a8e23771708595e4f5da19a6919270"}
Sep 11 04:01:55.219593 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:55.219456    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" event={"ID":"7390518d-06a9-47a0-9c7c-1853cfd2c761","Type":"ContainerStarted","Data":"9c9b45c898547d18cff908072e02260fa6a4ba775cf907a4381f5e52f190de1e"}
Sep 11 04:01:55.246365 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:55.246317    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" podStartSLOduration=1.24630141 podStartE2EDuration="1.24630141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:01:55.245767349 +0000 UTC m=+721.123959651" watchObservedRunningTime="2026-09-11 04:01:55.24630141 +0000 UTC m=+721.124493711"
Sep 11 04:01:55.555918 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:55.555829    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:55.565767 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:55.565742    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:56.225356 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:56.225323    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:56.226326 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:56.226306    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:01:59.037570 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.037534    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"]
Sep 11 04:01:59.041640 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.041594    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:01:59.044503 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.044482    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f547da13-dockercfg-jjkx9\""
Sep 11 04:01:59.044632 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.044529    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f547da13\""
Sep 11 04:01:59.053242 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.053222    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"]
Sep 11 04:01:59.114049 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.114015    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"]
Sep 11 04:01:59.118418 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.118386    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:01:59.126175 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.126146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb\" (UID: \"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:01:59.126378 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.126359    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn888\" (UniqueName: \"kubernetes.io/projected/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-kube-api-access-sn888\") pod \"payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb\" (UID: \"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:01:59.129080 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.129059    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"]
Sep 11 04:01:59.227208 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.227176    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af202a1-2c7e-42dd-8f83-420fd3d1a260-plugins-config-volume\") pod \"payload-processing-e2e-ait-f547da13-746c6b576f-97wxd\" (UID: \"5af202a1-2c7e-42dd-8f83-420fd3d1a260\") " pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:01:59.227208 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.227211    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwzlc\" (UniqueName: \"kubernetes.io/projected/5af202a1-2c7e-42dd-8f83-420fd3d1a260-kube-api-access-bwzlc\") pod \"payload-processing-e2e-ait-f547da13-746c6b576f-97wxd\" (UID: \"5af202a1-2c7e-42dd-8f83-420fd3d1a260\") " pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:01:59.227440 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.227239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb\" (UID: \"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:01:59.227440 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.227258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn888\" (UniqueName: \"kubernetes.io/projected/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-kube-api-access-sn888\") pod \"payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb\" (UID: \"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:01:59.228186 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.228164    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb\" (UID: \"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:01:59.236225 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.236195    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn888\" (UniqueName: \"kubernetes.io/projected/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-kube-api-access-sn888\") pod \"payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb\" (UID: \"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:01:59.328663 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.328562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af202a1-2c7e-42dd-8f83-420fd3d1a260-plugins-config-volume\") pod \"payload-processing-e2e-ait-f547da13-746c6b576f-97wxd\" (UID: \"5af202a1-2c7e-42dd-8f83-420fd3d1a260\") " pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:01:59.328663 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.328618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwzlc\" (UniqueName: \"kubernetes.io/projected/5af202a1-2c7e-42dd-8f83-420fd3d1a260-kube-api-access-bwzlc\") pod \"payload-processing-e2e-ait-f547da13-746c6b576f-97wxd\" (UID: \"5af202a1-2c7e-42dd-8f83-420fd3d1a260\") " pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:01:59.329730 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.329705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af202a1-2c7e-42dd-8f83-420fd3d1a260-plugins-config-volume\") pod \"payload-processing-e2e-ait-f547da13-746c6b576f-97wxd\" (UID: \"5af202a1-2c7e-42dd-8f83-420fd3d1a260\") " pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:01:59.341910 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.341833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwzlc\" (UniqueName: \"kubernetes.io/projected/5af202a1-2c7e-42dd-8f83-420fd3d1a260-kube-api-access-bwzlc\") pod \"payload-processing-e2e-ait-f547da13-746c6b576f-97wxd\" (UID: \"5af202a1-2c7e-42dd-8f83-420fd3d1a260\") " pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:01:59.353801 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.353776    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:01:59.436489 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.436343    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:01:59.659792 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.659770    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"]
Sep 11 04:01:59.661580 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:01:59.661554    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4770c6_61cf_4aa8_afcb_d514a2ea58b3.slice/crio-a58aab02d54c794b6435fce12a28969feb4a6e8af80da4e6e68faf34a299eb29 WatchSource:0}: Error finding container a58aab02d54c794b6435fce12a28969feb4a6e8af80da4e6e68faf34a299eb29: Status 404 returned error can't find the container with id a58aab02d54c794b6435fce12a28969feb4a6e8af80da4e6e68faf34a299eb29
Sep 11 04:01:59.752516 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:01:59.752495    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"]
Sep 11 04:01:59.753976 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:01:59.753950    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af202a1_2c7e_42dd_8f83_420fd3d1a260.slice/crio-d5d2a7ef177860705d5ff5af2b86e61cb02eeaf983d2c77469a0bad6f44798cb WatchSource:0}: Error finding container d5d2a7ef177860705d5ff5af2b86e61cb02eeaf983d2c77469a0bad6f44798cb: Status 404 returned error can't find the container with id d5d2a7ef177860705d5ff5af2b86e61cb02eeaf983d2c77469a0bad6f44798cb
Sep 11 04:02:00.225799 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.225760    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"]
Sep 11 04:02:00.229623 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.229589    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:02:00.232698 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.232672    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-944e93-dockercfg-52nxt\""
Sep 11 04:02:00.233061 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.233042    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-944e93\""
Sep 11 04:02:00.240053 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.240034    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"]
Sep 11 04:02:00.251925 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.251897    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb" event={"ID":"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3","Type":"ContainerStarted","Data":"a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2"}
Sep 11 04:02:00.252033 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.251948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb" event={"ID":"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3","Type":"ContainerStarted","Data":"a58aab02d54c794b6435fce12a28969feb4a6e8af80da4e6e68faf34a299eb29"}
Sep 11 04:02:00.252033 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.252007    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:02:00.253798 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.253779    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd" event={"ID":"5af202a1-2c7e-42dd-8f83-420fd3d1a260","Type":"ContainerStarted","Data":"a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e"}
Sep 11 04:02:00.253895 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.253814    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd" event={"ID":"5af202a1-2c7e-42dd-8f83-420fd3d1a260","Type":"ContainerStarted","Data":"d5d2a7ef177860705d5ff5af2b86e61cb02eeaf983d2c77469a0bad6f44798cb"}
Sep 11 04:02:00.254144 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.254131    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:02:00.276549 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.276502    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb" podStartSLOduration=1.276489451 podStartE2EDuration="1.276489451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:01:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:02:00.275026117 +0000 UTC m=+726.153218420" watchObservedRunningTime="2026-09-11 04:02:00.276489451 +0000 UTC m=+726.154681753"
Sep 11 04:02:00.303629 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.302591    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd" podStartSLOduration=1.302570254 podStartE2EDuration="1.302570254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:01:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:02:00.301805705 +0000 UTC m=+726.179998008" watchObservedRunningTime="2026-09-11 04:02:00.302570254 +0000 UTC m=+726.180762557"
Sep 11 04:02:00.337771 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.337715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d9d287-82c0-40fe-a30b-5e3566b84a2e-plugins-config-volume\") pod \"payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp\" (UID: \"28d9d287-82c0-40fe-a30b-5e3566b84a2e\") " pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:02:00.337995 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.337891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v66ww\" (UniqueName: \"kubernetes.io/projected/28d9d287-82c0-40fe-a30b-5e3566b84a2e-kube-api-access-v66ww\") pod \"payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp\" (UID: \"28d9d287-82c0-40fe-a30b-5e3566b84a2e\") " pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:02:00.439150 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.439114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d9d287-82c0-40fe-a30b-5e3566b84a2e-plugins-config-volume\") pod \"payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp\" (UID: \"28d9d287-82c0-40fe-a30b-5e3566b84a2e\") " pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:02:00.439312 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.439194    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v66ww\" (UniqueName: \"kubernetes.io/projected/28d9d287-82c0-40fe-a30b-5e3566b84a2e-kube-api-access-v66ww\") pod \"payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp\" (UID: \"28d9d287-82c0-40fe-a30b-5e3566b84a2e\") " pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:02:00.440187 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.440160    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d9d287-82c0-40fe-a30b-5e3566b84a2e-plugins-config-volume\") pod \"payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp\" (UID: \"28d9d287-82c0-40fe-a30b-5e3566b84a2e\") " pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:02:00.450826 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.450799    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v66ww\" (UniqueName: \"kubernetes.io/projected/28d9d287-82c0-40fe-a30b-5e3566b84a2e-kube-api-access-v66ww\") pod \"payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp\" (UID: \"28d9d287-82c0-40fe-a30b-5e3566b84a2e\") " pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:02:00.552098 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.552013    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:02:00.861635 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:00.860897    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"]
Sep 11 04:02:00.862144 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:02:00.862120    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28d9d287_82c0_40fe_a30b_5e3566b84a2e.slice/crio-a33118309543f2bd7874b917760b57d42806047fa8ca3dccbf098916f36c1358 WatchSource:0}: Error finding container a33118309543f2bd7874b917760b57d42806047fa8ca3dccbf098916f36c1358: Status 404 returned error can't find the container with id a33118309543f2bd7874b917760b57d42806047fa8ca3dccbf098916f36c1358
Sep 11 04:02:01.260896 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:01.260859    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp" event={"ID":"28d9d287-82c0-40fe-a30b-5e3566b84a2e","Type":"ContainerStarted","Data":"cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493"}
Sep 11 04:02:01.261351 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:01.260913    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp" event={"ID":"28d9d287-82c0-40fe-a30b-5e3566b84a2e","Type":"ContainerStarted","Data":"a33118309543f2bd7874b917760b57d42806047fa8ca3dccbf098916f36c1358"}
Sep 11 04:02:01.261351 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:01.261319    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:02:01.298204 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:01.298139    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp" podStartSLOduration=1.298115157 podStartE2EDuration="1.298115157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:02:01.295954725 +0000 UTC m=+727.174147031" watchObservedRunningTime="2026-09-11 04:02:01.298115157 +0000 UTC m=+727.176307461"
Sep 11 04:02:03.207785 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:03.207757    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:02:04.218783 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:04.218742    2575 patch_prober.go:28] interesting pod/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:02:04.219288 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:04.218816    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:02:05.300937 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:05.300894    2575 generic.go:356] "Generic (PLEG): container finished" podID="fd6c7967-b078-41d5-830f-a66e88e62116" containerID="0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb" exitCode=0
Sep 11 04:02:05.301477 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:05.300950    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" event={"ID":"fd6c7967-b078-41d5-830f-a66e88e62116","Type":"ContainerDied","Data":"0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb"}
Sep 11 04:02:05.301477 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:05.301407    2575 scope.go:117] "RemoveContainer" containerID="0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb"
Sep 11 04:02:05.302949 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:05.302912    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:02:05.303060 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:05.302998    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:02:05.303060 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:05.303045    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:02:06.313403 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:06.313359    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" event={"ID":"fd6c7967-b078-41d5-830f-a66e88e62116","Type":"ContainerStarted","Data":"3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4"}
Sep 11 04:02:07.232913 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:07.232873    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:02:07.233213 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:07.232885    2575 patch_prober.go:28] interesting pod/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 11 04:02:07.233324 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:07.233236    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 11 04:02:08.233256 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:08.233220    2575 patch_prober.go:28] interesting pod/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 11 04:02:08.233680 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:08.233280    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 11 04:02:09.232718 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:09.232681    2575 patch_prober.go:28] interesting pod/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 11 04:02:09.232895 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:09.232741    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 11 04:02:10.232846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:10.232808    2575 patch_prober.go:28] interesting pod/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 11 04:02:10.233256 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:10.232880    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 11 04:02:11.233190 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:11.233156    2575 patch_prober.go:28] interesting pod/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 11 04:02:11.233570 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:11.233218    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 11 04:02:11.263575 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:11.263542    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:02:12.237930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:12.237898    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:02:12.238305 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:12.238276    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:02:12.239064 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:12.239042    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:02:12.267751 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:12.267718    2575 patch_prober.go:28] interesting pod/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:02:12.267924 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:12.267774    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:02:12.269387 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:12.269367    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:02:13.282670 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:13.282640    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:02:13.362569 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:13.362537    2575 generic.go:356] "Generic (PLEG): container finished" podID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerID="1f8b47557a50066ef6b8ad1805cfe0a301a8e23771708595e4f5da19a6919270" exitCode=0
Sep 11 04:02:13.362734 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:13.362624    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" event={"ID":"7390518d-06a9-47a0-9c7c-1853cfd2c761","Type":"ContainerDied","Data":"1f8b47557a50066ef6b8ad1805cfe0a301a8e23771708595e4f5da19a6919270"}
Sep 11 04:02:13.363100 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:13.363084    2575 scope.go:117] "RemoveContainer" containerID="1f8b47557a50066ef6b8ad1805cfe0a301a8e23771708595e4f5da19a6919270"
Sep 11 04:02:13.364078 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:13.364054    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:02:13.364132 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:13.364115    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:02:13.364167 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:13.364146    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:02:14.369512 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:14.369481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" event={"ID":"7390518d-06a9-47a0-9c7c-1853cfd2c761","Type":"ContainerStarted","Data":"c7d9a241f0d8bd7fb0430bc2b3c44914eef1832f919a0269e26a89e3c0d8f31e"}
Sep 11 04:02:14.555241 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:14.555208    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:02:14.555435 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:14.555412    2575 patch_prober.go:28] interesting pod/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 11 04:02:14.555489 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:14.555470    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 11 04:02:15.555382 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:15.555345    2575 patch_prober.go:28] interesting pod/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 11 04:02:15.555799 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:15.555419    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 11 04:02:16.555486 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:16.555449    2575 patch_prober.go:28] interesting pod/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 11 04:02:16.555901 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:16.555506    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 11 04:02:17.555680 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:17.555639    2575 patch_prober.go:28] interesting pod/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 11 04:02:17.556072 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:17.555697    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 11 04:02:18.555836 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:18.555794    2575 patch_prober.go:28] interesting pod/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 11 04:02:18.556308 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:18.555864    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 11 04:02:19.559041 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.559013    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:02:19.559458 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.559263    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:02:19.559899 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.559883    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:02:19.749434 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.749402    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"]
Sep 11 04:02:19.752858 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.752838    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:02:19.755208 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.755186    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-5d685d\""
Sep 11 04:02:19.755314 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.755264    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-5d685d-dockercfg-kprcm\""
Sep 11 04:02:19.765844 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.765817    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"]
Sep 11 04:02:19.814797 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.814729    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"]
Sep 11 04:02:19.818172 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.818156    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:02:19.827422 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.827388    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"]
Sep 11 04:02:19.844899 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.844875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c676822a-9023-40b9-b350-0208d7af292d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj\" (UID: \"c676822a-9023-40b9-b350-0208d7af292d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:02:19.845041 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.844909    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vgwl\" (UniqueName: \"kubernetes.io/projected/c676822a-9023-40b9-b350-0208d7af292d-kube-api-access-6vgwl\") pod \"payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj\" (UID: \"c676822a-9023-40b9-b350-0208d7af292d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:02:19.946535 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.946503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0434b22f-8e51-4721-ae3f-f29f687b832d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f\" (UID: \"0434b22f-8e51-4721-ae3f-f29f687b832d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:02:19.946732 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.946592    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c676822a-9023-40b9-b350-0208d7af292d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj\" (UID: \"c676822a-9023-40b9-b350-0208d7af292d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:02:19.946732 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.946644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vgwl\" (UniqueName: \"kubernetes.io/projected/c676822a-9023-40b9-b350-0208d7af292d-kube-api-access-6vgwl\") pod \"payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj\" (UID: \"c676822a-9023-40b9-b350-0208d7af292d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:02:19.946732 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.946664    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph844\" (UniqueName: \"kubernetes.io/projected/0434b22f-8e51-4721-ae3f-f29f687b832d-kube-api-access-ph844\") pod \"payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f\" (UID: \"0434b22f-8e51-4721-ae3f-f29f687b832d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:02:19.947241 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.947223    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c676822a-9023-40b9-b350-0208d7af292d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj\" (UID: \"c676822a-9023-40b9-b350-0208d7af292d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:02:19.954838 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:19.954812    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vgwl\" (UniqueName: \"kubernetes.io/projected/c676822a-9023-40b9-b350-0208d7af292d-kube-api-access-6vgwl\") pod \"payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj\" (UID: \"c676822a-9023-40b9-b350-0208d7af292d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:02:20.048089 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:20.048057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0434b22f-8e51-4721-ae3f-f29f687b832d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f\" (UID: \"0434b22f-8e51-4721-ae3f-f29f687b832d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:02:20.048244 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:20.048162    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph844\" (UniqueName: \"kubernetes.io/projected/0434b22f-8e51-4721-ae3f-f29f687b832d-kube-api-access-ph844\") pod \"payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f\" (UID: \"0434b22f-8e51-4721-ae3f-f29f687b832d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:02:20.049030 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:20.049009    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0434b22f-8e51-4721-ae3f-f29f687b832d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f\" (UID: \"0434b22f-8e51-4721-ae3f-f29f687b832d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:02:20.056118 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:20.056093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph844\" (UniqueName: \"kubernetes.io/projected/0434b22f-8e51-4721-ae3f-f29f687b832d-kube-api-access-ph844\") pod \"payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f\" (UID: \"0434b22f-8e51-4721-ae3f-f29f687b832d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:02:20.063943 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:20.063922    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:02:20.130571 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:20.130537    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:02:20.346095 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:20.346071    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"]
Sep 11 04:02:20.347346 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:02:20.347320    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc676822a_9023_40b9_b350_0208d7af292d.slice/crio-b2903c6f890997a675f7990ab7996387699360070e1c91ab093ee85128ca30ea WatchSource:0}: Error finding container b2903c6f890997a675f7990ab7996387699360070e1c91ab093ee85128ca30ea: Status 404 returned error can't find the container with id b2903c6f890997a675f7990ab7996387699360070e1c91ab093ee85128ca30ea
Sep 11 04:02:20.425129 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:20.425099    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj" event={"ID":"c676822a-9023-40b9-b350-0208d7af292d","Type":"ContainerStarted","Data":"481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e"}
Sep 11 04:02:20.425278 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:20.425156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj" event={"ID":"c676822a-9023-40b9-b350-0208d7af292d","Type":"ContainerStarted","Data":"b2903c6f890997a675f7990ab7996387699360070e1c91ab093ee85128ca30ea"}
Sep 11 04:02:20.438153 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:20.438127    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"]
Sep 11 04:02:20.439549 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:02:20.439524    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0434b22f_8e51_4721_ae3f_f29f687b832d.slice/crio-eb703ce75acf5a675a6624c661e09b3c05ad2a4b4e0da75b8c08772b1601edd7 WatchSource:0}: Error finding container eb703ce75acf5a675a6624c661e09b3c05ad2a4b4e0da75b8c08772b1601edd7: Status 404 returned error can't find the container with id eb703ce75acf5a675a6624c661e09b3c05ad2a4b4e0da75b8c08772b1601edd7
Sep 11 04:02:20.463963 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:20.463920    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj" podStartSLOduration=1.4639062059999999 podStartE2EDuration="1.463906206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:02:20.462366576 +0000 UTC m=+746.340558891" watchObservedRunningTime="2026-09-11 04:02:20.463906206 +0000 UTC m=+746.342098507"
Sep 11 04:02:21.432858 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:21.432823    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f" event={"ID":"0434b22f-8e51-4721-ae3f-f29f687b832d","Type":"ContainerStarted","Data":"4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461"}
Sep 11 04:02:21.433304 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:21.432879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f" event={"ID":"0434b22f-8e51-4721-ae3f-f29f687b832d","Type":"ContainerStarted","Data":"eb703ce75acf5a675a6624c661e09b3c05ad2a4b4e0da75b8c08772b1601edd7"}
Sep 11 04:02:21.433304 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:21.433197    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:02:21.433304 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:21.433230    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:02:21.452898 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:21.452854    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f" podStartSLOduration=2.452839908 podStartE2EDuration="2.452839908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:02:21.452151123 +0000 UTC m=+747.330343425" watchObservedRunningTime="2026-09-11 04:02:21.452839908 +0000 UTC m=+747.331032250"
Sep 11 04:02:22.100205 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:22.100159    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"]
Sep 11 04:02:22.104470 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:22.104452    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"
Sep 11 04:02:22.107447 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:22.107416    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:02:22.110446 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:22.110420    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"]
Sep 11 04:02:22.271454 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:22.271416    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60199afa-cbea-45ec-9a14-07367beba34a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f547da13-9plkm\" (UID: \"60199afa-cbea-45ec-9a14-07367beba34a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"
Sep 11 04:02:22.372155 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:22.372068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60199afa-cbea-45ec-9a14-07367beba34a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f547da13-9plkm\" (UID: \"60199afa-cbea-45ec-9a14-07367beba34a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"
Sep 11 04:02:22.372809 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:22.372786    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60199afa-cbea-45ec-9a14-07367beba34a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f547da13-9plkm\" (UID: \"60199afa-cbea-45ec-9a14-07367beba34a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"
Sep 11 04:02:22.418077 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:22.418046    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"
Sep 11 04:02:22.691764 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:22.691734    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"]
Sep 11 04:02:22.692821 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:02:22.692786    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60199afa_cbea_45ec_9a14_07367beba34a.slice/crio-4ca101b582a253857d8c745185aa97da7aa72b97f1a560df4624f2b32d901cfc WatchSource:0}: Error finding container 4ca101b582a253857d8c745185aa97da7aa72b97f1a560df4624f2b32d901cfc: Status 404 returned error can't find the container with id 4ca101b582a253857d8c745185aa97da7aa72b97f1a560df4624f2b32d901cfc
Sep 11 04:02:23.445321 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:23.445286    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm" event={"ID":"60199afa-cbea-45ec-9a14-07367beba34a","Type":"ContainerStarted","Data":"4ca101b582a253857d8c745185aa97da7aa72b97f1a560df4624f2b32d901cfc"}
Sep 11 04:02:25.459043 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:25.458946    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm" event={"ID":"60199afa-cbea-45ec-9a14-07367beba34a","Type":"ContainerStarted","Data":"36853549683d7addb3b0f5ddb7194b085d5d371a479defd7e5679036982575de"}
Sep 11 04:02:25.474312 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:25.474264    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm" podStartSLOduration=1.082964813 podStartE2EDuration="3.474247973s" totalImagesPullingTime="2.39128316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:02:25.473466738 +0000 UTC m=+751.351659066" watchObservedRunningTime="2026-09-11 04:02:25.474247973 +0000 UTC m=+751.352440274"
Sep 11 04:02:26.467717 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:26.467686    2575 generic.go:356] "Generic (PLEG): container finished" podID="60199afa-cbea-45ec-9a14-07367beba34a" containerID="36853549683d7addb3b0f5ddb7194b085d5d371a479defd7e5679036982575de" exitCode=0
Sep 11 04:02:26.468081 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:26.467763    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm" event={"ID":"60199afa-cbea-45ec-9a14-07367beba34a","Type":"ContainerDied","Data":"36853549683d7addb3b0f5ddb7194b085d5d371a479defd7e5679036982575de"}
Sep 11 04:02:27.617321 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:27.617297    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"
Sep 11 04:02:27.622610 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:27.622578    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60199afa-cbea-45ec-9a14-07367beba34a-maas-api-service-ca\") pod \"60199afa-cbea-45ec-9a14-07367beba34a\" (UID: \"60199afa-cbea-45ec-9a14-07367beba34a\") "
Sep 11 04:02:27.622858 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:27.622834    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60199afa-cbea-45ec-9a14-07367beba34a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "60199afa-cbea-45ec-9a14-07367beba34a" (UID: "60199afa-cbea-45ec-9a14-07367beba34a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:02:27.723215 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:27.723170    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60199afa-cbea-45ec-9a14-07367beba34a-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:28.480334 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:28.480301    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"
Sep 11 04:02:28.480499 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:28.480351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm" event={"ID":"60199afa-cbea-45ec-9a14-07367beba34a","Type":"ContainerDied","Data":"4ca101b582a253857d8c745185aa97da7aa72b97f1a560df4624f2b32d901cfc"}
Sep 11 04:02:28.480499 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:28.480391    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ca101b582a253857d8c745185aa97da7aa72b97f1a560df4624f2b32d901cfc"
Sep 11 04:02:32.441169 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:32.441093    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:02:33.447970 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:33.447939    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:02:39.020808 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.020772    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"]
Sep 11 04:02:39.021676 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.021032    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd" podUID="5af202a1-2c7e-42dd-8f83-420fd3d1a260" containerName="payload-processing" containerID="cri-o://a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e" gracePeriod=30
Sep 11 04:02:39.032796 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.032764    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"]
Sep 11 04:02:39.033000 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.032975    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb" podUID="7c4770c6-61cf-4aa8-afcb-d514a2ea58b3" containerName="payload-pre-processing" containerID="cri-o://a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2" gracePeriod=30
Sep 11 04:02:39.225996 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.225922    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"]
Sep 11 04:02:39.230965 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.226875    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f547da13-9plkm"]
Sep 11 04:02:39.312985 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.312698    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:02:39.358460 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.358427    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"]
Sep 11 04:02:39.358791 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.358737    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy" containerID="cri-o://c7d9a241f0d8bd7fb0430bc2b3c44914eef1832f919a0269e26a89e3c0d8f31e" gracePeriod=30
Sep 11 04:02:39.363969 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.363948    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:02:39.429993 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.429958    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn888\" (UniqueName: \"kubernetes.io/projected/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-kube-api-access-sn888\") pod \"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3\" (UID: \"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3\") "
Sep 11 04:02:39.430175 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.430011    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af202a1-2c7e-42dd-8f83-420fd3d1a260-plugins-config-volume\") pod \"5af202a1-2c7e-42dd-8f83-420fd3d1a260\" (UID: \"5af202a1-2c7e-42dd-8f83-420fd3d1a260\") "
Sep 11 04:02:39.430175 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.430037    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwzlc\" (UniqueName: \"kubernetes.io/projected/5af202a1-2c7e-42dd-8f83-420fd3d1a260-kube-api-access-bwzlc\") pod \"5af202a1-2c7e-42dd-8f83-420fd3d1a260\" (UID: \"5af202a1-2c7e-42dd-8f83-420fd3d1a260\") "
Sep 11 04:02:39.430298 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.430168    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-plugins-config-volume\") pod \"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3\" (UID: \"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3\") "
Sep 11 04:02:39.430357 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.430338    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5af202a1-2c7e-42dd-8f83-420fd3d1a260-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5af202a1-2c7e-42dd-8f83-420fd3d1a260" (UID: "5af202a1-2c7e-42dd-8f83-420fd3d1a260"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:02:39.430567 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.430540    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c4770c6-61cf-4aa8-afcb-d514a2ea58b3" (UID: "7c4770c6-61cf-4aa8-afcb-d514a2ea58b3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:02:39.430878 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.430625    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af202a1-2c7e-42dd-8f83-420fd3d1a260-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:39.432380 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.432359    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-kube-api-access-sn888" (OuterVolumeSpecName: "kube-api-access-sn888") pod "7c4770c6-61cf-4aa8-afcb-d514a2ea58b3" (UID: "7c4770c6-61cf-4aa8-afcb-d514a2ea58b3"). InnerVolumeSpecName "kube-api-access-sn888". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:02:39.432380 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.432374    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5af202a1-2c7e-42dd-8f83-420fd3d1a260-kube-api-access-bwzlc" (OuterVolumeSpecName: "kube-api-access-bwzlc") pod "5af202a1-2c7e-42dd-8f83-420fd3d1a260" (UID: "5af202a1-2c7e-42dd-8f83-420fd3d1a260"). InnerVolumeSpecName "kube-api-access-bwzlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:02:39.531808 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.531773    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn888\" (UniqueName: \"kubernetes.io/projected/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-kube-api-access-sn888\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:39.531808 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.531803    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwzlc\" (UniqueName: \"kubernetes.io/projected/5af202a1-2c7e-42dd-8f83-420fd3d1a260-kube-api-access-bwzlc\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:39.531808 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.531813    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:39.542594 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.542522    2575 generic.go:356] "Generic (PLEG): container finished" podID="7c4770c6-61cf-4aa8-afcb-d514a2ea58b3" containerID="a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2" exitCode=0
Sep 11 04:02:39.542594 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.542576    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"
Sep 11 04:02:39.542776 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.542628    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb" event={"ID":"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3","Type":"ContainerDied","Data":"a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2"}
Sep 11 04:02:39.542776 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.542683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb" event={"ID":"7c4770c6-61cf-4aa8-afcb-d514a2ea58b3","Type":"ContainerDied","Data":"a58aab02d54c794b6435fce12a28969feb4a6e8af80da4e6e68faf34a299eb29"}
Sep 11 04:02:39.542776 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.542712    2575 scope.go:117] "RemoveContainer" containerID="a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2"
Sep 11 04:02:39.544063 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.544042    2575 generic.go:356] "Generic (PLEG): container finished" podID="5af202a1-2c7e-42dd-8f83-420fd3d1a260" containerID="a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e" exitCode=0
Sep 11 04:02:39.544190 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.544078    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"
Sep 11 04:02:39.544190 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.544096    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd" event={"ID":"5af202a1-2c7e-42dd-8f83-420fd3d1a260","Type":"ContainerDied","Data":"a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e"}
Sep 11 04:02:39.544190 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.544139    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd" event={"ID":"5af202a1-2c7e-42dd-8f83-420fd3d1a260","Type":"ContainerDied","Data":"d5d2a7ef177860705d5ff5af2b86e61cb02eeaf983d2c77469a0bad6f44798cb"}
Sep 11 04:02:39.552495 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.552475    2575 scope.go:117] "RemoveContainer" containerID="a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2"
Sep 11 04:02:39.552835 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:02:39.552811    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2\": container with ID starting with a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2 not found: ID does not exist" containerID="a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2"
Sep 11 04:02:39.552942 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.552840    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2"} err="failed to get container status \"a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2\": rpc error: code = NotFound desc = could not find container \"a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2\": container with ID starting with a315fa017abd859963741661f53ce65a5898df8f724a9b987b3c7ba920dd49e2 not found: ID does not exist"
Sep 11 04:02:39.552942 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.552861    2575 scope.go:117] "RemoveContainer" containerID="a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e"
Sep 11 04:02:39.561556 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.561537    2575 scope.go:117] "RemoveContainer" containerID="a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e"
Sep 11 04:02:39.561832 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:02:39.561814    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e\": container with ID starting with a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e not found: ID does not exist" containerID="a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e"
Sep 11 04:02:39.561886 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.561839    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e"} err="failed to get container status \"a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e\": rpc error: code = NotFound desc = could not find container \"a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e\": container with ID starting with a23271f431a32c4ca9d73cb6d986ae236738c3105de61901b5fb2edf7108760e not found: ID does not exist"
Sep 11 04:02:39.569611 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.569574    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"]
Sep 11 04:02:39.573320 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.573295    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd"]
Sep 11 04:02:39.582661 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.582638    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"]
Sep 11 04:02:39.586553 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:39.586528    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb"]
Sep 11 04:02:40.632993 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:40.632960    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5af202a1-2c7e-42dd-8f83-420fd3d1a260" path="/var/lib/kubelet/pods/5af202a1-2c7e-42dd-8f83-420fd3d1a260/volumes"
Sep 11 04:02:40.633371 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:40.633286    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60199afa-cbea-45ec-9a14-07367beba34a" path="/var/lib/kubelet/pods/60199afa-cbea-45ec-9a14-07367beba34a/volumes"
Sep 11 04:02:40.633583 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:40.633570    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c4770c6-61cf-4aa8-afcb-d514a2ea58b3" path="/var/lib/kubelet/pods/7c4770c6-61cf-4aa8-afcb-d514a2ea58b3/volumes"
Sep 11 04:02:44.306669 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.306635    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"]
Sep 11 04:02:44.307046 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.307033    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60199afa-cbea-45ec-9a14-07367beba34a" containerName="revoke-keys"
Sep 11 04:02:44.307092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.307048    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="60199afa-cbea-45ec-9a14-07367beba34a" containerName="revoke-keys"
Sep 11 04:02:44.307092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.307058    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af202a1-2c7e-42dd-8f83-420fd3d1a260" containerName="payload-processing"
Sep 11 04:02:44.307092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.307064    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af202a1-2c7e-42dd-8f83-420fd3d1a260" containerName="payload-processing"
Sep 11 04:02:44.307092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.307077    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4770c6-61cf-4aa8-afcb-d514a2ea58b3" containerName="payload-pre-processing"
Sep 11 04:02:44.307092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.307084    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4770c6-61cf-4aa8-afcb-d514a2ea58b3" containerName="payload-pre-processing"
Sep 11 04:02:44.307240 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.307153    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4770c6-61cf-4aa8-afcb-d514a2ea58b3" containerName="payload-pre-processing"
Sep 11 04:02:44.307240 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.307161    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af202a1-2c7e-42dd-8f83-420fd3d1a260" containerName="payload-processing"
Sep 11 04:02:44.307240 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.307171    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="60199afa-cbea-45ec-9a14-07367beba34a" containerName="revoke-keys"
Sep 11 04:02:44.314852 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.314833    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:02:44.317571 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.317552    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d3676176\""
Sep 11 04:02:44.321832 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.321811    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"]
Sep 11 04:02:44.375946 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.375921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64f5de92-79af-419a-b426-8f8952dc9129-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh\" (UID: \"64f5de92-79af-419a-b426-8f8952dc9129\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:02:44.376066 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.375956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkt5x\" (UniqueName: \"kubernetes.io/projected/64f5de92-79af-419a-b426-8f8952dc9129-kube-api-access-tkt5x\") pod \"payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh\" (UID: \"64f5de92-79af-419a-b426-8f8952dc9129\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:02:44.476433 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.476399    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkt5x\" (UniqueName: \"kubernetes.io/projected/64f5de92-79af-419a-b426-8f8952dc9129-kube-api-access-tkt5x\") pod \"payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh\" (UID: \"64f5de92-79af-419a-b426-8f8952dc9129\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:02:44.476610 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.476516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64f5de92-79af-419a-b426-8f8952dc9129-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh\" (UID: \"64f5de92-79af-419a-b426-8f8952dc9129\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:02:44.477162 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.477142    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64f5de92-79af-419a-b426-8f8952dc9129-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh\" (UID: \"64f5de92-79af-419a-b426-8f8952dc9129\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:02:44.484157 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.484127    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkt5x\" (UniqueName: \"kubernetes.io/projected/64f5de92-79af-419a-b426-8f8952dc9129-kube-api-access-tkt5x\") pod \"payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh\" (UID: \"64f5de92-79af-419a-b426-8f8952dc9129\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:02:44.577750 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.577670    2575 generic.go:356] "Generic (PLEG): container finished" podID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerID="c7d9a241f0d8bd7fb0430bc2b3c44914eef1832f919a0269e26a89e3c0d8f31e" exitCode=0
Sep 11 04:02:44.577912 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.577743    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" event={"ID":"7390518d-06a9-47a0-9c7c-1853cfd2c761","Type":"ContainerDied","Data":"c7d9a241f0d8bd7fb0430bc2b3c44914eef1832f919a0269e26a89e3c0d8f31e"}
Sep 11 04:02:44.577912 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.577825    2575 scope.go:117] "RemoveContainer" containerID="1f8b47557a50066ef6b8ad1805cfe0a301a8e23771708595e4f5da19a6919270"
Sep 11 04:02:44.612397 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.612375    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:02:44.625531 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.625510    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:02:44.677423 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.677393    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7390518d-06a9-47a0-9c7c-1853cfd2c761-istiod-ca-cert\") pod \"7390518d-06a9-47a0-9c7c-1853cfd2c761\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") "
Sep 11 04:02:44.677565 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.677446    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-podinfo\") pod \"7390518d-06a9-47a0-9c7c-1853cfd2c761\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") "
Sep 11 04:02:44.677565 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.677507    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-certs\") pod \"7390518d-06a9-47a0-9c7c-1853cfd2c761\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") "
Sep 11 04:02:44.677565 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.677543    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-token\") pod \"7390518d-06a9-47a0-9c7c-1853cfd2c761\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") "
Sep 11 04:02:44.678470 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.677588    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-data\") pod \"7390518d-06a9-47a0-9c7c-1853cfd2c761\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") "
Sep 11 04:02:44.678470 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.677649    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-envoy\") pod \"7390518d-06a9-47a0-9c7c-1853cfd2c761\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") "
Sep 11 04:02:44.678470 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.677738    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t7z8\" (UniqueName: \"kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-kube-api-access-6t7z8\") pod \"7390518d-06a9-47a0-9c7c-1853cfd2c761\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") "
Sep 11 04:02:44.678470 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.677783    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-socket\") pod \"7390518d-06a9-47a0-9c7c-1853cfd2c761\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") "
Sep 11 04:02:44.678470 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.677824    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-credential-socket\") pod \"7390518d-06a9-47a0-9c7c-1853cfd2c761\" (UID: \"7390518d-06a9-47a0-9c7c-1853cfd2c761\") "
Sep 11 04:02:44.679136 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.678760    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7390518d-06a9-47a0-9c7c-1853cfd2c761" (UID: "7390518d-06a9-47a0-9c7c-1853cfd2c761"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:02:44.679517 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.679475    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7390518d-06a9-47a0-9c7c-1853cfd2c761" (UID: "7390518d-06a9-47a0-9c7c-1853cfd2c761"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:02:44.679517 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.679480    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7390518d-06a9-47a0-9c7c-1853cfd2c761" (UID: "7390518d-06a9-47a0-9c7c-1853cfd2c761"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:02:44.679717 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.679676    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7390518d-06a9-47a0-9c7c-1853cfd2c761-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7390518d-06a9-47a0-9c7c-1853cfd2c761" (UID: "7390518d-06a9-47a0-9c7c-1853cfd2c761"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:02:44.679850 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.679785    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-data" (OuterVolumeSpecName: "istio-data") pod "7390518d-06a9-47a0-9c7c-1853cfd2c761" (UID: "7390518d-06a9-47a0-9c7c-1853cfd2c761"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:02:44.683438 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.683380    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-kube-api-access-6t7z8" (OuterVolumeSpecName: "kube-api-access-6t7z8") pod "7390518d-06a9-47a0-9c7c-1853cfd2c761" (UID: "7390518d-06a9-47a0-9c7c-1853cfd2c761"). InnerVolumeSpecName "kube-api-access-6t7z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:02:44.683938 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.683823    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-token" (OuterVolumeSpecName: "istio-token") pod "7390518d-06a9-47a0-9c7c-1853cfd2c761" (UID: "7390518d-06a9-47a0-9c7c-1853cfd2c761"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:02:44.683938 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.683912    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7390518d-06a9-47a0-9c7c-1853cfd2c761" (UID: "7390518d-06a9-47a0-9c7c-1853cfd2c761"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:02:44.684943 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.684901    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7390518d-06a9-47a0-9c7c-1853cfd2c761" (UID: "7390518d-06a9-47a0-9c7c-1853cfd2c761"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:02:44.779330 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.779290    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:44.779330 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.779328    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:44.779330 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.779338    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7390518d-06a9-47a0-9c7c-1853cfd2c761-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:44.779558 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.779348    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:44.779558 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.779356    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:44.779558 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.779364    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:44.779558 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.779371    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:44.779558 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.779378    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7390518d-06a9-47a0-9c7c-1853cfd2c761-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:44.779558 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.779385    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t7z8\" (UniqueName: \"kubernetes.io/projected/7390518d-06a9-47a0-9c7c-1853cfd2c761-kube-api-access-6t7z8\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:02:44.898249 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:44.898223    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"]
Sep 11 04:02:44.899486 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:02:44.899459    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f5de92_79af_419a_b426_8f8952dc9129.slice/crio-d494728c9a4163ce4795af9c2a3afb585788cf4b46adf2d83b2f327474f2c659 WatchSource:0}: Error finding container d494728c9a4163ce4795af9c2a3afb585788cf4b46adf2d83b2f327474f2c659: Status 404 returned error can't find the container with id d494728c9a4163ce4795af9c2a3afb585788cf4b46adf2d83b2f327474f2c659
Sep 11 04:02:45.585140 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:45.585100    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh" event={"ID":"64f5de92-79af-419a-b426-8f8952dc9129","Type":"ContainerStarted","Data":"161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5"}
Sep 11 04:02:45.585571 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:45.585174    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:02:45.585571 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:45.585201    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh" event={"ID":"64f5de92-79af-419a-b426-8f8952dc9129","Type":"ContainerStarted","Data":"d494728c9a4163ce4795af9c2a3afb585788cf4b46adf2d83b2f327474f2c659"}
Sep 11 04:02:45.586569 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:45.586553    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"
Sep 11 04:02:45.586659 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:45.586595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx" event={"ID":"7390518d-06a9-47a0-9c7c-1853cfd2c761","Type":"ContainerDied","Data":"9c9b45c898547d18cff908072e02260fa6a4ba775cf907a4381f5e52f190de1e"}
Sep 11 04:02:45.586720 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:45.586672    2575 scope.go:117] "RemoveContainer" containerID="c7d9a241f0d8bd7fb0430bc2b3c44914eef1832f919a0269e26a89e3c0d8f31e"
Sep 11 04:02:45.603673 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:45.603628    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh" podStartSLOduration=1.6035949029999998 podStartE2EDuration="1.603594903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:02:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:02:45.60116512 +0000 UTC m=+771.479357423" watchObservedRunningTime="2026-09-11 04:02:45.603594903 +0000 UTC m=+771.481787252"
Sep 11 04:02:45.617106 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:45.617078    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"]
Sep 11 04:02:45.624043 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:45.624021    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx"]
Sep 11 04:02:46.632285 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:46.632252    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" path="/var/lib/kubelet/pods/7390518d-06a9-47a0-9c7c-1853cfd2c761/volumes"
Sep 11 04:02:56.595368 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:02:56.595339    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:03:08.378494 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.378456    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"]
Sep 11 04:03:08.378986 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.378882    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy"
Sep 11 04:03:08.378986 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.378894    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy"
Sep 11 04:03:08.378986 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.378959    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy"
Sep 11 04:03:08.383553 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.383511    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"
Sep 11 04:03:08.386042 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.386020    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:03:08.387536 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.387515    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"]
Sep 11 04:03:08.393968 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.393945    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4151475e-6fc1-43e9-b7ab-08ad24d4cc03-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb\" (UID: \"4151475e-6fc1-43e9-b7ab-08ad24d4cc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"
Sep 11 04:03:08.494965 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.494929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4151475e-6fc1-43e9-b7ab-08ad24d4cc03-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb\" (UID: \"4151475e-6fc1-43e9-b7ab-08ad24d4cc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"
Sep 11 04:03:08.495528 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.495502    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4151475e-6fc1-43e9-b7ab-08ad24d4cc03-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb\" (UID: \"4151475e-6fc1-43e9-b7ab-08ad24d4cc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"
Sep 11 04:03:08.696132 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.696058    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"
Sep 11 04:03:08.964907 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:08.964880    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"]
Sep 11 04:03:08.966230 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:03:08.966191    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4151475e_6fc1_43e9_b7ab_08ad24d4cc03.slice/crio-17968d50526d0e3158c826ea1dd1e939767eb3bf9a41f8e48a7b7819e1f826d0 WatchSource:0}: Error finding container 17968d50526d0e3158c826ea1dd1e939767eb3bf9a41f8e48a7b7819e1f826d0: Status 404 returned error can't find the container with id 17968d50526d0e3158c826ea1dd1e939767eb3bf9a41f8e48a7b7819e1f826d0
Sep 11 04:03:09.722317 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:09.722290    2575 generic.go:356] "Generic (PLEG): container finished" podID="4151475e-6fc1-43e9-b7ab-08ad24d4cc03" containerID="bd4119c963290023f35e19ccd0aebcb326060a460c5009484994603177712e28" exitCode=0
Sep 11 04:03:09.722664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:09.722348    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb" event={"ID":"4151475e-6fc1-43e9-b7ab-08ad24d4cc03","Type":"ContainerDied","Data":"bd4119c963290023f35e19ccd0aebcb326060a460c5009484994603177712e28"}
Sep 11 04:03:09.722664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:09.722405    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb" event={"ID":"4151475e-6fc1-43e9-b7ab-08ad24d4cc03","Type":"ContainerStarted","Data":"17968d50526d0e3158c826ea1dd1e939767eb3bf9a41f8e48a7b7819e1f826d0"}
Sep 11 04:03:10.862573 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:10.862547    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"
Sep 11 04:03:10.917408 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:10.917373    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4151475e-6fc1-43e9-b7ab-08ad24d4cc03-maas-api-service-ca\") pod \"4151475e-6fc1-43e9-b7ab-08ad24d4cc03\" (UID: \"4151475e-6fc1-43e9-b7ab-08ad24d4cc03\") "
Sep 11 04:03:10.917746 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:10.917723    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4151475e-6fc1-43e9-b7ab-08ad24d4cc03-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4151475e-6fc1-43e9-b7ab-08ad24d4cc03" (UID: "4151475e-6fc1-43e9-b7ab-08ad24d4cc03"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:03:11.018944 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:11.018867    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4151475e-6fc1-43e9-b7ab-08ad24d4cc03-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:11.734107 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:11.734072    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"
Sep 11 04:03:11.734290 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:11.734103    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb" event={"ID":"4151475e-6fc1-43e9-b7ab-08ad24d4cc03","Type":"ContainerDied","Data":"17968d50526d0e3158c826ea1dd1e939767eb3bf9a41f8e48a7b7819e1f826d0"}
Sep 11 04:03:11.734290 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:11.734161    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17968d50526d0e3158c826ea1dd1e939767eb3bf9a41f8e48a7b7819e1f826d0"
Sep 11 04:03:14.263046 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.263011    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"]
Sep 11 04:03:14.263591 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.263264    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh" podUID="64f5de92-79af-419a-b426-8f8952dc9129" containerName="payload-pre-processing" containerID="cri-o://161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5" gracePeriod=30
Sep 11 04:03:14.412268 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.412235    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"]
Sep 11 04:03:14.418266 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.418238    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3676176-dw2bb"]
Sep 11 04:03:14.542729 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.542699    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:03:14.634011 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.633983    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4151475e-6fc1-43e9-b7ab-08ad24d4cc03" path="/var/lib/kubelet/pods/4151475e-6fc1-43e9-b7ab-08ad24d4cc03/volumes"
Sep 11 04:03:14.654242 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.654211    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64f5de92-79af-419a-b426-8f8952dc9129-plugins-config-volume\") pod \"64f5de92-79af-419a-b426-8f8952dc9129\" (UID: \"64f5de92-79af-419a-b426-8f8952dc9129\") "
Sep 11 04:03:14.654442 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.654252    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkt5x\" (UniqueName: \"kubernetes.io/projected/64f5de92-79af-419a-b426-8f8952dc9129-kube-api-access-tkt5x\") pod \"64f5de92-79af-419a-b426-8f8952dc9129\" (UID: \"64f5de92-79af-419a-b426-8f8952dc9129\") "
Sep 11 04:03:14.654705 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.654678    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64f5de92-79af-419a-b426-8f8952dc9129-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64f5de92-79af-419a-b426-8f8952dc9129" (UID: "64f5de92-79af-419a-b426-8f8952dc9129"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:03:14.656799 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.656771    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64f5de92-79af-419a-b426-8f8952dc9129-kube-api-access-tkt5x" (OuterVolumeSpecName: "kube-api-access-tkt5x") pod "64f5de92-79af-419a-b426-8f8952dc9129" (UID: "64f5de92-79af-419a-b426-8f8952dc9129"). InnerVolumeSpecName "kube-api-access-tkt5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:03:14.753871 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.753839    2575 generic.go:356] "Generic (PLEG): container finished" podID="64f5de92-79af-419a-b426-8f8952dc9129" containerID="161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5" exitCode=0
Sep 11 04:03:14.753871 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.753871    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"
Sep 11 04:03:14.754124 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.753895    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh" event={"ID":"64f5de92-79af-419a-b426-8f8952dc9129","Type":"ContainerDied","Data":"161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5"}
Sep 11 04:03:14.754124 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.753946    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh" event={"ID":"64f5de92-79af-419a-b426-8f8952dc9129","Type":"ContainerDied","Data":"d494728c9a4163ce4795af9c2a3afb585788cf4b46adf2d83b2f327474f2c659"}
Sep 11 04:03:14.754124 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.753976    2575 scope.go:117] "RemoveContainer" containerID="161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5"
Sep 11 04:03:14.755109 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.755046    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64f5de92-79af-419a-b426-8f8952dc9129-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:14.755109 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.755086    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkt5x\" (UniqueName: \"kubernetes.io/projected/64f5de92-79af-419a-b426-8f8952dc9129-kube-api-access-tkt5x\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:14.763654 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.763635    2575 scope.go:117] "RemoveContainer" containerID="161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5"
Sep 11 04:03:14.763942 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:03:14.763922    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5\": container with ID starting with 161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5 not found: ID does not exist" containerID="161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5"
Sep 11 04:03:14.763986 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.763952    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5"} err="failed to get container status \"161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5\": rpc error: code = NotFound desc = could not find container \"161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5\": container with ID starting with 161ea5f123d5b1d565316cc2bbb37aedef42c058af118ad83da3f126ba22a4d5 not found: ID does not exist"
Sep 11 04:03:14.774766 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.774719    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"]
Sep 11 04:03:14.780751 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:14.780730    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh"]
Sep 11 04:03:15.223920 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.223887    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"]
Sep 11 04:03:15.224468 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.224453    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4151475e-6fc1-43e9-b7ab-08ad24d4cc03" containerName="revoke-keys"
Sep 11 04:03:15.224512 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.224472    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4151475e-6fc1-43e9-b7ab-08ad24d4cc03" containerName="revoke-keys"
Sep 11 04:03:15.224512 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.224490    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy"
Sep 11 04:03:15.224512 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.224499    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy"
Sep 11 04:03:15.224634 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.224525    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f5de92-79af-419a-b426-8f8952dc9129" containerName="payload-pre-processing"
Sep 11 04:03:15.224634 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.224535    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f5de92-79af-419a-b426-8f8952dc9129" containerName="payload-pre-processing"
Sep 11 04:03:15.224707 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.224638    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7390518d-06a9-47a0-9c7c-1853cfd2c761" containerName="istio-proxy"
Sep 11 04:03:15.224707 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.224652    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4151475e-6fc1-43e9-b7ab-08ad24d4cc03" containerName="revoke-keys"
Sep 11 04:03:15.224707 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.224662    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="64f5de92-79af-419a-b426-8f8952dc9129" containerName="payload-pre-processing"
Sep 11 04:03:15.229142 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.229117    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.231704 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.231680    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1b0d05f3-openshift-default-dockercfg-chq54\""
Sep 11 04:03:15.236420 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.236400    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"]
Sep 11 04:03:15.260185 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.260152    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fa5362b-3198-471c-b730-382e9d071936-istio-podinfo\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.260387 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.260369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddbbq\" (UniqueName: \"kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-kube-api-access-ddbbq\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.260508 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.260494    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-credential-socket\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.260617 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.260586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-data\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.260738 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.260724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-certs\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.260888 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.260875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-istio-token\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.260991 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.260979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-envoy\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.261083 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.261071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-socket\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.261162 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.261151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fa5362b-3198-471c-b730-382e9d071936-istiod-ca-cert\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.362563 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.362529    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fa5362b-3198-471c-b730-382e9d071936-istio-podinfo\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.362563 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.362568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbbq\" (UniqueName: \"kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-kube-api-access-ddbbq\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363114 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.362594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-credential-socket\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363114 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.362632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-data\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363114 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.362663    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-certs\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363114 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.362737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-istio-token\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363114 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.362768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-envoy\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363114 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.362794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-socket\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363114 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.362817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fa5362b-3198-471c-b730-382e9d071936-istiod-ca-cert\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363114 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.363083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-data\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363432 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.363133    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-credential-socket\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363432 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.363194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-certs\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363432 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.363213    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-socket\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.363570 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.363553    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fa5362b-3198-471c-b730-382e9d071936-istiod-ca-cert\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.365293 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.365269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-envoy\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.365523 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.365503    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fa5362b-3198-471c-b730-382e9d071936-istio-podinfo\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.370630 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.370589    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-istio-token\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.370798 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.370782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddbbq\" (UniqueName: \"kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-kube-api-access-ddbbq\") pod \"e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") " pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.541120 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.541028    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:15.824104 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.824075    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"]
Sep 11 04:03:15.825362 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:03:15.825334    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa5362b_3198_471c_b730_382e9d071936.slice/crio-060c5a6e99ef1499368e21b47ca98542a5607239295729b40d5b702f7baf923c WatchSource:0}: Error finding container 060c5a6e99ef1499368e21b47ca98542a5607239295729b40d5b702f7baf923c: Status 404 returned error can't find the container with id 060c5a6e99ef1499368e21b47ca98542a5607239295729b40d5b702f7baf923c
Sep 11 04:03:15.827371 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.827341    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:03:15.827441 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.827412    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:03:15.827441 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:15.827437    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:03:16.633554 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:16.633519    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64f5de92-79af-419a-b426-8f8952dc9129" path="/var/lib/kubelet/pods/64f5de92-79af-419a-b426-8f8952dc9129/volumes"
Sep 11 04:03:16.768004 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:16.767970    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" event={"ID":"5fa5362b-3198-471c-b730-382e9d071936","Type":"ContainerStarted","Data":"389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99"}
Sep 11 04:03:16.768158 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:16.768018    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" event={"ID":"5fa5362b-3198-471c-b730-382e9d071936","Type":"ContainerStarted","Data":"060c5a6e99ef1499368e21b47ca98542a5607239295729b40d5b702f7baf923c"}
Sep 11 04:03:16.788848 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:16.788795    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" podStartSLOduration=1.788781432 podStartE2EDuration="1.788781432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:03:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:03:16.786487351 +0000 UTC m=+802.664679655" watchObservedRunningTime="2026-09-11 04:03:16.788781432 +0000 UTC m=+802.666973732"
Sep 11 04:03:17.541672 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:17.541633    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:17.546883 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:17.546860    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:17.773889 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:17.773853    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:17.774892 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:17.774871    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:20.101773 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.101740    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"]
Sep 11 04:03:20.105295 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.105276    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:20.107772 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.107753    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1b0d05f3\""
Sep 11 04:03:20.107987 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.107905    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1b0d05f3-dockercfg-vjtwm\""
Sep 11 04:03:20.114656 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.114633    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"]
Sep 11 04:03:20.204389 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.204349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed8c0037-1508-4ed8-a60b-1d89978622ca-plugins-config-volume\") pod \"payload-processing-e2e-ait-1b0d05f3-6646647789-627hj\" (UID: \"ed8c0037-1508-4ed8-a60b-1d89978622ca\") " pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:20.204389 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.204401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk6rd\" (UniqueName: \"kubernetes.io/projected/ed8c0037-1508-4ed8-a60b-1d89978622ca-kube-api-access-sk6rd\") pod \"payload-processing-e2e-ait-1b0d05f3-6646647789-627hj\" (UID: \"ed8c0037-1508-4ed8-a60b-1d89978622ca\") " pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:20.305263 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.305225    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed8c0037-1508-4ed8-a60b-1d89978622ca-plugins-config-volume\") pod \"payload-processing-e2e-ait-1b0d05f3-6646647789-627hj\" (UID: \"ed8c0037-1508-4ed8-a60b-1d89978622ca\") " pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:20.305263 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.305266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk6rd\" (UniqueName: \"kubernetes.io/projected/ed8c0037-1508-4ed8-a60b-1d89978622ca-kube-api-access-sk6rd\") pod \"payload-processing-e2e-ait-1b0d05f3-6646647789-627hj\" (UID: \"ed8c0037-1508-4ed8-a60b-1d89978622ca\") " pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:20.306005 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.305981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed8c0037-1508-4ed8-a60b-1d89978622ca-plugins-config-volume\") pod \"payload-processing-e2e-ait-1b0d05f3-6646647789-627hj\" (UID: \"ed8c0037-1508-4ed8-a60b-1d89978622ca\") " pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:20.316347 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.316327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk6rd\" (UniqueName: \"kubernetes.io/projected/ed8c0037-1508-4ed8-a60b-1d89978622ca-kube-api-access-sk6rd\") pod \"payload-processing-e2e-ait-1b0d05f3-6646647789-627hj\" (UID: \"ed8c0037-1508-4ed8-a60b-1d89978622ca\") " pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:20.418705 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.418621    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:20.709189 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.709160    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"]
Sep 11 04:03:20.710500 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:03:20.710470    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8c0037_1508_4ed8_a60b_1d89978622ca.slice/crio-0b46647448499ba3f2af3f3033c6ac70c91d0297310896b1a127f99f165c9e55 WatchSource:0}: Error finding container 0b46647448499ba3f2af3f3033c6ac70c91d0297310896b1a127f99f165c9e55: Status 404 returned error can't find the container with id 0b46647448499ba3f2af3f3033c6ac70c91d0297310896b1a127f99f165c9e55
Sep 11 04:03:20.794871 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.794833    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj" event={"ID":"ed8c0037-1508-4ed8-a60b-1d89978622ca","Type":"ContainerStarted","Data":"b4b210108edbd16908ec636753bb1f6e4f2a848dcf0e4362af0f388b82dabaaa"}
Sep 11 04:03:20.795061 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.794898    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj" event={"ID":"ed8c0037-1508-4ed8-a60b-1d89978622ca","Type":"ContainerStarted","Data":"0b46647448499ba3f2af3f3033c6ac70c91d0297310896b1a127f99f165c9e55"}
Sep 11 04:03:20.795061 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.794926    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:20.812012 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:20.811959    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj" podStartSLOduration=0.81194184 podStartE2EDuration="811.94184ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:03:20.810841767 +0000 UTC m=+806.689034082" watchObservedRunningTime="2026-09-11 04:03:20.81194184 +0000 UTC m=+806.690134194"
Sep 11 04:03:31.804491 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:31.804439    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:33.815763 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:33.815717    2575 patch_prober.go:28] interesting pod/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:03:33.816121 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:33.815789    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:03:34.876092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:34.876056    2575 generic.go:356] "Generic (PLEG): container finished" podID="5fa5362b-3198-471c-b730-382e9d071936" containerID="389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99" exitCode=0
Sep 11 04:03:34.876092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:34.876078    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" event={"ID":"5fa5362b-3198-471c-b730-382e9d071936","Type":"ContainerDied","Data":"389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99"}
Sep 11 04:03:34.876530 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:34.876432    2575 scope.go:117] "RemoveContainer" containerID="389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99"
Sep 11 04:03:34.877481 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:34.877456    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:03:34.877535 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:34.877523    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:03:34.877574 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:34.877556    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:03:35.889228 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:35.889184    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" event={"ID":"5fa5362b-3198-471c-b730-382e9d071936","Type":"ContainerStarted","Data":"bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd"}
Sep 11 04:03:36.541714 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:36.541673    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:36.541950 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:36.541925    2575 patch_prober.go:28] interesting pod/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 04:03:36.542031 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:36.541986    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 04:03:37.542276 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:37.542237    2575 patch_prober.go:28] interesting pod/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 04:03:37.542674 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:37.542308    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 04:03:38.542410 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:38.542376    2575 patch_prober.go:28] interesting pod/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 04:03:38.542853 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:38.542431    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 04:03:39.542527 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:39.542491    2575 patch_prober.go:28] interesting pod/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 04:03:39.542943 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:39.542557    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 04:03:40.541978 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:40.541942    2575 patch_prober.go:28] interesting pod/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 04:03:40.542158 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:40.542008    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 04:03:41.545778 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:41.545746    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:41.546237 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:41.546025    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:41.546703 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:41.546685    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:43.757558 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:43.757526    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"]
Sep 11 04:03:43.761174 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:43.761156    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"
Sep 11 04:03:43.763743 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:43.763724    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:03:43.769013 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:43.768672    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"]
Sep 11 04:03:43.936929 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:43.936892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5803d2b9-8294-4cc5-88c4-3e4d15519a1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq\" (UID: \"5803d2b9-8294-4cc5-88c4-3e4d15519a1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"
Sep 11 04:03:44.037940 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:44.037852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5803d2b9-8294-4cc5-88c4-3e4d15519a1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq\" (UID: \"5803d2b9-8294-4cc5-88c4-3e4d15519a1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"
Sep 11 04:03:44.038483 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:44.038461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5803d2b9-8294-4cc5-88c4-3e4d15519a1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq\" (UID: \"5803d2b9-8294-4cc5-88c4-3e4d15519a1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"
Sep 11 04:03:44.073736 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:44.073712    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"
Sep 11 04:03:44.343405 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:44.343376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"]
Sep 11 04:03:44.344299 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:03:44.344263    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5803d2b9_8294_4cc5_88c4_3e4d15519a1c.slice/crio-2297bbf9c75c5b813e54a420c2a78d6eb4d747dfbb40c38635b2586d1b0c8384 WatchSource:0}: Error finding container 2297bbf9c75c5b813e54a420c2a78d6eb4d747dfbb40c38635b2586d1b0c8384: Status 404 returned error can't find the container with id 2297bbf9c75c5b813e54a420c2a78d6eb4d747dfbb40c38635b2586d1b0c8384
Sep 11 04:03:44.960049 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:44.959955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq" event={"ID":"5803d2b9-8294-4cc5-88c4-3e4d15519a1c","Type":"ContainerStarted","Data":"e4ffab532097f9fa849585f63e648d4fbc9a557f7ddff8548565a571371ad055"}
Sep 11 04:03:44.960049 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:44.960016    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq" event={"ID":"5803d2b9-8294-4cc5-88c4-3e4d15519a1c","Type":"ContainerStarted","Data":"2297bbf9c75c5b813e54a420c2a78d6eb4d747dfbb40c38635b2586d1b0c8384"}
Sep 11 04:03:44.976438 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:44.976382    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq" podStartSLOduration=1.976362896 podStartE2EDuration="1.976362896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:03:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:03:44.974714411 +0000 UTC m=+830.852906717" watchObservedRunningTime="2026-09-11 04:03:44.976362896 +0000 UTC m=+830.854555198"
Sep 11 04:03:45.967426 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:45.967377    2575 generic.go:356] "Generic (PLEG): container finished" podID="5803d2b9-8294-4cc5-88c4-3e4d15519a1c" containerID="e4ffab532097f9fa849585f63e648d4fbc9a557f7ddff8548565a571371ad055" exitCode=0
Sep 11 04:03:45.967820 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:45.967447    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq" event={"ID":"5803d2b9-8294-4cc5-88c4-3e4d15519a1c","Type":"ContainerDied","Data":"e4ffab532097f9fa849585f63e648d4fbc9a557f7ddff8548565a571371ad055"}
Sep 11 04:03:47.121095 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:47.121072    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"
Sep 11 04:03:47.266913 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:47.266832    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5803d2b9-8294-4cc5-88c4-3e4d15519a1c-maas-api-service-ca\") pod \"5803d2b9-8294-4cc5-88c4-3e4d15519a1c\" (UID: \"5803d2b9-8294-4cc5-88c4-3e4d15519a1c\") "
Sep 11 04:03:47.267176 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:47.267153    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5803d2b9-8294-4cc5-88c4-3e4d15519a1c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5803d2b9-8294-4cc5-88c4-3e4d15519a1c" (UID: "5803d2b9-8294-4cc5-88c4-3e4d15519a1c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:03:47.367575 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:47.367536    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5803d2b9-8294-4cc5-88c4-3e4d15519a1c-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:47.979567 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:47.979534    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq" event={"ID":"5803d2b9-8294-4cc5-88c4-3e4d15519a1c","Type":"ContainerDied","Data":"2297bbf9c75c5b813e54a420c2a78d6eb4d747dfbb40c38635b2586d1b0c8384"}
Sep 11 04:03:47.979567 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:47.979550    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"
Sep 11 04:03:47.979809 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:47.979580    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2297bbf9c75c5b813e54a420c2a78d6eb4d747dfbb40c38635b2586d1b0c8384"
Sep 11 04:03:49.870453 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:49.870420    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"]
Sep 11 04:03:49.870946 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:49.870633    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj" podUID="ed8c0037-1508-4ed8-a60b-1d89978622ca" containerName="payload-processing" containerID="cri-o://b4b210108edbd16908ec636753bb1f6e4f2a848dcf0e4362af0f388b82dabaaa" gracePeriod=30
Sep 11 04:03:49.992959 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:49.992913    2575 generic.go:356] "Generic (PLEG): container finished" podID="ed8c0037-1508-4ed8-a60b-1d89978622ca" containerID="b4b210108edbd16908ec636753bb1f6e4f2a848dcf0e4362af0f388b82dabaaa" exitCode=0
Sep 11 04:03:49.993079 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:49.992985    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj" event={"ID":"ed8c0037-1508-4ed8-a60b-1d89978622ca","Type":"ContainerDied","Data":"b4b210108edbd16908ec636753bb1f6e4f2a848dcf0e4362af0f388b82dabaaa"}
Sep 11 04:03:50.025073 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:50.025023    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"]
Sep 11 04:03:50.027546 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:50.027526    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1b0d05f3-ng8wq"]
Sep 11 04:03:50.127871 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:50.127808    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:50.293509 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:50.293462    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed8c0037-1508-4ed8-a60b-1d89978622ca-plugins-config-volume\") pod \"ed8c0037-1508-4ed8-a60b-1d89978622ca\" (UID: \"ed8c0037-1508-4ed8-a60b-1d89978622ca\") "
Sep 11 04:03:50.293509 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:50.293517    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk6rd\" (UniqueName: \"kubernetes.io/projected/ed8c0037-1508-4ed8-a60b-1d89978622ca-kube-api-access-sk6rd\") pod \"ed8c0037-1508-4ed8-a60b-1d89978622ca\" (UID: \"ed8c0037-1508-4ed8-a60b-1d89978622ca\") "
Sep 11 04:03:50.293841 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:50.293818    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed8c0037-1508-4ed8-a60b-1d89978622ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed8c0037-1508-4ed8-a60b-1d89978622ca" (UID: "ed8c0037-1508-4ed8-a60b-1d89978622ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:03:50.295854 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:50.295829    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed8c0037-1508-4ed8-a60b-1d89978622ca-kube-api-access-sk6rd" (OuterVolumeSpecName: "kube-api-access-sk6rd") pod "ed8c0037-1508-4ed8-a60b-1d89978622ca" (UID: "ed8c0037-1508-4ed8-a60b-1d89978622ca"). InnerVolumeSpecName "kube-api-access-sk6rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:03:50.394739 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:50.394661    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk6rd\" (UniqueName: \"kubernetes.io/projected/ed8c0037-1508-4ed8-a60b-1d89978622ca-kube-api-access-sk6rd\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:50.394739 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:50.394696    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed8c0037-1508-4ed8-a60b-1d89978622ca-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:50.632372 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:50.632337    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5803d2b9-8294-4cc5-88c4-3e4d15519a1c" path="/var/lib/kubelet/pods/5803d2b9-8294-4cc5-88c4-3e4d15519a1c/volumes"
Sep 11 04:03:51.001706 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.001672    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj" event={"ID":"ed8c0037-1508-4ed8-a60b-1d89978622ca","Type":"ContainerDied","Data":"0b46647448499ba3f2af3f3033c6ac70c91d0297310896b1a127f99f165c9e55"}
Sep 11 04:03:51.001706 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.001700    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"
Sep 11 04:03:51.002237 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.001770    2575 scope.go:117] "RemoveContainer" containerID="b4b210108edbd16908ec636753bb1f6e4f2a848dcf0e4362af0f388b82dabaaa"
Sep 11 04:03:51.025575 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.025547    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"]
Sep 11 04:03:51.029495 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.029473    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj"]
Sep 11 04:03:51.101222 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.101187    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"]
Sep 11 04:03:51.101451 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.101404    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy" containerID="cri-o://bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd" gracePeriod=30
Sep 11 04:03:51.773154 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.773119    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"]
Sep 11 04:03:51.773586 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.773568    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8c0037-1508-4ed8-a60b-1d89978622ca" containerName="payload-processing"
Sep 11 04:03:51.773702 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.773590    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8c0037-1508-4ed8-a60b-1d89978622ca" containerName="payload-processing"
Sep 11 04:03:51.773702 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.773627    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5803d2b9-8294-4cc5-88c4-3e4d15519a1c" containerName="revoke-keys"
Sep 11 04:03:51.773702 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.773636    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5803d2b9-8294-4cc5-88c4-3e4d15519a1c" containerName="revoke-keys"
Sep 11 04:03:51.773860 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.773751    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5803d2b9-8294-4cc5-88c4-3e4d15519a1c" containerName="revoke-keys"
Sep 11 04:03:51.773860 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.773768    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed8c0037-1508-4ed8-a60b-1d89978622ca" containerName="payload-processing"
Sep 11 04:03:51.777943 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.777922    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.780496 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.780475    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0e17d64c-openshift-default-dockercfg-rf6sc\""
Sep 11 04:03:51.790134 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.790112    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"]
Sep 11 04:03:51.803966 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.803937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-socket\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.804088 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.803980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-podinfo\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.804088 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.804010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-envoy\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.804161 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.804096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7szn\" (UniqueName: \"kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-kube-api-access-q7szn\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.804161 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.804127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-token\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.804229 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.804189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-credential-socket\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.804263 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.804232    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c3f1822-c39a-44b8-949e-bfa33fe191da-istiod-ca-cert\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.804305 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.804287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-data\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.804345 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.804327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-certs\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905103 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-socket\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905103 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-podinfo\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905329 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905122    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-envoy\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905329 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7szn\" (UniqueName: \"kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-kube-api-access-q7szn\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905329 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-token\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905329 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-credential-socket\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905329 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c3f1822-c39a-44b8-949e-bfa33fe191da-istiod-ca-cert\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905329 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-data\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905678 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-certs\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905678 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905616    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-socket\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905801 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-credential-socket\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905858 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-data\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.905919 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.905858    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-certs\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.906110 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.906085    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c3f1822-c39a-44b8-949e-bfa33fe191da-istiod-ca-cert\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.907883 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.907862    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-envoy\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.908157 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.908139    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-podinfo\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.917240 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.916873    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7szn\" (UniqueName: \"kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-kube-api-access-q7szn\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:51.917240 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:51.917206    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-token\") pod \"e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") " pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:52.088862 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:52.088768    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:52.397316 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:52.397286    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"]
Sep 11 04:03:52.398056 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:03:52.398026    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3f1822_c39a_44b8_949e_bfa33fe191da.slice/crio-b72d59db3a2e9c58f5107b78c19aea101ae60aa86ebf5b9445d4fda44a3cf44d WatchSource:0}: Error finding container b72d59db3a2e9c58f5107b78c19aea101ae60aa86ebf5b9445d4fda44a3cf44d: Status 404 returned error can't find the container with id b72d59db3a2e9c58f5107b78c19aea101ae60aa86ebf5b9445d4fda44a3cf44d
Sep 11 04:03:52.400487 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:52.400455    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:03:52.400571 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:52.400520    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:03:52.400571 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:52.400550    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:03:52.634229 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:52.634194    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed8c0037-1508-4ed8-a60b-1d89978622ca" path="/var/lib/kubelet/pods/ed8c0037-1508-4ed8-a60b-1d89978622ca/volumes"
Sep 11 04:03:53.017992 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:53.017957    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" event={"ID":"8c3f1822-c39a-44b8-949e-bfa33fe191da","Type":"ContainerStarted","Data":"1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50"}
Sep 11 04:03:53.018205 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:53.018018    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" event={"ID":"8c3f1822-c39a-44b8-949e-bfa33fe191da","Type":"ContainerStarted","Data":"b72d59db3a2e9c58f5107b78c19aea101ae60aa86ebf5b9445d4fda44a3cf44d"}
Sep 11 04:03:53.041893 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:53.041829    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" podStartSLOduration=2.041807776 podStartE2EDuration="2.041807776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:03:53.037825044 +0000 UTC m=+838.916017383" watchObservedRunningTime="2026-09-11 04:03:53.041807776 +0000 UTC m=+838.920000080"
Sep 11 04:03:53.089173 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:53.089139    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:53.090655 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:53.090628    2575 patch_prober.go:28] interesting pod/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 11 04:03:53.090782 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:53.090684    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 11 04:03:54.094265 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:54.094232    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:55.030939 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:55.030910    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:55.031821 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:55.031804    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:03:56.134843 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.134816    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"]
Sep 11 04:03:56.138293 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.138277    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:03:56.140853 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.140827    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0e17d64c\""
Sep 11 04:03:56.140946 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.140876    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0e17d64c-dockercfg-t4999\""
Sep 11 04:03:56.149004 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.148980    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"]
Sep 11 04:03:56.245452 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.245423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-plugins-config-volume\") pod \"payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2\" (UID: \"87e6c847-2869-4e1c-907b-68eaf9ca1ca3\") " pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:03:56.245590 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.245528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmwjt\" (UniqueName: \"kubernetes.io/projected/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-kube-api-access-jmwjt\") pod \"payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2\" (UID: \"87e6c847-2869-4e1c-907b-68eaf9ca1ca3\") " pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:03:56.346161 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.346136    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmwjt\" (UniqueName: \"kubernetes.io/projected/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-kube-api-access-jmwjt\") pod \"payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2\" (UID: \"87e6c847-2869-4e1c-907b-68eaf9ca1ca3\") " pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:03:56.346305 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.346239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-plugins-config-volume\") pod \"payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2\" (UID: \"87e6c847-2869-4e1c-907b-68eaf9ca1ca3\") " pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:03:56.346958 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.346939    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-plugins-config-volume\") pod \"payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2\" (UID: \"87e6c847-2869-4e1c-907b-68eaf9ca1ca3\") " pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:03:56.354648 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.354628    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmwjt\" (UniqueName: \"kubernetes.io/projected/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-kube-api-access-jmwjt\") pod \"payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2\" (UID: \"87e6c847-2869-4e1c-907b-68eaf9ca1ca3\") " pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:03:56.355535 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.355520    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:56.447260 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447187    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fa5362b-3198-471c-b730-382e9d071936-istiod-ca-cert\") pod \"5fa5362b-3198-471c-b730-382e9d071936\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") "
Sep 11 04:03:56.447260 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447218    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fa5362b-3198-471c-b730-382e9d071936-istio-podinfo\") pod \"5fa5362b-3198-471c-b730-382e9d071936\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") "
Sep 11 04:03:56.447260 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447252    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-data\") pod \"5fa5362b-3198-471c-b730-382e9d071936\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") "
Sep 11 04:03:56.447518 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447281    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-istio-token\") pod \"5fa5362b-3198-471c-b730-382e9d071936\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") "
Sep 11 04:03:56.447518 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447299    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-envoy\") pod \"5fa5362b-3198-471c-b730-382e9d071936\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") "
Sep 11 04:03:56.447518 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447323    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-credential-socket\") pod \"5fa5362b-3198-471c-b730-382e9d071936\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") "
Sep 11 04:03:56.447518 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447358    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddbbq\" (UniqueName: \"kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-kube-api-access-ddbbq\") pod \"5fa5362b-3198-471c-b730-382e9d071936\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") "
Sep 11 04:03:56.447518 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447385    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-certs\") pod \"5fa5362b-3198-471c-b730-382e9d071936\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") "
Sep 11 04:03:56.447518 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447446    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-socket\") pod \"5fa5362b-3198-471c-b730-382e9d071936\" (UID: \"5fa5362b-3198-471c-b730-382e9d071936\") "
Sep 11 04:03:56.447930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447567    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-data" (OuterVolumeSpecName: "istio-data") pod "5fa5362b-3198-471c-b730-382e9d071936" (UID: "5fa5362b-3198-471c-b730-382e9d071936"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:03:56.447930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447701    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5fa5362b-3198-471c-b730-382e9d071936" (UID: "5fa5362b-3198-471c-b730-382e9d071936"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:03:56.447930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447762    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fa5362b-3198-471c-b730-382e9d071936-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5fa5362b-3198-471c-b730-382e9d071936" (UID: "5fa5362b-3198-471c-b730-382e9d071936"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:03:56.447930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447768    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5fa5362b-3198-471c-b730-382e9d071936" (UID: "5fa5362b-3198-471c-b730-382e9d071936"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:03:56.447930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447841    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fa5362b-3198-471c-b730-382e9d071936-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:56.447930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447859    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:56.447930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447872    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:56.447930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447912    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:56.448525 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.447961    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5fa5362b-3198-471c-b730-382e9d071936" (UID: "5fa5362b-3198-471c-b730-382e9d071936"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:03:56.449887 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.449856    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-kube-api-access-ddbbq" (OuterVolumeSpecName: "kube-api-access-ddbbq") pod "5fa5362b-3198-471c-b730-382e9d071936" (UID: "5fa5362b-3198-471c-b730-382e9d071936"). InnerVolumeSpecName "kube-api-access-ddbbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:03:56.449994 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.449916    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-istio-token" (OuterVolumeSpecName: "istio-token") pod "5fa5362b-3198-471c-b730-382e9d071936" (UID: "5fa5362b-3198-471c-b730-382e9d071936"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:03:56.449994 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.449913    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5fa5362b-3198-471c-b730-382e9d071936-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5fa5362b-3198-471c-b730-382e9d071936" (UID: "5fa5362b-3198-471c-b730-382e9d071936"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:03:56.449994 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.449924    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5fa5362b-3198-471c-b730-382e9d071936" (UID: "5fa5362b-3198-471c-b730-382e9d071936"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:03:56.494299 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.494277    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:03:56.549643 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.549521    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:56.549643 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.549557    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fa5362b-3198-471c-b730-382e9d071936-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:56.549643 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.549571    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:56.549643 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.549583    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fa5362b-3198-471c-b730-382e9d071936-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:56.549643 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.549618    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddbbq\" (UniqueName: \"kubernetes.io/projected/5fa5362b-3198-471c-b730-382e9d071936-kube-api-access-ddbbq\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:03:56.766134 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:56.766110    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"]
Sep 11 04:03:56.766482 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:03:56.766460    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e6c847_2869_4e1c_907b_68eaf9ca1ca3.slice/crio-2ace0e8e20cc631cf960f7b1608e16aa8d0791c7ed5a67f6c835eedc79e6e545 WatchSource:0}: Error finding container 2ace0e8e20cc631cf960f7b1608e16aa8d0791c7ed5a67f6c835eedc79e6e545: Status 404 returned error can't find the container with id 2ace0e8e20cc631cf960f7b1608e16aa8d0791c7ed5a67f6c835eedc79e6e545
Sep 11 04:03:57.044694 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.044583    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2" event={"ID":"87e6c847-2869-4e1c-907b-68eaf9ca1ca3","Type":"ContainerStarted","Data":"0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db"}
Sep 11 04:03:57.044882 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.044787    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:03:57.044882 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.044848    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2" event={"ID":"87e6c847-2869-4e1c-907b-68eaf9ca1ca3","Type":"ContainerStarted","Data":"2ace0e8e20cc631cf960f7b1608e16aa8d0791c7ed5a67f6c835eedc79e6e545"}
Sep 11 04:03:57.046383 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.046359    2575 generic.go:356] "Generic (PLEG): container finished" podID="5fa5362b-3198-471c-b730-382e9d071936" containerID="bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd" exitCode=0
Sep 11 04:03:57.046489 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.046428    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"
Sep 11 04:03:57.046489 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.046444    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" event={"ID":"5fa5362b-3198-471c-b730-382e9d071936","Type":"ContainerDied","Data":"bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd"}
Sep 11 04:03:57.046557 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.046495    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg" event={"ID":"5fa5362b-3198-471c-b730-382e9d071936","Type":"ContainerDied","Data":"060c5a6e99ef1499368e21b47ca98542a5607239295729b40d5b702f7baf923c"}
Sep 11 04:03:57.046557 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.046519    2575 scope.go:117] "RemoveContainer" containerID="bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd"
Sep 11 04:03:57.055801 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.055788    2575 scope.go:117] "RemoveContainer" containerID="389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99"
Sep 11 04:03:57.062727 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.062688    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2" podStartSLOduration=1.062675485 podStartE2EDuration="1.062675485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:03:57.060678452 +0000 UTC m=+842.938870755" watchObservedRunningTime="2026-09-11 04:03:57.062675485 +0000 UTC m=+842.940867832"
Sep 11 04:03:57.066310 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.066290    2575 scope.go:117] "RemoveContainer" containerID="bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd"
Sep 11 04:03:57.066558 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:03:57.066541    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd\": container with ID starting with bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd not found: ID does not exist" containerID="bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd"
Sep 11 04:03:57.066640 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.066566    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd"} err="failed to get container status \"bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd\": rpc error: code = NotFound desc = could not find container \"bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd\": container with ID starting with bf1fab90ea72f0d964831927bf20216e2c266e0da15acb9bdce64e57883913dd not found: ID does not exist"
Sep 11 04:03:57.066640 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.066582    2575 scope.go:117] "RemoveContainer" containerID="389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99"
Sep 11 04:03:57.066846 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:03:57.066830    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99\": container with ID starting with 389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99 not found: ID does not exist" containerID="389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99"
Sep 11 04:03:57.066887 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.066850    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99"} err="failed to get container status \"389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99\": rpc error: code = NotFound desc = could not find container \"389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99\": container with ID starting with 389fb9fbcddd1ded7cd3612f79683d98839888aefb28c68d943d365347715a99 not found: ID does not exist"
Sep 11 04:03:57.074989 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.074963    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"]
Sep 11 04:03:57.078557 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:57.078538    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg"]
Sep 11 04:03:58.633288 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:03:58.633254    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fa5362b-3198-471c-b730-382e9d071936" path="/var/lib/kubelet/pods/5fa5362b-3198-471c-b730-382e9d071936/volumes"
Sep 11 04:04:06.693820 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.693782    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"]
Sep 11 04:04:06.694538 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.694513    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy"
Sep 11 04:04:06.694688 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.694552    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy"
Sep 11 04:04:06.694688 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.694576    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy"
Sep 11 04:04:06.694688 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.694583    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy"
Sep 11 04:04:06.694854 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.694722    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy"
Sep 11 04:04:06.700189 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.700161    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"
Sep 11 04:04:06.704328 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.704097    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"]
Sep 11 04:04:06.705016 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.704998    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:04:06.750197 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.750170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55bb55e4-3bbd-4f83-9e3e-c4d217ad5411-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-944e93-jllwd\" (UID: \"55bb55e4-3bbd-4f83-9e3e-c4d217ad5411\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"
Sep 11 04:04:06.851322 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.851293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55bb55e4-3bbd-4f83-9e3e-c4d217ad5411-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-944e93-jllwd\" (UID: \"55bb55e4-3bbd-4f83-9e3e-c4d217ad5411\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"
Sep 11 04:04:06.851966 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:06.851944    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55bb55e4-3bbd-4f83-9e3e-c4d217ad5411-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-944e93-jllwd\" (UID: \"55bb55e4-3bbd-4f83-9e3e-c4d217ad5411\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"
Sep 11 04:04:07.017724 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:07.017683    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"
Sep 11 04:04:07.289290 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:07.289205    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"]
Sep 11 04:04:07.308331 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:04:07.308304    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55bb55e4_3bbd_4f83_9e3e_c4d217ad5411.slice/crio-85f976ca821984a24acd10bfc7197ad3a551c366c1d804d4b2098de196cdbbd3 WatchSource:0}: Error finding container 85f976ca821984a24acd10bfc7197ad3a551c366c1d804d4b2098de196cdbbd3: Status 404 returned error can't find the container with id 85f976ca821984a24acd10bfc7197ad3a551c366c1d804d4b2098de196cdbbd3
Sep 11 04:04:08.056192 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:08.056163    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:04:08.127787 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:08.127750    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd" event={"ID":"55bb55e4-3bbd-4f83-9e3e-c4d217ad5411","Type":"ContainerStarted","Data":"656480f28b2e6755987f46150b5fd8c036fd888b2cddfd32109e7bac3553f324"}
Sep 11 04:04:08.127787 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:08.127806    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd" event={"ID":"55bb55e4-3bbd-4f83-9e3e-c4d217ad5411","Type":"ContainerStarted","Data":"85f976ca821984a24acd10bfc7197ad3a551c366c1d804d4b2098de196cdbbd3"}
Sep 11 04:04:08.145465 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:08.145413    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd" podStartSLOduration=2.145398145 podStartE2EDuration="2.145398145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:04:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:04:08.142375173 +0000 UTC m=+854.020567475" watchObservedRunningTime="2026-09-11 04:04:08.145398145 +0000 UTC m=+854.023590448"
Sep 11 04:04:09.135060 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:09.135018    2575 generic.go:356] "Generic (PLEG): container finished" podID="55bb55e4-3bbd-4f83-9e3e-c4d217ad5411" containerID="656480f28b2e6755987f46150b5fd8c036fd888b2cddfd32109e7bac3553f324" exitCode=0
Sep 11 04:04:09.135545 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:09.135105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd" event={"ID":"55bb55e4-3bbd-4f83-9e3e-c4d217ad5411","Type":"ContainerDied","Data":"656480f28b2e6755987f46150b5fd8c036fd888b2cddfd32109e7bac3553f324"}
Sep 11 04:04:10.305464 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:10.305441    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"
Sep 11 04:04:10.384799 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:10.384774    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55bb55e4-3bbd-4f83-9e3e-c4d217ad5411-maas-api-service-ca\") pod \"55bb55e4-3bbd-4f83-9e3e-c4d217ad5411\" (UID: \"55bb55e4-3bbd-4f83-9e3e-c4d217ad5411\") "
Sep 11 04:04:10.385109 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:10.385085    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55bb55e4-3bbd-4f83-9e3e-c4d217ad5411-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "55bb55e4-3bbd-4f83-9e3e-c4d217ad5411" (UID: "55bb55e4-3bbd-4f83-9e3e-c4d217ad5411"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:04:10.485793 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:10.485755    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55bb55e4-3bbd-4f83-9e3e-c4d217ad5411-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:11.148234 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:11.148200    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"
Sep 11 04:04:11.148234 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:11.148215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd" event={"ID":"55bb55e4-3bbd-4f83-9e3e-c4d217ad5411","Type":"ContainerDied","Data":"85f976ca821984a24acd10bfc7197ad3a551c366c1d804d4b2098de196cdbbd3"}
Sep 11 04:04:11.148443 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:11.148296    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85f976ca821984a24acd10bfc7197ad3a551c366c1d804d4b2098de196cdbbd3"
Sep 11 04:04:14.168034 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:14.168004    2575 generic.go:356] "Generic (PLEG): container finished" podID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerID="1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50" exitCode=0
Sep 11 04:04:14.168532 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:14.168081    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" event={"ID":"8c3f1822-c39a-44b8-949e-bfa33fe191da","Type":"ContainerDied","Data":"1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50"}
Sep 11 04:04:14.168635 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:14.168558    2575 scope.go:117] "RemoveContainer" containerID="1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50"
Sep 11 04:04:14.169661 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:14.169574    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:04:14.169661 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:14.169655    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:04:14.169771 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:14.169706    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:04:15.175337 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:15.175306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" event={"ID":"8c3f1822-c39a-44b8-949e-bfa33fe191da","Type":"ContainerStarted","Data":"23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0"}
Sep 11 04:04:16.090105 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:16.090069    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:04:16.090503 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:16.090477    2575 patch_prober.go:28] interesting pod/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 11 04:04:16.090695 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:16.090668    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 11 04:04:17.076455 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.076422    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"]
Sep 11 04:04:17.076959 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.076729    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp" podUID="28d9d287-82c0-40fe-a30b-5e3566b84a2e" containerName="payload-processing" containerID="cri-o://cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493" gracePeriod=30
Sep 11 04:04:17.095632 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.093949    2575 patch_prober.go:28] interesting pod/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 11 04:04:17.095632 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.094008    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 11 04:04:17.396625 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.389767    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:04:17.451553 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.451518    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v66ww\" (UniqueName: \"kubernetes.io/projected/28d9d287-82c0-40fe-a30b-5e3566b84a2e-kube-api-access-v66ww\") pod \"28d9d287-82c0-40fe-a30b-5e3566b84a2e\" (UID: \"28d9d287-82c0-40fe-a30b-5e3566b84a2e\") "
Sep 11 04:04:17.451720 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.451708    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d9d287-82c0-40fe-a30b-5e3566b84a2e-plugins-config-volume\") pod \"28d9d287-82c0-40fe-a30b-5e3566b84a2e\" (UID: \"28d9d287-82c0-40fe-a30b-5e3566b84a2e\") "
Sep 11 04:04:17.452048 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.452025    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28d9d287-82c0-40fe-a30b-5e3566b84a2e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "28d9d287-82c0-40fe-a30b-5e3566b84a2e" (UID: "28d9d287-82c0-40fe-a30b-5e3566b84a2e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:04:17.453741 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.453721    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28d9d287-82c0-40fe-a30b-5e3566b84a2e-kube-api-access-v66ww" (OuterVolumeSpecName: "kube-api-access-v66ww") pod "28d9d287-82c0-40fe-a30b-5e3566b84a2e" (UID: "28d9d287-82c0-40fe-a30b-5e3566b84a2e"). InnerVolumeSpecName "kube-api-access-v66ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:04:17.461972 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.461952    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"]
Sep 11 04:04:17.464497 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.464475    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-944e93-jllwd"]
Sep 11 04:04:17.552971 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.552932    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v66ww\" (UniqueName: \"kubernetes.io/projected/28d9d287-82c0-40fe-a30b-5e3566b84a2e-kube-api-access-v66ww\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:17.552971 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:17.552964    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d9d287-82c0-40fe-a30b-5e3566b84a2e-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:18.089129 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.089091    2575 patch_prober.go:28] interesting pod/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 11 04:04:18.089771 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.089712    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 11 04:04:18.217671 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.217636    2575 generic.go:356] "Generic (PLEG): container finished" podID="28d9d287-82c0-40fe-a30b-5e3566b84a2e" containerID="cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493" exitCode=0
Sep 11 04:04:18.217846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.217678    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"
Sep 11 04:04:18.217846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.217703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp" event={"ID":"28d9d287-82c0-40fe-a30b-5e3566b84a2e","Type":"ContainerDied","Data":"cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493"}
Sep 11 04:04:18.217846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.217745    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp" event={"ID":"28d9d287-82c0-40fe-a30b-5e3566b84a2e","Type":"ContainerDied","Data":"a33118309543f2bd7874b917760b57d42806047fa8ca3dccbf098916f36c1358"}
Sep 11 04:04:18.217846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.217766    2575 scope.go:117] "RemoveContainer" containerID="cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493"
Sep 11 04:04:18.227351 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.227332    2575 scope.go:117] "RemoveContainer" containerID="cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493"
Sep 11 04:04:18.227633 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:04:18.227615    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493\": container with ID starting with cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493 not found: ID does not exist" containerID="cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493"
Sep 11 04:04:18.227689 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.227640    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493"} err="failed to get container status \"cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493\": rpc error: code = NotFound desc = could not find container \"cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493\": container with ID starting with cebdfa7bc5c9d2cbe4983f95880f1597c6b7829a06f29cbfa1bd86a2f6d6f493 not found: ID does not exist"
Sep 11 04:04:18.245492 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.245471    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"]
Sep 11 04:04:18.249297 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.249276    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp"]
Sep 11 04:04:18.632415 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.632371    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28d9d287-82c0-40fe-a30b-5e3566b84a2e" path="/var/lib/kubelet/pods/28d9d287-82c0-40fe-a30b-5e3566b84a2e/volumes"
Sep 11 04:04:18.632852 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:18.632828    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55bb55e4-3bbd-4f83-9e3e-c4d217ad5411" path="/var/lib/kubelet/pods/55bb55e4-3bbd-4f83-9e3e-c4d217ad5411/volumes"
Sep 11 04:04:19.089921 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.089876    2575 patch_prober.go:28] interesting pod/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 11 04:04:19.090422 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.089963    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 11 04:04:19.154277 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.154246    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"]
Sep 11 04:04:19.154876 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.154860    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55bb55e4-3bbd-4f83-9e3e-c4d217ad5411" containerName="revoke-keys"
Sep 11 04:04:19.154930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.154880    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="55bb55e4-3bbd-4f83-9e3e-c4d217ad5411" containerName="revoke-keys"
Sep 11 04:04:19.154930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.154907    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28d9d287-82c0-40fe-a30b-5e3566b84a2e" containerName="payload-processing"
Sep 11 04:04:19.154930 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.154916    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="28d9d287-82c0-40fe-a30b-5e3566b84a2e" containerName="payload-processing"
Sep 11 04:04:19.155026 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.155005    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="55bb55e4-3bbd-4f83-9e3e-c4d217ad5411" containerName="revoke-keys"
Sep 11 04:04:19.155026 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.155018    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa5362b-3198-471c-b730-382e9d071936" containerName="istio-proxy"
Sep 11 04:04:19.155089 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.155030    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="28d9d287-82c0-40fe-a30b-5e3566b84a2e" containerName="payload-processing"
Sep 11 04:04:19.158534 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.158513    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"
Sep 11 04:04:19.162510 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.161583    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:04:19.162891 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.162833    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"]
Sep 11 04:04:19.268316 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.268286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40bfbd4f-0519-4809-b7d4-105e3a144785-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf\" (UID: \"40bfbd4f-0519-4809-b7d4-105e3a144785\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"
Sep 11 04:04:19.369486 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.369391    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40bfbd4f-0519-4809-b7d4-105e3a144785-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf\" (UID: \"40bfbd4f-0519-4809-b7d4-105e3a144785\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"
Sep 11 04:04:19.370030 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.370012    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40bfbd4f-0519-4809-b7d4-105e3a144785-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf\" (UID: \"40bfbd4f-0519-4809-b7d4-105e3a144785\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"
Sep 11 04:04:19.471787 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.471758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"
Sep 11 04:04:19.764064 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:19.764034    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"]
Sep 11 04:04:19.765881 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:04:19.765852    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40bfbd4f_0519_4809_b7d4_105e3a144785.slice/crio-ea99b3bc3b34840ae8c39ec19b7fd6fae36d1e6601022a09d9b535e73899e397 WatchSource:0}: Error finding container ea99b3bc3b34840ae8c39ec19b7fd6fae36d1e6601022a09d9b535e73899e397: Status 404 returned error can't find the container with id ea99b3bc3b34840ae8c39ec19b7fd6fae36d1e6601022a09d9b535e73899e397
Sep 11 04:04:20.089512 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:20.089396    2575 patch_prober.go:28] interesting pod/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 11 04:04:20.089512 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:20.089437    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 11 04:04:20.234133 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:20.234097    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf" event={"ID":"40bfbd4f-0519-4809-b7d4-105e3a144785","Type":"ContainerStarted","Data":"1b82ddc4a20adac0df57708e2decb05bbccf68ef01c4dd13ac77c857268fcf0d"}
Sep 11 04:04:20.234538 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:20.234153    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf" event={"ID":"40bfbd4f-0519-4809-b7d4-105e3a144785","Type":"ContainerStarted","Data":"ea99b3bc3b34840ae8c39ec19b7fd6fae36d1e6601022a09d9b535e73899e397"}
Sep 11 04:04:20.251947 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:20.251885    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf" podStartSLOduration=1.2518624950000001 podStartE2EDuration="1.251862495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:04:20.248052708 +0000 UTC m=+866.126245024" watchObservedRunningTime="2026-09-11 04:04:20.251862495 +0000 UTC m=+866.130054798"
Sep 11 04:04:21.093942 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:21.093911    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:04:21.094339 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:21.094314    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:04:21.095096 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:21.095078    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:04:21.243062 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:21.243030    2575 generic.go:356] "Generic (PLEG): container finished" podID="40bfbd4f-0519-4809-b7d4-105e3a144785" containerID="1b82ddc4a20adac0df57708e2decb05bbccf68ef01c4dd13ac77c857268fcf0d" exitCode=0
Sep 11 04:04:21.243443 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:21.243106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf" event={"ID":"40bfbd4f-0519-4809-b7d4-105e3a144785","Type":"ContainerDied","Data":"1b82ddc4a20adac0df57708e2decb05bbccf68ef01c4dd13ac77c857268fcf0d"}
Sep 11 04:04:22.383799 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:22.383777    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"
Sep 11 04:04:22.498730 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:22.498694    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40bfbd4f-0519-4809-b7d4-105e3a144785-maas-api-service-ca\") pod \"40bfbd4f-0519-4809-b7d4-105e3a144785\" (UID: \"40bfbd4f-0519-4809-b7d4-105e3a144785\") "
Sep 11 04:04:22.499059 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:22.499011    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40bfbd4f-0519-4809-b7d4-105e3a144785-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40bfbd4f-0519-4809-b7d4-105e3a144785" (UID: "40bfbd4f-0519-4809-b7d4-105e3a144785"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:04:22.600104 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:22.600069    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40bfbd4f-0519-4809-b7d4-105e3a144785-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:23.254937 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:23.254911    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"
Sep 11 04:04:23.255118 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:23.254947    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf" event={"ID":"40bfbd4f-0519-4809-b7d4-105e3a144785","Type":"ContainerDied","Data":"ea99b3bc3b34840ae8c39ec19b7fd6fae36d1e6601022a09d9b535e73899e397"}
Sep 11 04:04:23.255118 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:23.254991    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea99b3bc3b34840ae8c39ec19b7fd6fae36d1e6601022a09d9b535e73899e397"
Sep 11 04:04:26.407272 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.407239    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"]
Sep 11 04:04:26.407689 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.407526    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2" podUID="87e6c847-2869-4e1c-907b-68eaf9ca1ca3" containerName="payload-processing" containerID="cri-o://0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db" gracePeriod=30
Sep 11 04:04:26.655338 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.655304    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"]
Sep 11 04:04:26.658306 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.658256    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0e17d64c-9vlbf"]
Sep 11 04:04:26.677709 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.677689    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:04:26.782188 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.782150    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"]
Sep 11 04:04:26.782462 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.782435    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy" containerID="cri-o://23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0" gracePeriod=30
Sep 11 04:04:26.836514 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.836479    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmwjt\" (UniqueName: \"kubernetes.io/projected/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-kube-api-access-jmwjt\") pod \"87e6c847-2869-4e1c-907b-68eaf9ca1ca3\" (UID: \"87e6c847-2869-4e1c-907b-68eaf9ca1ca3\") "
Sep 11 04:04:26.836731 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.836575    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-plugins-config-volume\") pod \"87e6c847-2869-4e1c-907b-68eaf9ca1ca3\" (UID: \"87e6c847-2869-4e1c-907b-68eaf9ca1ca3\") "
Sep 11 04:04:26.836921 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.836897    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "87e6c847-2869-4e1c-907b-68eaf9ca1ca3" (UID: "87e6c847-2869-4e1c-907b-68eaf9ca1ca3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:04:26.838698 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.838674    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-kube-api-access-jmwjt" (OuterVolumeSpecName: "kube-api-access-jmwjt") pod "87e6c847-2869-4e1c-907b-68eaf9ca1ca3" (UID: "87e6c847-2869-4e1c-907b-68eaf9ca1ca3"). InnerVolumeSpecName "kube-api-access-jmwjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:04:26.937810 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.937699    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmwjt\" (UniqueName: \"kubernetes.io/projected/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-kube-api-access-jmwjt\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:26.937810 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:26.937741    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87e6c847-2869-4e1c-907b-68eaf9ca1ca3-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:27.279562 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:27.279526    2575 generic.go:356] "Generic (PLEG): container finished" podID="87e6c847-2869-4e1c-907b-68eaf9ca1ca3" containerID="0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db" exitCode=0
Sep 11 04:04:27.279768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:27.279583    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"
Sep 11 04:04:27.279768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:27.279630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2" event={"ID":"87e6c847-2869-4e1c-907b-68eaf9ca1ca3","Type":"ContainerDied","Data":"0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db"}
Sep 11 04:04:27.279768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:27.279688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2" event={"ID":"87e6c847-2869-4e1c-907b-68eaf9ca1ca3","Type":"ContainerDied","Data":"2ace0e8e20cc631cf960f7b1608e16aa8d0791c7ed5a67f6c835eedc79e6e545"}
Sep 11 04:04:27.279768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:27.279709    2575 scope.go:117] "RemoveContainer" containerID="0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db"
Sep 11 04:04:27.289641 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:27.289625    2575 scope.go:117] "RemoveContainer" containerID="0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db"
Sep 11 04:04:27.289918 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:04:27.289894    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db\": container with ID starting with 0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db not found: ID does not exist" containerID="0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db"
Sep 11 04:04:27.289977 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:27.289926    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db"} err="failed to get container status \"0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db\": rpc error: code = NotFound desc = could not find container \"0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db\": container with ID starting with 0c2a869e441dfe0f2cfb13d8b7133bc5fe9a53e7f55c1d757a58799b939d78db not found: ID does not exist"
Sep 11 04:04:27.303593 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:27.303568    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"]
Sep 11 04:04:27.309028 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:27.309006    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2"]
Sep 11 04:04:28.632821 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:28.632790    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40bfbd4f-0519-4809-b7d4-105e3a144785" path="/var/lib/kubelet/pods/40bfbd4f-0519-4809-b7d4-105e3a144785/volumes"
Sep 11 04:04:28.633189 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:28.633128    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87e6c847-2869-4e1c-907b-68eaf9ca1ca3" path="/var/lib/kubelet/pods/87e6c847-2869-4e1c-907b-68eaf9ca1ca3/volumes"
Sep 11 04:04:30.443843 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.443809    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"]
Sep 11 04:04:30.444235 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.444174    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e6c847-2869-4e1c-907b-68eaf9ca1ca3" containerName="payload-processing"
Sep 11 04:04:30.444235 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.444185    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e6c847-2869-4e1c-907b-68eaf9ca1ca3" containerName="payload-processing"
Sep 11 04:04:30.444235 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.444212    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40bfbd4f-0519-4809-b7d4-105e3a144785" containerName="revoke-keys"
Sep 11 04:04:30.444235 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.444217    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="40bfbd4f-0519-4809-b7d4-105e3a144785" containerName="revoke-keys"
Sep 11 04:04:30.444384 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.444271    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="87e6c847-2869-4e1c-907b-68eaf9ca1ca3" containerName="payload-processing"
Sep 11 04:04:30.444384 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.444279    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="40bfbd4f-0519-4809-b7d4-105e3a144785" containerName="revoke-keys"
Sep 11 04:04:30.448322 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.448307    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:04:30.450847 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.450820    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-557c41\""
Sep 11 04:04:30.450983 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.450884    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-557c41-dockercfg-rl4fb\""
Sep 11 04:04:30.459348 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.459323    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"]
Sep 11 04:04:30.571522 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.571488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12dbc841-66b2-4819-b8eb-969b718fb3a1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8\" (UID: \"12dbc841-66b2-4819-b8eb-969b718fb3a1\") " pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:04:30.571724 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.571526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d2xb\" (UniqueName: \"kubernetes.io/projected/12dbc841-66b2-4819-b8eb-969b718fb3a1-kube-api-access-6d2xb\") pod \"payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8\" (UID: \"12dbc841-66b2-4819-b8eb-969b718fb3a1\") " pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:04:30.673093 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.673056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12dbc841-66b2-4819-b8eb-969b718fb3a1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8\" (UID: \"12dbc841-66b2-4819-b8eb-969b718fb3a1\") " pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:04:30.673093 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.673097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d2xb\" (UniqueName: \"kubernetes.io/projected/12dbc841-66b2-4819-b8eb-969b718fb3a1-kube-api-access-6d2xb\") pod \"payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8\" (UID: \"12dbc841-66b2-4819-b8eb-969b718fb3a1\") " pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:04:30.673828 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.673803    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12dbc841-66b2-4819-b8eb-969b718fb3a1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8\" (UID: \"12dbc841-66b2-4819-b8eb-969b718fb3a1\") " pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:04:30.681537 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.681516    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d2xb\" (UniqueName: \"kubernetes.io/projected/12dbc841-66b2-4819-b8eb-969b718fb3a1-kube-api-access-6d2xb\") pod \"payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8\" (UID: \"12dbc841-66b2-4819-b8eb-969b718fb3a1\") " pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:04:30.759706 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:30.759673    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:04:31.030682 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:31.030658    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"]
Sep 11 04:04:31.032279 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:04:31.032236    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12dbc841_66b2_4819_b8eb_969b718fb3a1.slice/crio-e97304d0bf994e07572e7baf8f2c0d43c754c3230d3b0d969110f0b59f0b21af WatchSource:0}: Error finding container e97304d0bf994e07572e7baf8f2c0d43c754c3230d3b0d969110f0b59f0b21af: Status 404 returned error can't find the container with id e97304d0bf994e07572e7baf8f2c0d43c754c3230d3b0d969110f0b59f0b21af
Sep 11 04:04:31.305561 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:31.305461    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8" event={"ID":"12dbc841-66b2-4819-b8eb-969b718fb3a1","Type":"ContainerStarted","Data":"4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592"}
Sep 11 04:04:31.305561 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:31.305517    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8" event={"ID":"12dbc841-66b2-4819-b8eb-969b718fb3a1","Type":"ContainerStarted","Data":"e97304d0bf994e07572e7baf8f2c0d43c754c3230d3b0d969110f0b59f0b21af"}
Sep 11 04:04:31.305561 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:31.305544    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:04:31.323617 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:31.323553    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8" podStartSLOduration=1.3235378230000001 podStartE2EDuration="1.323537823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:04:31.321388062 +0000 UTC m=+877.199580376" watchObservedRunningTime="2026-09-11 04:04:31.323537823 +0000 UTC m=+877.201730126"
Sep 11 04:04:32.044697 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.044639    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:04:32.185724 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.185691    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-envoy\") pod \"8c3f1822-c39a-44b8-949e-bfa33fe191da\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") "
Sep 11 04:04:32.185724 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.185732    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-credential-socket\") pod \"8c3f1822-c39a-44b8-949e-bfa33fe191da\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") "
Sep 11 04:04:32.185962 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.185756    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-token\") pod \"8c3f1822-c39a-44b8-949e-bfa33fe191da\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") "
Sep 11 04:04:32.185962 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.185778    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-socket\") pod \"8c3f1822-c39a-44b8-949e-bfa33fe191da\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") "
Sep 11 04:04:32.185962 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.185798    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c3f1822-c39a-44b8-949e-bfa33fe191da-istiod-ca-cert\") pod \"8c3f1822-c39a-44b8-949e-bfa33fe191da\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") "
Sep 11 04:04:32.185962 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.185867    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7szn\" (UniqueName: \"kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-kube-api-access-q7szn\") pod \"8c3f1822-c39a-44b8-949e-bfa33fe191da\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") "
Sep 11 04:04:32.185962 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.185896    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-podinfo\") pod \"8c3f1822-c39a-44b8-949e-bfa33fe191da\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") "
Sep 11 04:04:32.185962 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.185927    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-certs\") pod \"8c3f1822-c39a-44b8-949e-bfa33fe191da\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") "
Sep 11 04:04:32.185962 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.185963    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-data\") pod \"8c3f1822-c39a-44b8-949e-bfa33fe191da\" (UID: \"8c3f1822-c39a-44b8-949e-bfa33fe191da\") "
Sep 11 04:04:32.186305 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.186017    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c3f1822-c39a-44b8-949e-bfa33fe191da" (UID: "8c3f1822-c39a-44b8-949e-bfa33fe191da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:04:32.186305 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.186094    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c3f1822-c39a-44b8-949e-bfa33fe191da" (UID: "8c3f1822-c39a-44b8-949e-bfa33fe191da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:04:32.186305 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.186271    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c3f1822-c39a-44b8-949e-bfa33fe191da" (UID: "8c3f1822-c39a-44b8-949e-bfa33fe191da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:04:32.186305 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.186286    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:32.186305 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.186303    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:32.186570 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.186539    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c3f1822-c39a-44b8-949e-bfa33fe191da" (UID: "8c3f1822-c39a-44b8-949e-bfa33fe191da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:04:32.186775 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.186756    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c3f1822-c39a-44b8-949e-bfa33fe191da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c3f1822-c39a-44b8-949e-bfa33fe191da" (UID: "8c3f1822-c39a-44b8-949e-bfa33fe191da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:04:32.188097 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.188073    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c3f1822-c39a-44b8-949e-bfa33fe191da" (UID: "8c3f1822-c39a-44b8-949e-bfa33fe191da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:04:32.188379 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.188360    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-kube-api-access-q7szn" (OuterVolumeSpecName: "kube-api-access-q7szn") pod "8c3f1822-c39a-44b8-949e-bfa33fe191da" (UID: "8c3f1822-c39a-44b8-949e-bfa33fe191da"). InnerVolumeSpecName "kube-api-access-q7szn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:04:32.188565 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.188534    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c3f1822-c39a-44b8-949e-bfa33fe191da" (UID: "8c3f1822-c39a-44b8-949e-bfa33fe191da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:04:32.188565 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.188553    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c3f1822-c39a-44b8-949e-bfa33fe191da" (UID: "8c3f1822-c39a-44b8-949e-bfa33fe191da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:04:32.287661 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.287592    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:32.287661 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.287651    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:32.287661 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.287660    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:32.287661 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.287667    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:32.287661 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.287675    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:32.288086 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.287683    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c3f1822-c39a-44b8-949e-bfa33fe191da-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:32.288086 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.287691    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7szn\" (UniqueName: \"kubernetes.io/projected/8c3f1822-c39a-44b8-949e-bfa33fe191da-kube-api-access-q7szn\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:04:32.313784 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.313695    2575 generic.go:356] "Generic (PLEG): container finished" podID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerID="23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0" exitCode=0
Sep 11 04:04:32.313784 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.313747    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"
Sep 11 04:04:32.313971 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.313787    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" event={"ID":"8c3f1822-c39a-44b8-949e-bfa33fe191da","Type":"ContainerDied","Data":"23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0"}
Sep 11 04:04:32.313971 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.313842    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw" event={"ID":"8c3f1822-c39a-44b8-949e-bfa33fe191da","Type":"ContainerDied","Data":"b72d59db3a2e9c58f5107b78c19aea101ae60aa86ebf5b9445d4fda44a3cf44d"}
Sep 11 04:04:32.313971 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.313864    2575 scope.go:117] "RemoveContainer" containerID="23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0"
Sep 11 04:04:32.323988 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.323972    2575 scope.go:117] "RemoveContainer" containerID="1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50"
Sep 11 04:04:32.333088 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.333069    2575 scope.go:117] "RemoveContainer" containerID="23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0"
Sep 11 04:04:32.333346 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:04:32.333329    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0\": container with ID starting with 23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0 not found: ID does not exist" containerID="23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0"
Sep 11 04:04:32.333423 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.333352    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0"} err="failed to get container status \"23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0\": rpc error: code = NotFound desc = could not find container \"23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0\": container with ID starting with 23074633cdb7d6ed0c689d84ab9336615aa234f9670204b3e2ecb33c9da87ee0 not found: ID does not exist"
Sep 11 04:04:32.333423 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.333367    2575 scope.go:117] "RemoveContainer" containerID="1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50"
Sep 11 04:04:32.333683 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:04:32.333665    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50\": container with ID starting with 1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50 not found: ID does not exist" containerID="1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50"
Sep 11 04:04:32.333724 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.333689    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50"} err="failed to get container status \"1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50\": rpc error: code = NotFound desc = could not find container \"1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50\": container with ID starting with 1776d89f3169e29a88ec26f9878e2df112e6132202e6766933e4c83317213d50 not found: ID does not exist"
Sep 11 04:04:32.338722 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.338702    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"]
Sep 11 04:04:32.344269 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.344248    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw"]
Sep 11 04:04:32.633712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:32.633636    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" path="/var/lib/kubelet/pods/8c3f1822-c39a-44b8-949e-bfa33fe191da/volumes"
Sep 11 04:04:42.315907 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:42.315876    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:04:54.637186 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:54.637110    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 04:04:54.638480 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:04:54.638449    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 04:05:25.429165 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.429126    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"]
Sep 11 04:05:25.429657 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.429496    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy"
Sep 11 04:05:25.429657 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.429507    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy"
Sep 11 04:05:25.429657 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.429522    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy"
Sep 11 04:05:25.429657 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.429527    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy"
Sep 11 04:05:25.429657 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.429617    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy"
Sep 11 04:05:25.432681 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.432664    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"
Sep 11 04:05:25.434991 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.434969    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:05:25.440537 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.440498    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"]
Sep 11 04:05:25.539872 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.539837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1bd1d8-d7d8-4890-a539-311e790cdf52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-557c41-75pgz\" (UID: \"6a1bd1d8-d7d8-4890-a539-311e790cdf52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"
Sep 11 04:05:25.641326 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.641290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1bd1d8-d7d8-4890-a539-311e790cdf52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-557c41-75pgz\" (UID: \"6a1bd1d8-d7d8-4890-a539-311e790cdf52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"
Sep 11 04:05:25.641926 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.641906    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1bd1d8-d7d8-4890-a539-311e790cdf52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-557c41-75pgz\" (UID: \"6a1bd1d8-d7d8-4890-a539-311e790cdf52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"
Sep 11 04:05:25.746349 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:25.746320    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"
Sep 11 04:05:26.019508 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:26.019484    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"]
Sep 11 04:05:26.021046 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:05:26.021023    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1bd1d8_d7d8_4890_a539_311e790cdf52.slice/crio-adbf6a49a7f2675dfc0b41f71f16b7f85adfdfcb9c3bef826db338b97933788b WatchSource:0}: Error finding container adbf6a49a7f2675dfc0b41f71f16b7f85adfdfcb9c3bef826db338b97933788b: Status 404 returned error can't find the container with id adbf6a49a7f2675dfc0b41f71f16b7f85adfdfcb9c3bef826db338b97933788b
Sep 11 04:05:26.633386 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:26.633306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz" event={"ID":"6a1bd1d8-d7d8-4890-a539-311e790cdf52","Type":"ContainerStarted","Data":"16237f80afa05e4887d6de3479c45688a3379cf727e6ee3bddee9d6d84f7ca96"}
Sep 11 04:05:26.633386 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:26.633357    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz" event={"ID":"6a1bd1d8-d7d8-4890-a539-311e790cdf52","Type":"ContainerStarted","Data":"adbf6a49a7f2675dfc0b41f71f16b7f85adfdfcb9c3bef826db338b97933788b"}
Sep 11 04:05:26.647355 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:26.647308    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz" podStartSLOduration=1.6472934609999998 podStartE2EDuration="1.647293461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:05:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:05:26.645755904 +0000 UTC m=+932.523948207" watchObservedRunningTime="2026-09-11 04:05:26.647293461 +0000 UTC m=+932.525485806"
Sep 11 04:05:27.638480 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:27.638445    2575 generic.go:356] "Generic (PLEG): container finished" podID="6a1bd1d8-d7d8-4890-a539-311e790cdf52" containerID="16237f80afa05e4887d6de3479c45688a3379cf727e6ee3bddee9d6d84f7ca96" exitCode=0
Sep 11 04:05:27.638878 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:27.638526    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz" event={"ID":"6a1bd1d8-d7d8-4890-a539-311e790cdf52","Type":"ContainerDied","Data":"16237f80afa05e4887d6de3479c45688a3379cf727e6ee3bddee9d6d84f7ca96"}
Sep 11 04:05:28.779290 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:28.779263    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"
Sep 11 04:05:28.870684 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:28.870658    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1bd1d8-d7d8-4890-a539-311e790cdf52-maas-api-service-ca\") pod \"6a1bd1d8-d7d8-4890-a539-311e790cdf52\" (UID: \"6a1bd1d8-d7d8-4890-a539-311e790cdf52\") "
Sep 11 04:05:28.870997 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:28.870974    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a1bd1d8-d7d8-4890-a539-311e790cdf52-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6a1bd1d8-d7d8-4890-a539-311e790cdf52" (UID: "6a1bd1d8-d7d8-4890-a539-311e790cdf52"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:05:28.972335 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:28.972308    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1bd1d8-d7d8-4890-a539-311e790cdf52-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:05:29.651173 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:29.651139    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz" event={"ID":"6a1bd1d8-d7d8-4890-a539-311e790cdf52","Type":"ContainerDied","Data":"adbf6a49a7f2675dfc0b41f71f16b7f85adfdfcb9c3bef826db338b97933788b"}
Sep 11 04:05:29.651173 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:29.651172    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"
Sep 11 04:05:29.651379 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:29.651186    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adbf6a49a7f2675dfc0b41f71f16b7f85adfdfcb9c3bef826db338b97933788b"
Sep 11 04:05:36.077705 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.077667    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"]
Sep 11 04:05:36.078106 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.077930    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8" podUID="12dbc841-66b2-4819-b8eb-969b718fb3a1" containerName="payload-processing" containerID="cri-o://4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592" gracePeriod=30
Sep 11 04:05:36.243330 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.243295    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"]
Sep 11 04:05:36.245638 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.245594    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-557c41-75pgz"]
Sep 11 04:05:36.330439 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.330382    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:05:36.444355 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.444324    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12dbc841-66b2-4819-b8eb-969b718fb3a1-plugins-config-volume\") pod \"12dbc841-66b2-4819-b8eb-969b718fb3a1\" (UID: \"12dbc841-66b2-4819-b8eb-969b718fb3a1\") "
Sep 11 04:05:36.444531 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.444368    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d2xb\" (UniqueName: \"kubernetes.io/projected/12dbc841-66b2-4819-b8eb-969b718fb3a1-kube-api-access-6d2xb\") pod \"12dbc841-66b2-4819-b8eb-969b718fb3a1\" (UID: \"12dbc841-66b2-4819-b8eb-969b718fb3a1\") "
Sep 11 04:05:36.444797 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.444775    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12dbc841-66b2-4819-b8eb-969b718fb3a1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "12dbc841-66b2-4819-b8eb-969b718fb3a1" (UID: "12dbc841-66b2-4819-b8eb-969b718fb3a1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:05:36.446587 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.446566    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12dbc841-66b2-4819-b8eb-969b718fb3a1-kube-api-access-6d2xb" (OuterVolumeSpecName: "kube-api-access-6d2xb") pod "12dbc841-66b2-4819-b8eb-969b718fb3a1" (UID: "12dbc841-66b2-4819-b8eb-969b718fb3a1"). InnerVolumeSpecName "kube-api-access-6d2xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:05:36.545675 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.545638    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12dbc841-66b2-4819-b8eb-969b718fb3a1-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:05:36.545675 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.545670    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d2xb\" (UniqueName: \"kubernetes.io/projected/12dbc841-66b2-4819-b8eb-969b718fb3a1-kube-api-access-6d2xb\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:05:36.633078 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.633002    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a1bd1d8-d7d8-4890-a539-311e790cdf52" path="/var/lib/kubelet/pods/6a1bd1d8-d7d8-4890-a539-311e790cdf52/volumes"
Sep 11 04:05:36.696397 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.696362    2575 generic.go:356] "Generic (PLEG): container finished" podID="12dbc841-66b2-4819-b8eb-969b718fb3a1" containerID="4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592" exitCode=0
Sep 11 04:05:36.696564 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.696403    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"
Sep 11 04:05:36.696564 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.696442    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8" event={"ID":"12dbc841-66b2-4819-b8eb-969b718fb3a1","Type":"ContainerDied","Data":"4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592"}
Sep 11 04:05:36.696564 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.696486    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8" event={"ID":"12dbc841-66b2-4819-b8eb-969b718fb3a1","Type":"ContainerDied","Data":"e97304d0bf994e07572e7baf8f2c0d43c754c3230d3b0d969110f0b59f0b21af"}
Sep 11 04:05:36.696564 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.696510    2575 scope.go:117] "RemoveContainer" containerID="4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592"
Sep 11 04:05:36.705922 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.705901    2575 scope.go:117] "RemoveContainer" containerID="4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592"
Sep 11 04:05:36.706202 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:05:36.706182    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592\": container with ID starting with 4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592 not found: ID does not exist" containerID="4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592"
Sep 11 04:05:36.706255 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.706213    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592"} err="failed to get container status \"4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592\": rpc error: code = NotFound desc = could not find container \"4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592\": container with ID starting with 4a6d07ce57619bf7b5a3c2a11976402936cf2369e6063c29791d3f5b28029592 not found: ID does not exist"
Sep 11 04:05:36.713090 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.713066    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"]
Sep 11 04:05:36.716515 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:36.716490    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8"]
Sep 11 04:05:38.632392 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:38.632358    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12dbc841-66b2-4819-b8eb-969b718fb3a1" path="/var/lib/kubelet/pods/12dbc841-66b2-4819-b8eb-969b718fb3a1/volumes"
Sep 11 04:05:43.705685 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.705653    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"]
Sep 11 04:05:43.706229 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.706206    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12dbc841-66b2-4819-b8eb-969b718fb3a1" containerName="payload-processing"
Sep 11 04:05:43.706229 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.706228    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="12dbc841-66b2-4819-b8eb-969b718fb3a1" containerName="payload-processing"
Sep 11 04:05:43.706380 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.706242    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a1bd1d8-d7d8-4890-a539-311e790cdf52" containerName="revoke-keys"
Sep 11 04:05:43.706380 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.706252    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a1bd1d8-d7d8-4890-a539-311e790cdf52" containerName="revoke-keys"
Sep 11 04:05:43.706380 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.706342    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a1bd1d8-d7d8-4890-a539-311e790cdf52" containerName="revoke-keys"
Sep 11 04:05:43.706380 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.706358    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="12dbc841-66b2-4819-b8eb-969b718fb3a1" containerName="payload-processing"
Sep 11 04:05:43.706380 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.706367    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c3f1822-c39a-44b8-949e-bfa33fe191da" containerName="istio-proxy"
Sep 11 04:05:43.711294 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.711273    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.713846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.713827    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-ce78b8-openshift-default-dockercfg-qbkh2\""
Sep 11 04:05:43.720252 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.720231    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"]
Sep 11 04:05:43.805489 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.805457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-socket\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.805676 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.805493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-credential-socket\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.805676 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.805514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-istio-token\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.805676 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.805572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gkps\" (UniqueName: \"kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-kube-api-access-7gkps\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.805676 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.805619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-envoy\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.805676 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.805637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afa9eff7-94cc-4315-8676-81965c2522b1-istiod-ca-cert\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.805887 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.805738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afa9eff7-94cc-4315-8676-81965c2522b1-istio-podinfo\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.805887 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.805779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-certs\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.805887 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.805836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-data\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.906386 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.906346    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gkps\" (UniqueName: \"kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-kube-api-access-7gkps\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.906386 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.906389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-envoy\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.906664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.906406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afa9eff7-94cc-4315-8676-81965c2522b1-istiod-ca-cert\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.906664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.906444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afa9eff7-94cc-4315-8676-81965c2522b1-istio-podinfo\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.906664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.906472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-certs\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.906664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.906510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-data\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.906664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.906577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-socket\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.906664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.906614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-credential-socket\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.906664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.906639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-istio-token\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.907004 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.906963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-data\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.907061 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.907025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-certs\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.907106 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.907072    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-socket\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.907216 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.907196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-credential-socket\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.907283 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.907265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afa9eff7-94cc-4315-8676-81965c2522b1-istiod-ca-cert\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.908838 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.908822    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-envoy\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.909378 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.909363    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afa9eff7-94cc-4315-8676-81965c2522b1-istio-podinfo\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.914865 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.914842    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-istio-token\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:43.915076 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:43.915060    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gkps\" (UniqueName: \"kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-kube-api-access-7gkps\") pod \"e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") " pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:44.023161 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:44.023126    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:44.298537 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:44.298513    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"]
Sep 11 04:05:44.300166 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:05:44.300135    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa9eff7_94cc_4315_8676_81965c2522b1.slice/crio-da787912917dedee8d99e7523553c8c6066f65dcd82af76af901f824d5fa6a07 WatchSource:0}: Error finding container da787912917dedee8d99e7523553c8c6066f65dcd82af76af901f824d5fa6a07: Status 404 returned error can't find the container with id da787912917dedee8d99e7523553c8c6066f65dcd82af76af901f824d5fa6a07
Sep 11 04:05:44.302327 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:44.302293    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:05:44.302427 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:44.302358    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:05:44.302427 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:44.302386    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:05:44.743044 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:44.743006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2" event={"ID":"afa9eff7-94cc-4315-8676-81965c2522b1","Type":"ContainerStarted","Data":"0ef90302dd457264fb9034d0aab36c1fe4ec240ce8f71aee27e7850e97180726"}
Sep 11 04:05:44.743439 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:44.743066    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2" event={"ID":"afa9eff7-94cc-4315-8676-81965c2522b1","Type":"ContainerStarted","Data":"da787912917dedee8d99e7523553c8c6066f65dcd82af76af901f824d5fa6a07"}
Sep 11 04:05:44.767620 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:44.763905    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2" podStartSLOduration=1.763884453 podStartE2EDuration="1.763884453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:05:44.760526881 +0000 UTC m=+950.638719184" watchObservedRunningTime="2026-09-11 04:05:44.763884453 +0000 UTC m=+950.642076756"
Sep 11 04:05:45.023501 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:45.023389    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:45.028626 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:45.028583    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:45.749340 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:45.749309    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:05:45.750315 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:05:45.750294    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:06:06.890071 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:06.890038    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"]
Sep 11 04:06:06.894914 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:06.894896    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:06.897567 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:06.897546    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2d69ee02\""
Sep 11 04:06:06.897673 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:06.897545    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2d69ee02-dockercfg-4g5vt\""
Sep 11 04:06:06.903127 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:06.903102    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"]
Sep 11 04:06:06.989515 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:06.989473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96e15c2f-549f-4460-92f5-3b1fd83d4107-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx\" (UID: \"96e15c2f-549f-4460-92f5-3b1fd83d4107\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:06.989848 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:06.989784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvblq\" (UniqueName: \"kubernetes.io/projected/96e15c2f-549f-4460-92f5-3b1fd83d4107-kube-api-access-bvblq\") pod \"payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx\" (UID: \"96e15c2f-549f-4460-92f5-3b1fd83d4107\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:07.091153 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:07.091118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96e15c2f-549f-4460-92f5-3b1fd83d4107-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx\" (UID: \"96e15c2f-549f-4460-92f5-3b1fd83d4107\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:07.091352 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:07.091198    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvblq\" (UniqueName: \"kubernetes.io/projected/96e15c2f-549f-4460-92f5-3b1fd83d4107-kube-api-access-bvblq\") pod \"payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx\" (UID: \"96e15c2f-549f-4460-92f5-3b1fd83d4107\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:07.091850 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:07.091830    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96e15c2f-549f-4460-92f5-3b1fd83d4107-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx\" (UID: \"96e15c2f-549f-4460-92f5-3b1fd83d4107\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:07.098978 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:07.098958    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvblq\" (UniqueName: \"kubernetes.io/projected/96e15c2f-549f-4460-92f5-3b1fd83d4107-kube-api-access-bvblq\") pod \"payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx\" (UID: \"96e15c2f-549f-4460-92f5-3b1fd83d4107\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:07.206797 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:07.206710    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:07.477130 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:07.477102    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"]
Sep 11 04:06:07.479804 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:06:07.479775    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e15c2f_549f_4460_92f5_3b1fd83d4107.slice/crio-d9016d69f2c4669e98517d03b28246e45c142bf01bbc56c280acbb5831251e28 WatchSource:0}: Error finding container d9016d69f2c4669e98517d03b28246e45c142bf01bbc56c280acbb5831251e28: Status 404 returned error can't find the container with id d9016d69f2c4669e98517d03b28246e45c142bf01bbc56c280acbb5831251e28
Sep 11 04:06:07.876170 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:07.876073    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx" event={"ID":"96e15c2f-549f-4460-92f5-3b1fd83d4107","Type":"ContainerStarted","Data":"c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588"}
Sep 11 04:06:07.876170 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:07.876130    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx" event={"ID":"96e15c2f-549f-4460-92f5-3b1fd83d4107","Type":"ContainerStarted","Data":"d9016d69f2c4669e98517d03b28246e45c142bf01bbc56c280acbb5831251e28"}
Sep 11 04:06:07.876403 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:07.876190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:07.892670 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:07.892616    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx" podStartSLOduration=1.892578857 podStartE2EDuration="1.892578857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:06:07.891139642 +0000 UTC m=+973.769331945" watchObservedRunningTime="2026-09-11 04:06:07.892578857 +0000 UTC m=+973.770771163"
Sep 11 04:06:18.883417 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:18.883329    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:20.815209 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:20.815175    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"]
Sep 11 04:06:20.815711 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:20.815382    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2" podUID="afa9eff7-94cc-4315-8676-81965c2522b1" containerName="istio-proxy" containerID="cri-o://0ef90302dd457264fb9034d0aab36c1fe4ec240ce8f71aee27e7850e97180726" gracePeriod=30
Sep 11 04:06:22.143211 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:22.143170    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"]
Sep 11 04:06:22.147011 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:22.146990    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"
Sep 11 04:06:22.149543 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:22.149524    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:06:22.154411 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:22.154386    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"]
Sep 11 04:06:22.227804 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:22.227769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78ffdeb9-931e-449a-991f-ff8701f5cee3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j\" (UID: \"78ffdeb9-931e-449a-991f-ff8701f5cee3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"
Sep 11 04:06:22.328541 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:22.328507    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78ffdeb9-931e-449a-991f-ff8701f5cee3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j\" (UID: \"78ffdeb9-931e-449a-991f-ff8701f5cee3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"
Sep 11 04:06:22.329174 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:22.329152    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78ffdeb9-931e-449a-991f-ff8701f5cee3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j\" (UID: \"78ffdeb9-931e-449a-991f-ff8701f5cee3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"
Sep 11 04:06:22.459273 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:22.459192    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"
Sep 11 04:06:22.730675 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:22.730648    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"]
Sep 11 04:06:22.731758 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:06:22.731729    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ffdeb9_931e_449a_991f_ff8701f5cee3.slice/crio-2c7338066b9b4844d939bec7556765ed6ef472b018a6bcfb130749a88c3d358d WatchSource:0}: Error finding container 2c7338066b9b4844d939bec7556765ed6ef472b018a6bcfb130749a88c3d358d: Status 404 returned error can't find the container with id 2c7338066b9b4844d939bec7556765ed6ef472b018a6bcfb130749a88c3d358d
Sep 11 04:06:22.962095 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:22.962065    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j" event={"ID":"78ffdeb9-931e-449a-991f-ff8701f5cee3","Type":"ContainerStarted","Data":"2c7338066b9b4844d939bec7556765ed6ef472b018a6bcfb130749a88c3d358d"}
Sep 11 04:06:23.968674 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:23.968642    2575 generic.go:356] "Generic (PLEG): container finished" podID="78ffdeb9-931e-449a-991f-ff8701f5cee3" containerID="a488dac4ecabc3cea7139af257328c46027706a77b4c4f4e6759d6e12c336696" exitCode=0
Sep 11 04:06:23.969116 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:23.968710    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j" event={"ID":"78ffdeb9-931e-449a-991f-ff8701f5cee3","Type":"ContainerDied","Data":"a488dac4ecabc3cea7139af257328c46027706a77b4c4f4e6759d6e12c336696"}
Sep 11 04:06:25.111893 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:25.111865    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"
Sep 11 04:06:25.257269 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:25.257165    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78ffdeb9-931e-449a-991f-ff8701f5cee3-maas-api-service-ca\") pod \"78ffdeb9-931e-449a-991f-ff8701f5cee3\" (UID: \"78ffdeb9-931e-449a-991f-ff8701f5cee3\") "
Sep 11 04:06:25.257592 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:25.257567    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78ffdeb9-931e-449a-991f-ff8701f5cee3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78ffdeb9-931e-449a-991f-ff8701f5cee3" (UID: "78ffdeb9-931e-449a-991f-ff8701f5cee3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:06:25.358017 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:25.357981    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78ffdeb9-931e-449a-991f-ff8701f5cee3-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:25.981693 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:25.981663    2575 generic.go:356] "Generic (PLEG): container finished" podID="afa9eff7-94cc-4315-8676-81965c2522b1" containerID="0ef90302dd457264fb9034d0aab36c1fe4ec240ce8f71aee27e7850e97180726" exitCode=0
Sep 11 04:06:25.981866 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:25.981741    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2" event={"ID":"afa9eff7-94cc-4315-8676-81965c2522b1","Type":"ContainerDied","Data":"0ef90302dd457264fb9034d0aab36c1fe4ec240ce8f71aee27e7850e97180726"}
Sep 11 04:06:25.983156 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:25.983133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j" event={"ID":"78ffdeb9-931e-449a-991f-ff8701f5cee3","Type":"ContainerDied","Data":"2c7338066b9b4844d939bec7556765ed6ef472b018a6bcfb130749a88c3d358d"}
Sep 11 04:06:25.983281 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:25.983172    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c7338066b9b4844d939bec7556765ed6ef472b018a6bcfb130749a88c3d358d"
Sep 11 04:06:25.983281 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:25.983172    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"
Sep 11 04:06:26.066100 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.066080    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:06:26.164382 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164302    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gkps\" (UniqueName: \"kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-kube-api-access-7gkps\") pod \"afa9eff7-94cc-4315-8676-81965c2522b1\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") "
Sep 11 04:06:26.164382 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164358    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afa9eff7-94cc-4315-8676-81965c2522b1-istiod-ca-cert\") pod \"afa9eff7-94cc-4315-8676-81965c2522b1\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") "
Sep 11 04:06:26.164894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164415    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-envoy\") pod \"afa9eff7-94cc-4315-8676-81965c2522b1\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") "
Sep 11 04:06:26.164894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164433    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-certs\") pod \"afa9eff7-94cc-4315-8676-81965c2522b1\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") "
Sep 11 04:06:26.164894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164451    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-istio-token\") pod \"afa9eff7-94cc-4315-8676-81965c2522b1\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") "
Sep 11 04:06:26.164894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164475    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-credential-socket\") pod \"afa9eff7-94cc-4315-8676-81965c2522b1\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") "
Sep 11 04:06:26.164894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164515    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-data\") pod \"afa9eff7-94cc-4315-8676-81965c2522b1\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") "
Sep 11 04:06:26.164894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164545    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-socket\") pod \"afa9eff7-94cc-4315-8676-81965c2522b1\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") "
Sep 11 04:06:26.164894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164569    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afa9eff7-94cc-4315-8676-81965c2522b1-istio-podinfo\") pod \"afa9eff7-94cc-4315-8676-81965c2522b1\" (UID: \"afa9eff7-94cc-4315-8676-81965c2522b1\") "
Sep 11 04:06:26.164894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164773    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "afa9eff7-94cc-4315-8676-81965c2522b1" (UID: "afa9eff7-94cc-4315-8676-81965c2522b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:06:26.165307 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164927    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "afa9eff7-94cc-4315-8676-81965c2522b1" (UID: "afa9eff7-94cc-4315-8676-81965c2522b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:06:26.165307 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164941    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "afa9eff7-94cc-4315-8676-81965c2522b1" (UID: "afa9eff7-94cc-4315-8676-81965c2522b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:06:26.165307 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.164955    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:26.165307 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.165135    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "afa9eff7-94cc-4315-8676-81965c2522b1" (UID: "afa9eff7-94cc-4315-8676-81965c2522b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:06:26.165455 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.165347    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa9eff7-94cc-4315-8676-81965c2522b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "afa9eff7-94cc-4315-8676-81965c2522b1" (UID: "afa9eff7-94cc-4315-8676-81965c2522b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:06:26.166775 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.166753    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "afa9eff7-94cc-4315-8676-81965c2522b1" (UID: "afa9eff7-94cc-4315-8676-81965c2522b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:06:26.166880 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.166785    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "afa9eff7-94cc-4315-8676-81965c2522b1" (UID: "afa9eff7-94cc-4315-8676-81965c2522b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:06:26.167208 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.167189    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/afa9eff7-94cc-4315-8676-81965c2522b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "afa9eff7-94cc-4315-8676-81965c2522b1" (UID: "afa9eff7-94cc-4315-8676-81965c2522b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:06:26.167266 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.167207    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-kube-api-access-7gkps" (OuterVolumeSpecName: "kube-api-access-7gkps") pod "afa9eff7-94cc-4315-8676-81965c2522b1" (UID: "afa9eff7-94cc-4315-8676-81965c2522b1"). InnerVolumeSpecName "kube-api-access-7gkps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:06:26.265768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.265737    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gkps\" (UniqueName: \"kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-kube-api-access-7gkps\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:26.265768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.265764    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afa9eff7-94cc-4315-8676-81965c2522b1-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:26.265768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.265773    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:26.265985 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.265782    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afa9eff7-94cc-4315-8676-81965c2522b1-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:26.265985 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.265791    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:26.265985 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.265798    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:26.265985 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.265807    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afa9eff7-94cc-4315-8676-81965c2522b1-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:26.265985 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.265814    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afa9eff7-94cc-4315-8676-81965c2522b1-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:26.990022 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.989985    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"
Sep 11 04:06:26.990022 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.990003    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2" event={"ID":"afa9eff7-94cc-4315-8676-81965c2522b1","Type":"ContainerDied","Data":"da787912917dedee8d99e7523553c8c6066f65dcd82af76af901f824d5fa6a07"}
Sep 11 04:06:26.990261 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:26.990062    2575 scope.go:117] "RemoveContainer" containerID="0ef90302dd457264fb9034d0aab36c1fe4ec240ce8f71aee27e7850e97180726"
Sep 11 04:06:27.027972 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:27.027945    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"]
Sep 11 04:06:27.032464 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:27.032442    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2"]
Sep 11 04:06:28.633115 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:28.633079    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afa9eff7-94cc-4315-8676-81965c2522b1" path="/var/lib/kubelet/pods/afa9eff7-94cc-4315-8676-81965c2522b1/volumes"
Sep 11 04:06:32.998844 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:32.998808    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"]
Sep 11 04:06:32.999212 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:32.999058    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s" podUID="7d09018e-3e72-4d00-a904-2a2341d22bf7" containerName="payload-processing" containerID="cri-o://d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f" gracePeriod=30
Sep 11 04:06:33.175910 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:33.175881    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"]
Sep 11 04:06:33.178547 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:33.178518    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-00a938-9bv7j"]
Sep 11 04:06:33.262690 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:33.262637    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:06:33.434015 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:33.433981    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d09018e-3e72-4d00-a904-2a2341d22bf7-plugins-config-volume\") pod \"7d09018e-3e72-4d00-a904-2a2341d22bf7\" (UID: \"7d09018e-3e72-4d00-a904-2a2341d22bf7\") "
Sep 11 04:06:33.434190 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:33.434022    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkdjj\" (UniqueName: \"kubernetes.io/projected/7d09018e-3e72-4d00-a904-2a2341d22bf7-kube-api-access-wkdjj\") pod \"7d09018e-3e72-4d00-a904-2a2341d22bf7\" (UID: \"7d09018e-3e72-4d00-a904-2a2341d22bf7\") "
Sep 11 04:06:33.434363 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:33.434339    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d09018e-3e72-4d00-a904-2a2341d22bf7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d09018e-3e72-4d00-a904-2a2341d22bf7" (UID: "7d09018e-3e72-4d00-a904-2a2341d22bf7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:06:33.436236 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:33.436212    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d09018e-3e72-4d00-a904-2a2341d22bf7-kube-api-access-wkdjj" (OuterVolumeSpecName: "kube-api-access-wkdjj") pod "7d09018e-3e72-4d00-a904-2a2341d22bf7" (UID: "7d09018e-3e72-4d00-a904-2a2341d22bf7"). InnerVolumeSpecName "kube-api-access-wkdjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:06:33.535690 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:33.535626    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d09018e-3e72-4d00-a904-2a2341d22bf7-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:33.535690 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:33.535650    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkdjj\" (UniqueName: \"kubernetes.io/projected/7d09018e-3e72-4d00-a904-2a2341d22bf7-kube-api-access-wkdjj\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:34.037286 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.037246    2575 generic.go:356] "Generic (PLEG): container finished" podID="7d09018e-3e72-4d00-a904-2a2341d22bf7" containerID="d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f" exitCode=0
Sep 11 04:06:34.037286 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.037285    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"
Sep 11 04:06:34.037806 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.037333    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s" event={"ID":"7d09018e-3e72-4d00-a904-2a2341d22bf7","Type":"ContainerDied","Data":"d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f"}
Sep 11 04:06:34.037806 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.037374    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s" event={"ID":"7d09018e-3e72-4d00-a904-2a2341d22bf7","Type":"ContainerDied","Data":"000b1e230eccac914ba37df0d842819c7ec37f9dff46400e343e82ea47c21a3f"}
Sep 11 04:06:34.037806 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.037394    2575 scope.go:117] "RemoveContainer" containerID="d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f"
Sep 11 04:06:34.046702 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.046683    2575 scope.go:117] "RemoveContainer" containerID="d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f"
Sep 11 04:06:34.047000 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:06:34.046980    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f\": container with ID starting with d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f not found: ID does not exist" containerID="d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f"
Sep 11 04:06:34.047089 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.047006    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f"} err="failed to get container status \"d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f\": rpc error: code = NotFound desc = could not find container \"d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f\": container with ID starting with d2849f9c1ac72664db88f583f8d33d5bb742d15d68e9d7d0ad73ca3a38015a8f not found: ID does not exist"
Sep 11 04:06:34.059151 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.059128    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"]
Sep 11 04:06:34.063018 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.062996    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s"]
Sep 11 04:06:34.205992 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.205950    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s" podUID="7d09018e-3e72-4d00-a904-2a2341d22bf7" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.44:9004: i/o timeout"
Sep 11 04:06:34.632860 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.632833    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78ffdeb9-931e-449a-991f-ff8701f5cee3" path="/var/lib/kubelet/pods/78ffdeb9-931e-449a-991f-ff8701f5cee3/volumes"
Sep 11 04:06:34.633179 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:34.633167    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d09018e-3e72-4d00-a904-2a2341d22bf7" path="/var/lib/kubelet/pods/7d09018e-3e72-4d00-a904-2a2341d22bf7/volumes"
Sep 11 04:06:36.937174 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.937142    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"]
Sep 11 04:06:36.937568 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.937495    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d09018e-3e72-4d00-a904-2a2341d22bf7" containerName="payload-processing"
Sep 11 04:06:36.937568 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.937509    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d09018e-3e72-4d00-a904-2a2341d22bf7" containerName="payload-processing"
Sep 11 04:06:36.937568 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.937536    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78ffdeb9-931e-449a-991f-ff8701f5cee3" containerName="revoke-keys"
Sep 11 04:06:36.937568 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.937544    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="78ffdeb9-931e-449a-991f-ff8701f5cee3" containerName="revoke-keys"
Sep 11 04:06:36.937568 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.937562    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa9eff7-94cc-4315-8676-81965c2522b1" containerName="istio-proxy"
Sep 11 04:06:36.937568 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.937572    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa9eff7-94cc-4315-8676-81965c2522b1" containerName="istio-proxy"
Sep 11 04:06:36.937897 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.937666    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d09018e-3e72-4d00-a904-2a2341d22bf7" containerName="payload-processing"
Sep 11 04:06:36.937897 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.937675    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="78ffdeb9-931e-449a-991f-ff8701f5cee3" containerName="revoke-keys"
Sep 11 04:06:36.937897 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.937683    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa9eff7-94cc-4315-8676-81965c2522b1" containerName="istio-proxy"
Sep 11 04:06:36.942187 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.942155    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"
Sep 11 04:06:36.945459 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.945439    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:06:36.948683 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:36.948654    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"]
Sep 11 04:06:37.067909 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:37.067881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05e8cc41-a389-443b-b3fe-b27d01d913cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6\" (UID: \"05e8cc41-a389-443b-b3fe-b27d01d913cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"
Sep 11 04:06:37.168877 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:37.168840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05e8cc41-a389-443b-b3fe-b27d01d913cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6\" (UID: \"05e8cc41-a389-443b-b3fe-b27d01d913cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"
Sep 11 04:06:37.169484 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:37.169457    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05e8cc41-a389-443b-b3fe-b27d01d913cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6\" (UID: \"05e8cc41-a389-443b-b3fe-b27d01d913cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"
Sep 11 04:06:37.257656 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:37.257626    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"
Sep 11 04:06:37.538093 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:37.538066    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"]
Sep 11 04:06:37.540274 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:06:37.540245    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e8cc41_a389_443b_b3fe_b27d01d913cc.slice/crio-8ddb74eb6e7e2cc64467cddb3292583c354eccd69d345ec16d30099b1c5a644d WatchSource:0}: Error finding container 8ddb74eb6e7e2cc64467cddb3292583c354eccd69d345ec16d30099b1c5a644d: Status 404 returned error can't find the container with id 8ddb74eb6e7e2cc64467cddb3292583c354eccd69d345ec16d30099b1c5a644d
Sep 11 04:06:38.063728 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:38.063637    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6" event={"ID":"05e8cc41-a389-443b-b3fe-b27d01d913cc","Type":"ContainerStarted","Data":"e873de78d7cb6ac3e656f5e4230671ce6c1f85a9f2e7dd040a9511a2937ff65b"}
Sep 11 04:06:38.063728 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:38.063700    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6" event={"ID":"05e8cc41-a389-443b-b3fe-b27d01d913cc","Type":"ContainerStarted","Data":"8ddb74eb6e7e2cc64467cddb3292583c354eccd69d345ec16d30099b1c5a644d"}
Sep 11 04:06:38.080925 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:38.080877    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6" podStartSLOduration=2.08086098 podStartE2EDuration="2.08086098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:06:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:06:38.079773886 +0000 UTC m=+1003.957966189" watchObservedRunningTime="2026-09-11 04:06:38.08086098 +0000 UTC m=+1003.959053281"
Sep 11 04:06:39.071137 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:39.071108    2575 generic.go:356] "Generic (PLEG): container finished" podID="05e8cc41-a389-443b-b3fe-b27d01d913cc" containerID="e873de78d7cb6ac3e656f5e4230671ce6c1f85a9f2e7dd040a9511a2937ff65b" exitCode=0
Sep 11 04:06:39.071536 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:39.071199    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6" event={"ID":"05e8cc41-a389-443b-b3fe-b27d01d913cc","Type":"ContainerDied","Data":"e873de78d7cb6ac3e656f5e4230671ce6c1f85a9f2e7dd040a9511a2937ff65b"}
Sep 11 04:06:39.719092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:39.719057    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"]
Sep 11 04:06:39.719349 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:39.719322    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy" containerID="cri-o://3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4" gracePeriod=30
Sep 11 04:06:40.051807 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.051723    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"]
Sep 11 04:06:40.055497 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.055480    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"
Sep 11 04:06:40.062526 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.062400    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"]
Sep 11 04:06:40.197080 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.197051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e732bc55-c3b0-4918-aa18-045c315d7286-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c\" (UID: \"e732bc55-c3b0-4918-aa18-045c315d7286\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"
Sep 11 04:06:40.215735 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.215705    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"
Sep 11 04:06:40.297900 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.297868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e732bc55-c3b0-4918-aa18-045c315d7286-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c\" (UID: \"e732bc55-c3b0-4918-aa18-045c315d7286\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"
Sep 11 04:06:40.298484 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.298463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e732bc55-c3b0-4918-aa18-045c315d7286-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c\" (UID: \"e732bc55-c3b0-4918-aa18-045c315d7286\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"
Sep 11 04:06:40.367497 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.367403    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"
Sep 11 04:06:40.398638 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.398591    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05e8cc41-a389-443b-b3fe-b27d01d913cc-maas-api-service-ca\") pod \"05e8cc41-a389-443b-b3fe-b27d01d913cc\" (UID: \"05e8cc41-a389-443b-b3fe-b27d01d913cc\") "
Sep 11 04:06:40.398946 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.398919    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e8cc41-a389-443b-b3fe-b27d01d913cc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "05e8cc41-a389-443b-b3fe-b27d01d913cc" (UID: "05e8cc41-a389-443b-b3fe-b27d01d913cc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:06:40.499908 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.499874    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05e8cc41-a389-443b-b3fe-b27d01d913cc-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:40.638041 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:06:40.638014    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode732bc55_c3b0_4918_aa18_045c315d7286.slice/crio-3006050fd758cd2e9ccc9f32a78324286756fdd1745c6c48fb6898278a02463c WatchSource:0}: Error finding container 3006050fd758cd2e9ccc9f32a78324286756fdd1745c6c48fb6898278a02463c: Status 404 returned error can't find the container with id 3006050fd758cd2e9ccc9f32a78324286756fdd1745c6c48fb6898278a02463c
Sep 11 04:06:40.638172 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:40.638054    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"]
Sep 11 04:06:41.083775 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:41.083740    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c" event={"ID":"e732bc55-c3b0-4918-aa18-045c315d7286","Type":"ContainerStarted","Data":"eef9e01d4f98d183463fb1926735eb50c0889a12134fd63ff0e0321400d50189"}
Sep 11 04:06:41.083972 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:41.083791    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c" event={"ID":"e732bc55-c3b0-4918-aa18-045c315d7286","Type":"ContainerStarted","Data":"3006050fd758cd2e9ccc9f32a78324286756fdd1745c6c48fb6898278a02463c"}
Sep 11 04:06:41.085105 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:41.085081    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6" event={"ID":"05e8cc41-a389-443b-b3fe-b27d01d913cc","Type":"ContainerDied","Data":"8ddb74eb6e7e2cc64467cddb3292583c354eccd69d345ec16d30099b1c5a644d"}
Sep 11 04:06:41.085199 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:41.085120    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ddb74eb6e7e2cc64467cddb3292583c354eccd69d345ec16d30099b1c5a644d"
Sep 11 04:06:41.085199 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:41.085088    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"
Sep 11 04:06:41.098346 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:41.098307    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c" podStartSLOduration=1.098294054 podStartE2EDuration="1.098294054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:06:41.097385733 +0000 UTC m=+1006.975578063" watchObservedRunningTime="2026-09-11 04:06:41.098294054 +0000 UTC m=+1006.976486396"
Sep 11 04:06:42.092430 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:42.092396    2575 generic.go:356] "Generic (PLEG): container finished" podID="e732bc55-c3b0-4918-aa18-045c315d7286" containerID="eef9e01d4f98d183463fb1926735eb50c0889a12134fd63ff0e0321400d50189" exitCode=0
Sep 11 04:06:42.092869 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:42.092463    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c" event={"ID":"e732bc55-c3b0-4918-aa18-045c315d7286","Type":"ContainerDied","Data":"eef9e01d4f98d183463fb1926735eb50c0889a12134fd63ff0e0321400d50189"}
Sep 11 04:06:42.241064 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:42.241026    2575 patch_prober.go:28] interesting pod/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:06:42.241216 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:42.241086    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:06:43.237471 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:43.237448    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"
Sep 11 04:06:43.326922 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:43.326890    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e732bc55-c3b0-4918-aa18-045c315d7286-maas-api-service-ca\") pod \"e732bc55-c3b0-4918-aa18-045c315d7286\" (UID: \"e732bc55-c3b0-4918-aa18-045c315d7286\") "
Sep 11 04:06:43.327232 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:43.327209    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e732bc55-c3b0-4918-aa18-045c315d7286-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e732bc55-c3b0-4918-aa18-045c315d7286" (UID: "e732bc55-c3b0-4918-aa18-045c315d7286"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:06:43.428004 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:43.427938    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e732bc55-c3b0-4918-aa18-045c315d7286-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:44.104208 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:44.104170    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c" event={"ID":"e732bc55-c3b0-4918-aa18-045c315d7286","Type":"ContainerDied","Data":"3006050fd758cd2e9ccc9f32a78324286756fdd1745c6c48fb6898278a02463c"}
Sep 11 04:06:44.104208 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:44.104207    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"
Sep 11 04:06:44.104408 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:44.104228    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3006050fd758cd2e9ccc9f32a78324286756fdd1745c6c48fb6898278a02463c"
Sep 11 04:06:44.980354 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:44.980333    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:06:45.043471 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043392    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd6c7967-b078-41d5-830f-a66e88e62116-istiod-ca-cert\") pod \"fd6c7967-b078-41d5-830f-a66e88e62116\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") "
Sep 11 04:06:45.043471 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043442    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-envoy\") pod \"fd6c7967-b078-41d5-830f-a66e88e62116\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") "
Sep 11 04:06:45.043694 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043485    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-credential-socket\") pod \"fd6c7967-b078-41d5-830f-a66e88e62116\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") "
Sep 11 04:06:45.043694 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043508    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-data\") pod \"fd6c7967-b078-41d5-830f-a66e88e62116\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") "
Sep 11 04:06:45.043694 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043552    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-istio-token\") pod \"fd6c7967-b078-41d5-830f-a66e88e62116\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") "
Sep 11 04:06:45.043694 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043593    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd6c7967-b078-41d5-830f-a66e88e62116-istio-podinfo\") pod \"fd6c7967-b078-41d5-830f-a66e88e62116\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") "
Sep 11 04:06:45.043694 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043646    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-socket\") pod \"fd6c7967-b078-41d5-830f-a66e88e62116\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") "
Sep 11 04:06:45.043694 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043670    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rj52\" (UniqueName: \"kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-kube-api-access-5rj52\") pod \"fd6c7967-b078-41d5-830f-a66e88e62116\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") "
Sep 11 04:06:45.043694 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043692    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-certs\") pod \"fd6c7967-b078-41d5-830f-a66e88e62116\" (UID: \"fd6c7967-b078-41d5-830f-a66e88e62116\") "
Sep 11 04:06:45.044049 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043835    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd6c7967-b078-41d5-830f-a66e88e62116" (UID: "fd6c7967-b078-41d5-830f-a66e88e62116"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:06:45.044049 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043863    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd6c7967-b078-41d5-830f-a66e88e62116" (UID: "fd6c7967-b078-41d5-830f-a66e88e62116"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:06:45.044049 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.043928    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd6c7967-b078-41d5-830f-a66e88e62116" (UID: "fd6c7967-b078-41d5-830f-a66e88e62116"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:06:45.044049 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.044047    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:45.044274 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.044078    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:45.044274 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.044094    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:45.044274 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.044045    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd6c7967-b078-41d5-830f-a66e88e62116" (UID: "fd6c7967-b078-41d5-830f-a66e88e62116"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:06:45.044274 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.044121    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd6c7967-b078-41d5-830f-a66e88e62116-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd6c7967-b078-41d5-830f-a66e88e62116" (UID: "fd6c7967-b078-41d5-830f-a66e88e62116"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:06:45.045972 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.045934    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd6c7967-b078-41d5-830f-a66e88e62116" (UID: "fd6c7967-b078-41d5-830f-a66e88e62116"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:06:45.046086 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.045976    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd6c7967-b078-41d5-830f-a66e88e62116" (UID: "fd6c7967-b078-41d5-830f-a66e88e62116"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:06:45.046086 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.046011    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-kube-api-access-5rj52" (OuterVolumeSpecName: "kube-api-access-5rj52") pod "fd6c7967-b078-41d5-830f-a66e88e62116" (UID: "fd6c7967-b078-41d5-830f-a66e88e62116"). InnerVolumeSpecName "kube-api-access-5rj52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:06:45.046086 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.046017    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd6c7967-b078-41d5-830f-a66e88e62116-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd6c7967-b078-41d5-830f-a66e88e62116" (UID: "fd6c7967-b078-41d5-830f-a66e88e62116"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:06:45.111893 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.111867    2575 generic.go:356] "Generic (PLEG): container finished" podID="fd6c7967-b078-41d5-830f-a66e88e62116" containerID="3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4" exitCode=0
Sep 11 04:06:45.112023 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.111911    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"
Sep 11 04:06:45.112023 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.111947    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" event={"ID":"fd6c7967-b078-41d5-830f-a66e88e62116","Type":"ContainerDied","Data":"3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4"}
Sep 11 04:06:45.112023 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.112009    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht" event={"ID":"fd6c7967-b078-41d5-830f-a66e88e62116","Type":"ContainerDied","Data":"373f541fb29f1be39468863f5223ed1462e69d74d0c6207eee6bf80aed1fa5ec"}
Sep 11 04:06:45.112207 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.112039    2575 scope.go:117] "RemoveContainer" containerID="3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4"
Sep 11 04:06:45.121861 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.121846    2575 scope.go:117] "RemoveContainer" containerID="0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb"
Sep 11 04:06:45.130665 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.130373    2575 scope.go:117] "RemoveContainer" containerID="3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4"
Sep 11 04:06:45.130806 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:06:45.130771    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4\": container with ID starting with 3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4 not found: ID does not exist" containerID="3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4"
Sep 11 04:06:45.130909 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.130807    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4"} err="failed to get container status \"3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4\": rpc error: code = NotFound desc = could not find container \"3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4\": container with ID starting with 3413d795b42631a0edc4efeabb49652d9db9d5616a04be2e6cf6c842c455bcf4 not found: ID does not exist"
Sep 11 04:06:45.130909 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.130831    2575 scope.go:117] "RemoveContainer" containerID="0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb"
Sep 11 04:06:45.131163 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:06:45.131140    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb\": container with ID starting with 0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb not found: ID does not exist" containerID="0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb"
Sep 11 04:06:45.131212 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.131174    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb"} err="failed to get container status \"0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb\": rpc error: code = NotFound desc = could not find container \"0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb\": container with ID starting with 0a333d2ad3e6388023897fa0cd13dec53c1cb31498e670539ea1ee398df322cb not found: ID does not exist"
Sep 11 04:06:45.133569 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.133550    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"]
Sep 11 04:06:45.137170 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.137148    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht"]
Sep 11 04:06:45.144727 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.144713    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd6c7967-b078-41d5-830f-a66e88e62116-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:45.144787 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.144729    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:45.144787 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.144737    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:45.144787 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.144745    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd6c7967-b078-41d5-830f-a66e88e62116-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:45.144787 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.144753    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rj52\" (UniqueName: \"kubernetes.io/projected/fd6c7967-b078-41d5-830f-a66e88e62116-kube-api-access-5rj52\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:45.144787 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:45.144761    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd6c7967-b078-41d5-830f-a66e88e62116-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:46.638493 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:46.633359    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" path="/var/lib/kubelet/pods/fd6c7967-b078-41d5-830f-a66e88e62116/volumes"
Sep 11 04:06:47.676639 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:47.676575    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"]
Sep 11 04:06:47.677523 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:47.677410    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx" podUID="96e15c2f-549f-4460-92f5-3b1fd83d4107" containerName="payload-pre-processing" containerID="cri-o://c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588" gracePeriod=30
Sep 11 04:06:47.827909 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:47.827874    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"]
Sep 11 04:06:47.830170 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:47.830145    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2d69ee02-sdhk6"]
Sep 11 04:06:47.931577 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:47.931520    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:47.971132 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:47.971107    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96e15c2f-549f-4460-92f5-3b1fd83d4107-plugins-config-volume\") pod \"96e15c2f-549f-4460-92f5-3b1fd83d4107\" (UID: \"96e15c2f-549f-4460-92f5-3b1fd83d4107\") "
Sep 11 04:06:47.971291 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:47.971142    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvblq\" (UniqueName: \"kubernetes.io/projected/96e15c2f-549f-4460-92f5-3b1fd83d4107-kube-api-access-bvblq\") pod \"96e15c2f-549f-4460-92f5-3b1fd83d4107\" (UID: \"96e15c2f-549f-4460-92f5-3b1fd83d4107\") "
Sep 11 04:06:47.971469 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:47.971446    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e15c2f-549f-4460-92f5-3b1fd83d4107-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96e15c2f-549f-4460-92f5-3b1fd83d4107" (UID: "96e15c2f-549f-4460-92f5-3b1fd83d4107"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:06:47.973404 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:47.973386    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e15c2f-549f-4460-92f5-3b1fd83d4107-kube-api-access-bvblq" (OuterVolumeSpecName: "kube-api-access-bvblq") pod "96e15c2f-549f-4460-92f5-3b1fd83d4107" (UID: "96e15c2f-549f-4460-92f5-3b1fd83d4107"). InnerVolumeSpecName "kube-api-access-bvblq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:06:48.072632 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.072569    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96e15c2f-549f-4460-92f5-3b1fd83d4107-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:48.072632 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.072630    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvblq\" (UniqueName: \"kubernetes.io/projected/96e15c2f-549f-4460-92f5-3b1fd83d4107-kube-api-access-bvblq\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:48.131483 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.131446    2575 generic.go:356] "Generic (PLEG): container finished" podID="96e15c2f-549f-4460-92f5-3b1fd83d4107" containerID="c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588" exitCode=0
Sep 11 04:06:48.131664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.131490    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"
Sep 11 04:06:48.131664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.131510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx" event={"ID":"96e15c2f-549f-4460-92f5-3b1fd83d4107","Type":"ContainerDied","Data":"c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588"}
Sep 11 04:06:48.131664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.131559    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx" event={"ID":"96e15c2f-549f-4460-92f5-3b1fd83d4107","Type":"ContainerDied","Data":"d9016d69f2c4669e98517d03b28246e45c142bf01bbc56c280acbb5831251e28"}
Sep 11 04:06:48.131664 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.131589    2575 scope.go:117] "RemoveContainer" containerID="c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588"
Sep 11 04:06:48.141651 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.141629    2575 scope.go:117] "RemoveContainer" containerID="c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588"
Sep 11 04:06:48.141902 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:06:48.141881    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588\": container with ID starting with c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588 not found: ID does not exist" containerID="c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588"
Sep 11 04:06:48.141951 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.141910    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588"} err="failed to get container status \"c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588\": rpc error: code = NotFound desc = could not find container \"c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588\": container with ID starting with c8c273f3995ee42f372c3d554dd38e01bd3743bd4d92fa7187c5768b2a822588 not found: ID does not exist"
Sep 11 04:06:48.153443 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.153422    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"]
Sep 11 04:06:48.156731 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.156709    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx"]
Sep 11 04:06:48.632801 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.632772    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e8cc41-a389-443b-b3fe-b27d01d913cc" path="/var/lib/kubelet/pods/05e8cc41-a389-443b-b3fe-b27d01d913cc/volumes"
Sep 11 04:06:48.633124 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:48.633111    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96e15c2f-549f-4460-92f5-3b1fd83d4107" path="/var/lib/kubelet/pods/96e15c2f-549f-4460-92f5-3b1fd83d4107/volumes"
Sep 11 04:06:50.809654 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:50.809617    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"]
Sep 11 04:06:50.810140 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:50.809886    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj" podUID="c676822a-9023-40b9-b350-0208d7af292d" containerName="payload-processing" containerID="cri-o://481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e" gracePeriod=30
Sep 11 04:06:50.816179 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:50.816154    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"]
Sep 11 04:06:50.816577 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:50.816547    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f" podUID="0434b22f-8e51-4721-ae3f-f29f687b832d" containerName="payload-pre-processing" containerID="cri-o://4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461" gracePeriod=30
Sep 11 04:06:50.964361 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:50.964320    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"]
Sep 11 04:06:50.967436 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:50.967397    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5d685d-sv75c"]
Sep 11 04:06:51.111410 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.111387    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:06:51.114445 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.114423    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:06:51.153191 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.153165    2575 generic.go:356] "Generic (PLEG): container finished" podID="0434b22f-8e51-4721-ae3f-f29f687b832d" containerID="4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461" exitCode=0
Sep 11 04:06:51.153347 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.153213    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"
Sep 11 04:06:51.153347 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.153252    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f" event={"ID":"0434b22f-8e51-4721-ae3f-f29f687b832d","Type":"ContainerDied","Data":"4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461"}
Sep 11 04:06:51.153455 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.153355    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f" event={"ID":"0434b22f-8e51-4721-ae3f-f29f687b832d","Type":"ContainerDied","Data":"eb703ce75acf5a675a6624c661e09b3c05ad2a4b4e0da75b8c08772b1601edd7"}
Sep 11 04:06:51.153455 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.153388    2575 scope.go:117] "RemoveContainer" containerID="4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461"
Sep 11 04:06:51.154777 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.154754    2575 generic.go:356] "Generic (PLEG): container finished" podID="c676822a-9023-40b9-b350-0208d7af292d" containerID="481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e" exitCode=0
Sep 11 04:06:51.154896 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.154788    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj" event={"ID":"c676822a-9023-40b9-b350-0208d7af292d","Type":"ContainerDied","Data":"481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e"}
Sep 11 04:06:51.154896 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.154800    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"
Sep 11 04:06:51.154896 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.154856    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj" event={"ID":"c676822a-9023-40b9-b350-0208d7af292d","Type":"ContainerDied","Data":"b2903c6f890997a675f7990ab7996387699360070e1c91ab093ee85128ca30ea"}
Sep 11 04:06:51.166329 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.166308    2575 scope.go:117] "RemoveContainer" containerID="4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461"
Sep 11 04:06:51.166669 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:06:51.166648    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461\": container with ID starting with 4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461 not found: ID does not exist" containerID="4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461"
Sep 11 04:06:51.166767 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.166677    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461"} err="failed to get container status \"4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461\": rpc error: code = NotFound desc = could not find container \"4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461\": container with ID starting with 4ccd45b0e1e7ff4c9855312c06f22f887395104f109373fe8cb15cc39dae7461 not found: ID does not exist"
Sep 11 04:06:51.166767 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.166695    2575 scope.go:117] "RemoveContainer" containerID="481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e"
Sep 11 04:06:51.176829 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.176805    2575 scope.go:117] "RemoveContainer" containerID="481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e"
Sep 11 04:06:51.177128 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:06:51.177111    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e\": container with ID starting with 481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e not found: ID does not exist" containerID="481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e"
Sep 11 04:06:51.177195 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.177138    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e"} err="failed to get container status \"481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e\": rpc error: code = NotFound desc = could not find container \"481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e\": container with ID starting with 481b448b7127b8d171bcaa58a5734edddab946c0c980ea1b193209af8ae7060e not found: ID does not exist"
Sep 11 04:06:51.197560 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.197539    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c676822a-9023-40b9-b350-0208d7af292d-plugins-config-volume\") pod \"c676822a-9023-40b9-b350-0208d7af292d\" (UID: \"c676822a-9023-40b9-b350-0208d7af292d\") "
Sep 11 04:06:51.197697 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.197570    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vgwl\" (UniqueName: \"kubernetes.io/projected/c676822a-9023-40b9-b350-0208d7af292d-kube-api-access-6vgwl\") pod \"c676822a-9023-40b9-b350-0208d7af292d\" (UID: \"c676822a-9023-40b9-b350-0208d7af292d\") "
Sep 11 04:06:51.197697 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.197585    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph844\" (UniqueName: \"kubernetes.io/projected/0434b22f-8e51-4721-ae3f-f29f687b832d-kube-api-access-ph844\") pod \"0434b22f-8e51-4721-ae3f-f29f687b832d\" (UID: \"0434b22f-8e51-4721-ae3f-f29f687b832d\") "
Sep 11 04:06:51.197697 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.197657    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0434b22f-8e51-4721-ae3f-f29f687b832d-plugins-config-volume\") pod \"0434b22f-8e51-4721-ae3f-f29f687b832d\" (UID: \"0434b22f-8e51-4721-ae3f-f29f687b832d\") "
Sep 11 04:06:51.200243 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.198220    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0434b22f-8e51-4721-ae3f-f29f687b832d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0434b22f-8e51-4721-ae3f-f29f687b832d" (UID: "0434b22f-8e51-4721-ae3f-f29f687b832d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:06:51.200243 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.198263    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c676822a-9023-40b9-b350-0208d7af292d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c676822a-9023-40b9-b350-0208d7af292d" (UID: "c676822a-9023-40b9-b350-0208d7af292d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:06:51.203629 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.200878    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0434b22f-8e51-4721-ae3f-f29f687b832d-kube-api-access-ph844" (OuterVolumeSpecName: "kube-api-access-ph844") pod "0434b22f-8e51-4721-ae3f-f29f687b832d" (UID: "0434b22f-8e51-4721-ae3f-f29f687b832d"). InnerVolumeSpecName "kube-api-access-ph844". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:06:51.205894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.205872    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c676822a-9023-40b9-b350-0208d7af292d-kube-api-access-6vgwl" (OuterVolumeSpecName: "kube-api-access-6vgwl") pod "c676822a-9023-40b9-b350-0208d7af292d" (UID: "c676822a-9023-40b9-b350-0208d7af292d"). InnerVolumeSpecName "kube-api-access-6vgwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:06:51.299338 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.299315    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c676822a-9023-40b9-b350-0208d7af292d-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:51.299338 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.299336    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vgwl\" (UniqueName: \"kubernetes.io/projected/c676822a-9023-40b9-b350-0208d7af292d-kube-api-access-6vgwl\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:51.299483 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.299346    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph844\" (UniqueName: \"kubernetes.io/projected/0434b22f-8e51-4721-ae3f-f29f687b832d-kube-api-access-ph844\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:51.299483 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.299354    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0434b22f-8e51-4721-ae3f-f29f687b832d-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:06:51.476657 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.476633    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"]
Sep 11 04:06:51.479855 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.479832    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f"]
Sep 11 04:06:51.490514 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.490490    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"]
Sep 11 04:06:51.497592 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:51.497570    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj"]
Sep 11 04:06:52.632128 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:52.632097    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0434b22f-8e51-4721-ae3f-f29f687b832d" path="/var/lib/kubelet/pods/0434b22f-8e51-4721-ae3f-f29f687b832d/volumes"
Sep 11 04:06:52.632497 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:52.632448    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c676822a-9023-40b9-b350-0208d7af292d" path="/var/lib/kubelet/pods/c676822a-9023-40b9-b350-0208d7af292d/volumes"
Sep 11 04:06:52.632762 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:52.632749    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e732bc55-c3b0-4918-aa18-045c315d7286" path="/var/lib/kubelet/pods/e732bc55-c3b0-4918-aa18-045c315d7286/volumes"
Sep 11 04:06:58.113030 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.112987    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"]
Sep 11 04:06:58.113394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113324    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy"
Sep 11 04:06:58.113394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113335    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy"
Sep 11 04:06:58.113394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113347    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c676822a-9023-40b9-b350-0208d7af292d" containerName="payload-processing"
Sep 11 04:06:58.113394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113353    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c676822a-9023-40b9-b350-0208d7af292d" containerName="payload-processing"
Sep 11 04:06:58.113394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113364    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0434b22f-8e51-4721-ae3f-f29f687b832d" containerName="payload-pre-processing"
Sep 11 04:06:58.113394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113369    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0434b22f-8e51-4721-ae3f-f29f687b832d" containerName="payload-pre-processing"
Sep 11 04:06:58.113394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113380    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e8cc41-a389-443b-b3fe-b27d01d913cc" containerName="revoke-keys"
Sep 11 04:06:58.113394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113385    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e8cc41-a389-443b-b3fe-b27d01d913cc" containerName="revoke-keys"
Sep 11 04:06:58.113394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113395    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e15c2f-549f-4460-92f5-3b1fd83d4107" containerName="payload-pre-processing"
Sep 11 04:06:58.113394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113399    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e15c2f-549f-4460-92f5-3b1fd83d4107" containerName="payload-pre-processing"
Sep 11 04:06:58.113718 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113406    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e732bc55-c3b0-4918-aa18-045c315d7286" containerName="revoke-keys"
Sep 11 04:06:58.113718 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113411    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e732bc55-c3b0-4918-aa18-045c315d7286" containerName="revoke-keys"
Sep 11 04:06:58.113718 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113464    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e8cc41-a389-443b-b3fe-b27d01d913cc" containerName="revoke-keys"
Sep 11 04:06:58.113718 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113471    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c676822a-9023-40b9-b350-0208d7af292d" containerName="payload-processing"
Sep 11 04:06:58.113718 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113477    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e732bc55-c3b0-4918-aa18-045c315d7286" containerName="revoke-keys"
Sep 11 04:06:58.113718 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113484    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy"
Sep 11 04:06:58.113718 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113489    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0434b22f-8e51-4721-ae3f-f29f687b832d" containerName="payload-pre-processing"
Sep 11 04:06:58.113718 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.113496    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e15c2f-549f-4460-92f5-3b1fd83d4107" containerName="payload-pre-processing"
Sep 11 04:06:58.118123 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.118108    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.122405 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.122385    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-9d031d-openshift-default-dockercfg-fn89s\""
Sep 11 04:06:58.136707 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.136683    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"]
Sep 11 04:06:58.265375 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.265344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjll5\" (UniqueName: \"kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-kube-api-access-vjll5\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.265533 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.265387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-data\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.265533 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.265419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-podinfo\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.265533 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.265437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-credential-socket\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.265533 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.265456    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-envoy\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.265533 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.265476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-socket\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.265732 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.265560    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-certs\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.265732 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.265624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-token\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.265732 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.265666    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istiod-ca-cert\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367054 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.366977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-socket\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367054 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-certs\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367054 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367037    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-token\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367294 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istiod-ca-cert\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367294 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjll5\" (UniqueName: \"kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-kube-api-access-vjll5\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367294 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367281    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-data\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367459 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-podinfo\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367459 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-credential-socket\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367459 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367416    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-socket\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367459 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-envoy\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367657 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367442    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-certs\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367657 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367639    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-data\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367778 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367754    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-credential-socket\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.367887 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.367841    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istiod-ca-cert\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.369671 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.369653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-envoy\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.369901 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.369883    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-podinfo\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.378163 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.378139    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjll5\" (UniqueName: \"kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-kube-api-access-vjll5\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.378258 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.378213    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-token\") pod \"e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") " pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.427630 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.427581    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:58.726104 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.726078    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"]
Sep 11 04:06:58.727986 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:06:58.727961    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7205d0d6_6947_49b9_b776_d8b01f1f3fbb.slice/crio-26466c407ec04355d114c7fa276ec95fe808f0577fe2e9c21f2656b1b928920d WatchSource:0}: Error finding container 26466c407ec04355d114c7fa276ec95fe808f0577fe2e9c21f2656b1b928920d: Status 404 returned error can't find the container with id 26466c407ec04355d114c7fa276ec95fe808f0577fe2e9c21f2656b1b928920d
Sep 11 04:06:58.730015 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.729988    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:06:58.730056 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.730049    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:06:58.730094 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:58.730076    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:06:59.211585 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:59.211485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" event={"ID":"7205d0d6-6947-49b9-b776-d8b01f1f3fbb","Type":"ContainerStarted","Data":"5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd"}
Sep 11 04:06:59.211585 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:59.211549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" event={"ID":"7205d0d6-6947-49b9-b776-d8b01f1f3fbb","Type":"ContainerStarted","Data":"26466c407ec04355d114c7fa276ec95fe808f0577fe2e9c21f2656b1b928920d"}
Sep 11 04:06:59.233035 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:59.232987    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" podStartSLOduration=1.232970866 podStartE2EDuration="1.232970866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:06:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:06:59.229972442 +0000 UTC m=+1025.108164767" watchObservedRunningTime="2026-09-11 04:06:59.232970866 +0000 UTC m=+1025.111163213"
Sep 11 04:06:59.428119 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:59.428083    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:06:59.433043 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:06:59.433019    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:07:00.217001 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:00.216969    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:07:00.217904 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:00.217886    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:07:03.328172 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.328133    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"]
Sep 11 04:07:03.328696 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.328677    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy"
Sep 11 04:07:03.328779 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.328698    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy"
Sep 11 04:07:03.328963 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.328941    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd6c7967-b078-41d5-830f-a66e88e62116" containerName="istio-proxy"
Sep 11 04:07:03.332207 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.332192    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:07:03.334660 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.334639    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-9d031d\""
Sep 11 04:07:03.334753 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.334735    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-9d031d-dockercfg-8jnfr\""
Sep 11 04:07:03.343792 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.343767    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"]
Sep 11 04:07:03.389102 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.389072    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"]
Sep 11 04:07:03.392354 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.392339    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:07:03.403732 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.403714    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"]
Sep 11 04:07:03.414980 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.414956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czfcp\" (UniqueName: \"kubernetes.io/projected/c2f2d203-39ba-477d-98bc-781f7cd6d143-kube-api-access-czfcp\") pod \"payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh\" (UID: \"c2f2d203-39ba-477d-98bc-781f7cd6d143\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:07:03.415135 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.415009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2f2d203-39ba-477d-98bc-781f7cd6d143-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh\" (UID: \"c2f2d203-39ba-477d-98bc-781f7cd6d143\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:07:03.516480 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.516443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czfcp\" (UniqueName: \"kubernetes.io/projected/c2f2d203-39ba-477d-98bc-781f7cd6d143-kube-api-access-czfcp\") pod \"payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh\" (UID: \"c2f2d203-39ba-477d-98bc-781f7cd6d143\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:07:03.516480 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.516483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7a126e9-33d2-4dae-a884-21701a8e630b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn\" (UID: \"f7a126e9-33d2-4dae-a884-21701a8e630b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:07:03.516739 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.516532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2f2d203-39ba-477d-98bc-781f7cd6d143-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh\" (UID: \"c2f2d203-39ba-477d-98bc-781f7cd6d143\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:07:03.516739 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.516685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72n7w\" (UniqueName: \"kubernetes.io/projected/f7a126e9-33d2-4dae-a884-21701a8e630b-kube-api-access-72n7w\") pod \"payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn\" (UID: \"f7a126e9-33d2-4dae-a884-21701a8e630b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:07:03.517165 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.517148    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2f2d203-39ba-477d-98bc-781f7cd6d143-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh\" (UID: \"c2f2d203-39ba-477d-98bc-781f7cd6d143\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:07:03.525978 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.525954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czfcp\" (UniqueName: \"kubernetes.io/projected/c2f2d203-39ba-477d-98bc-781f7cd6d143-kube-api-access-czfcp\") pod \"payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh\" (UID: \"c2f2d203-39ba-477d-98bc-781f7cd6d143\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:07:03.618189 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.618118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72n7w\" (UniqueName: \"kubernetes.io/projected/f7a126e9-33d2-4dae-a884-21701a8e630b-kube-api-access-72n7w\") pod \"payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn\" (UID: \"f7a126e9-33d2-4dae-a884-21701a8e630b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:07:03.618189 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.618177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7a126e9-33d2-4dae-a884-21701a8e630b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn\" (UID: \"f7a126e9-33d2-4dae-a884-21701a8e630b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:07:03.618813 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.618795    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7a126e9-33d2-4dae-a884-21701a8e630b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn\" (UID: \"f7a126e9-33d2-4dae-a884-21701a8e630b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:07:03.628222 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.628201    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72n7w\" (UniqueName: \"kubernetes.io/projected/f7a126e9-33d2-4dae-a884-21701a8e630b-kube-api-access-72n7w\") pod \"payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn\" (UID: \"f7a126e9-33d2-4dae-a884-21701a8e630b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:07:03.644181 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.644162    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:07:03.702342 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.702311    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:07:03.918671 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.918645    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"]
Sep 11 04:07:03.920479 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:07:03.920450    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f2d203_39ba_477d_98bc_781f7cd6d143.slice/crio-d124601c2b03b5490d548dc9b69d31957f49188a9cc1d450238968057da74153 WatchSource:0}: Error finding container d124601c2b03b5490d548dc9b69d31957f49188a9cc1d450238968057da74153: Status 404 returned error can't find the container with id d124601c2b03b5490d548dc9b69d31957f49188a9cc1d450238968057da74153
Sep 11 04:07:03.988212 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:07:03.988187    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a126e9_33d2_4dae_a884_21701a8e630b.slice/crio-a5cba096f4741be970861d8347f4589955743581caec9d54b03868481d308fd3 WatchSource:0}: Error finding container a5cba096f4741be970861d8347f4589955743581caec9d54b03868481d308fd3: Status 404 returned error can't find the container with id a5cba096f4741be970861d8347f4589955743581caec9d54b03868481d308fd3
Sep 11 04:07:03.988294 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:03.988233    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"]
Sep 11 04:07:04.246213 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:04.246186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh" event={"ID":"c2f2d203-39ba-477d-98bc-781f7cd6d143","Type":"ContainerStarted","Data":"2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671"}
Sep 11 04:07:04.246395 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:04.246243    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh" event={"ID":"c2f2d203-39ba-477d-98bc-781f7cd6d143","Type":"ContainerStarted","Data":"d124601c2b03b5490d548dc9b69d31957f49188a9cc1d450238968057da74153"}
Sep 11 04:07:04.246395 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:04.246360    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:07:04.247969 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:04.247946    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn" event={"ID":"f7a126e9-33d2-4dae-a884-21701a8e630b","Type":"ContainerStarted","Data":"b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963"}
Sep 11 04:07:04.248106 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:04.247981    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn" event={"ID":"f7a126e9-33d2-4dae-a884-21701a8e630b","Type":"ContainerStarted","Data":"a5cba096f4741be970861d8347f4589955743581caec9d54b03868481d308fd3"}
Sep 11 04:07:04.248106 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:04.248067    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:07:04.270509 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:04.270435    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh" podStartSLOduration=1.270416674 podStartE2EDuration="1.270416674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:07:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:07:04.268106866 +0000 UTC m=+1030.146299184" watchObservedRunningTime="2026-09-11 04:07:04.270416674 +0000 UTC m=+1030.148608974"
Sep 11 04:07:04.296722 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:04.296673    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn" podStartSLOduration=1.29665788 podStartE2EDuration="1.29665788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:07:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:07:04.29350823 +0000 UTC m=+1030.171700531" watchObservedRunningTime="2026-09-11 04:07:04.29665788 +0000 UTC m=+1030.174850182"
Sep 11 04:07:13.210081 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.210038    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"]
Sep 11 04:07:13.215511 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.215490    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:07:13.218130 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.218109    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-68ec26-dockercfg-jfj2q\""
Sep 11 04:07:13.218356 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.218342    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-68ec26\""
Sep 11 04:07:13.224123 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.224099    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"]
Sep 11 04:07:13.318147 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.318111    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jdjs\" (UniqueName: \"kubernetes.io/projected/671b291c-a584-4aef-b120-863800f2c463-kube-api-access-2jdjs\") pod \"payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x\" (UID: \"671b291c-a584-4aef-b120-863800f2c463\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:07:13.318343 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.318188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/671b291c-a584-4aef-b120-863800f2c463-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x\" (UID: \"671b291c-a584-4aef-b120-863800f2c463\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:07:13.418759 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.418723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/671b291c-a584-4aef-b120-863800f2c463-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x\" (UID: \"671b291c-a584-4aef-b120-863800f2c463\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:07:13.418922 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.418802    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jdjs\" (UniqueName: \"kubernetes.io/projected/671b291c-a584-4aef-b120-863800f2c463-kube-api-access-2jdjs\") pod \"payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x\" (UID: \"671b291c-a584-4aef-b120-863800f2c463\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:07:13.419465 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.419445    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/671b291c-a584-4aef-b120-863800f2c463-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x\" (UID: \"671b291c-a584-4aef-b120-863800f2c463\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:07:13.426558 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.426536    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jdjs\" (UniqueName: \"kubernetes.io/projected/671b291c-a584-4aef-b120-863800f2c463-kube-api-access-2jdjs\") pod \"payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x\" (UID: \"671b291c-a584-4aef-b120-863800f2c463\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:07:13.529136 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.529094    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:07:13.813821 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:13.813631    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"]
Sep 11 04:07:13.816692 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:07:13.816654    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671b291c_a584_4aef_b120_863800f2c463.slice/crio-86ec0c071a28deddee92db7eb7e91ccd453458edcdb71c5c3aeef122ceb63015 WatchSource:0}: Error finding container 86ec0c071a28deddee92db7eb7e91ccd453458edcdb71c5c3aeef122ceb63015: Status 404 returned error can't find the container with id 86ec0c071a28deddee92db7eb7e91ccd453458edcdb71c5c3aeef122ceb63015
Sep 11 04:07:14.320198 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:14.320162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x" event={"ID":"671b291c-a584-4aef-b120-863800f2c463","Type":"ContainerStarted","Data":"dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186"}
Sep 11 04:07:14.320712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:14.320225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x" event={"ID":"671b291c-a584-4aef-b120-863800f2c463","Type":"ContainerStarted","Data":"86ec0c071a28deddee92db7eb7e91ccd453458edcdb71c5c3aeef122ceb63015"}
Sep 11 04:07:14.320712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:14.320257    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:07:14.337248 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:14.337198    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x" podStartSLOduration=1.3371830550000001 podStartE2EDuration="1.337183055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:07:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:07:14.335656036 +0000 UTC m=+1040.213848338" watchObservedRunningTime="2026-09-11 04:07:14.337183055 +0000 UTC m=+1040.215375357"
Sep 11 04:07:15.254554 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:15.254526    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:07:15.254806 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:15.254785    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:07:16.257764 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:16.257719    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:07:16.258147 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:16.257781    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:07:17.349332 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:17.349300    2575 generic.go:356] "Generic (PLEG): container finished" podID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerID="5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd" exitCode=0
Sep 11 04:07:17.349873 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:17.349380    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" event={"ID":"7205d0d6-6947-49b9-b776-d8b01f1f3fbb","Type":"ContainerDied","Data":"5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd"}
Sep 11 04:07:17.349945 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:17.349873    2575 scope.go:117] "RemoveContainer" containerID="5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd"
Sep 11 04:07:17.350926 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:17.350901    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:07:17.350988 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:17.350975    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:07:17.351028 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:17.351010    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:07:18.356445 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:18.356414    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" event={"ID":"7205d0d6-6947-49b9-b776-d8b01f1f3fbb","Type":"ContainerStarted","Data":"c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2"}
Sep 11 04:07:18.427868 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:18.427827    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:07:18.428065 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:18.428041    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 04:07:18.428121 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:18.428095    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 04:07:19.428323 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:19.428288    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 04:07:19.428742 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:19.428370    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 04:07:20.428631 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:20.428566    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 04:07:20.429078 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:20.428662    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 04:07:21.428463 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:21.428426    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 04:07:21.428672 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:21.428483    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 04:07:22.428139 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:22.428102    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 04:07:22.428337 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:22.428170    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 04:07:23.428133 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:23.428096    2575 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 04:07:23.428536 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:23.428152    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 04:07:24.432066 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:24.432036    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:07:24.432448 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:24.432412    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:07:24.433099 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:24.433079    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:07:25.338622 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:25.338575    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:07:31.847040 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:31.847006    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"]
Sep 11 04:07:31.850804 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:31.850787    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:07:31.856269 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:31.856242    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-c158b2\""
Sep 11 04:07:31.856394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:31.856336    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-c158b2-dockercfg-x8z75\""
Sep 11 04:07:31.881053 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:31.881027    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"]
Sep 11 04:07:31.887023 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:31.886999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5eace334-3231-4022-9b10-1ce66522dadc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8\" (UID: \"5eace334-3231-4022-9b10-1ce66522dadc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:07:31.887132 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:31.887053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlw26\" (UniqueName: \"kubernetes.io/projected/5eace334-3231-4022-9b10-1ce66522dadc-kube-api-access-zlw26\") pod \"payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8\" (UID: \"5eace334-3231-4022-9b10-1ce66522dadc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:07:31.987971 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:31.987941    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlw26\" (UniqueName: \"kubernetes.io/projected/5eace334-3231-4022-9b10-1ce66522dadc-kube-api-access-zlw26\") pod \"payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8\" (UID: \"5eace334-3231-4022-9b10-1ce66522dadc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:07:31.988139 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:31.988061    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5eace334-3231-4022-9b10-1ce66522dadc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8\" (UID: \"5eace334-3231-4022-9b10-1ce66522dadc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:07:31.988752 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:31.988727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5eace334-3231-4022-9b10-1ce66522dadc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8\" (UID: \"5eace334-3231-4022-9b10-1ce66522dadc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:07:32.002760 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:32.002737    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlw26\" (UniqueName: \"kubernetes.io/projected/5eace334-3231-4022-9b10-1ce66522dadc-kube-api-access-zlw26\") pod \"payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8\" (UID: \"5eace334-3231-4022-9b10-1ce66522dadc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:07:32.160994 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:32.160913    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:07:32.441029 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:32.441006    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"]
Sep 11 04:07:32.442663 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:07:32.442629    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eace334_3231_4022_9b10_1ce66522dadc.slice/crio-d6cf73022ddcf254ca97161f8dbfdb4a3b7daf23b5be72d9806638534e03b18c WatchSource:0}: Error finding container d6cf73022ddcf254ca97161f8dbfdb4a3b7daf23b5be72d9806638534e03b18c: Status 404 returned error can't find the container with id d6cf73022ddcf254ca97161f8dbfdb4a3b7daf23b5be72d9806638534e03b18c
Sep 11 04:07:33.454149 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:33.454116    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8" event={"ID":"5eace334-3231-4022-9b10-1ce66522dadc","Type":"ContainerStarted","Data":"8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39"}
Sep 11 04:07:33.454537 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:33.454164    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8" event={"ID":"5eace334-3231-4022-9b10-1ce66522dadc","Type":"ContainerStarted","Data":"d6cf73022ddcf254ca97161f8dbfdb4a3b7daf23b5be72d9806638534e03b18c"}
Sep 11 04:07:33.454537 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:33.454229    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:07:33.476420 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:33.476366    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8" podStartSLOduration=2.476349398 podStartE2EDuration="2.476349398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:07:33.476162967 +0000 UTC m=+1059.354355269" watchObservedRunningTime="2026-09-11 04:07:33.476349398 +0000 UTC m=+1059.354541702"
Sep 11 04:07:41.447916 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.447880    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"]
Sep 11 04:07:41.452629 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.452587    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:07:41.457301 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.457281    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-604323\""
Sep 11 04:07:41.457423 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.457372    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-604323-dockercfg-wrqqr\""
Sep 11 04:07:41.466843 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.466821    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"]
Sep 11 04:07:41.496299 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.496273    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"]
Sep 11 04:07:41.499713 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.499696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:07:41.512094 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.512074    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"]
Sep 11 04:07:41.577530 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.577495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82b275fc-fd22-4d45-a64c-f6c256703356-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl\" (UID: \"82b275fc-fd22-4d45-a64c-f6c256703356\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:07:41.577530 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.577533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxvtv\" (UniqueName: \"kubernetes.io/projected/a07155fa-f0c4-4ccc-936f-a75b73e85196-kube-api-access-bxvtv\") pod \"payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq\" (UID: \"a07155fa-f0c4-4ccc-936f-a75b73e85196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:07:41.577797 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.577560    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a07155fa-f0c4-4ccc-936f-a75b73e85196-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq\" (UID: \"a07155fa-f0c4-4ccc-936f-a75b73e85196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:07:41.577797 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.577681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4mx9\" (UniqueName: \"kubernetes.io/projected/82b275fc-fd22-4d45-a64c-f6c256703356-kube-api-access-r4mx9\") pod \"payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl\" (UID: \"82b275fc-fd22-4d45-a64c-f6c256703356\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:07:41.678029 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.677992    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mx9\" (UniqueName: \"kubernetes.io/projected/82b275fc-fd22-4d45-a64c-f6c256703356-kube-api-access-r4mx9\") pod \"payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl\" (UID: \"82b275fc-fd22-4d45-a64c-f6c256703356\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:07:41.678175 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.678079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82b275fc-fd22-4d45-a64c-f6c256703356-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl\" (UID: \"82b275fc-fd22-4d45-a64c-f6c256703356\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:07:41.678175 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.678108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxvtv\" (UniqueName: \"kubernetes.io/projected/a07155fa-f0c4-4ccc-936f-a75b73e85196-kube-api-access-bxvtv\") pod \"payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq\" (UID: \"a07155fa-f0c4-4ccc-936f-a75b73e85196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:07:41.678175 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.678146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a07155fa-f0c4-4ccc-936f-a75b73e85196-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq\" (UID: \"a07155fa-f0c4-4ccc-936f-a75b73e85196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:07:41.678857 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.678841    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82b275fc-fd22-4d45-a64c-f6c256703356-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl\" (UID: \"82b275fc-fd22-4d45-a64c-f6c256703356\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:07:41.678914 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.678869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a07155fa-f0c4-4ccc-936f-a75b73e85196-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq\" (UID: \"a07155fa-f0c4-4ccc-936f-a75b73e85196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:07:41.686767 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.686744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4mx9\" (UniqueName: \"kubernetes.io/projected/82b275fc-fd22-4d45-a64c-f6c256703356-kube-api-access-r4mx9\") pod \"payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl\" (UID: \"82b275fc-fd22-4d45-a64c-f6c256703356\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:07:41.686939 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.686919    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxvtv\" (UniqueName: \"kubernetes.io/projected/a07155fa-f0c4-4ccc-936f-a75b73e85196-kube-api-access-bxvtv\") pod \"payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq\" (UID: \"a07155fa-f0c4-4ccc-936f-a75b73e85196\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:07:41.763298 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.763275    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:07:41.809568 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:41.809537    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:07:42.035053 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:42.035023    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"]
Sep 11 04:07:42.035747 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:07:42.035723    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b275fc_fd22_4d45_a64c_f6c256703356.slice/crio-e4a6e62935352a16f11f8e0d87ea790c5b7d5d67573f31e0c4d815f5c52377ef WatchSource:0}: Error finding container e4a6e62935352a16f11f8e0d87ea790c5b7d5d67573f31e0c4d815f5c52377ef: Status 404 returned error can't find the container with id e4a6e62935352a16f11f8e0d87ea790c5b7d5d67573f31e0c4d815f5c52377ef
Sep 11 04:07:42.095923 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:42.095887    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"]
Sep 11 04:07:42.097217 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:07:42.097195    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07155fa_f0c4_4ccc_936f_a75b73e85196.slice/crio-fa3dc2181e8ee0f971dfb89c7cb3491de2ae2bcd1c372682cd35ab5b1525710e WatchSource:0}: Error finding container fa3dc2181e8ee0f971dfb89c7cb3491de2ae2bcd1c372682cd35ab5b1525710e: Status 404 returned error can't find the container with id fa3dc2181e8ee0f971dfb89c7cb3491de2ae2bcd1c372682cd35ab5b1525710e
Sep 11 04:07:42.510377 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:42.510348    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl" event={"ID":"82b275fc-fd22-4d45-a64c-f6c256703356","Type":"ContainerStarted","Data":"37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921"}
Sep 11 04:07:42.510853 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:42.510408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl" event={"ID":"82b275fc-fd22-4d45-a64c-f6c256703356","Type":"ContainerStarted","Data":"e4a6e62935352a16f11f8e0d87ea790c5b7d5d67573f31e0c4d815f5c52377ef"}
Sep 11 04:07:42.510853 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:42.510440    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:07:42.511993 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:42.511964    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq" event={"ID":"a07155fa-f0c4-4ccc-936f-a75b73e85196","Type":"ContainerStarted","Data":"812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50"}
Sep 11 04:07:42.512129 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:42.512004    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq" event={"ID":"a07155fa-f0c4-4ccc-936f-a75b73e85196","Type":"ContainerStarted","Data":"fa3dc2181e8ee0f971dfb89c7cb3491de2ae2bcd1c372682cd35ab5b1525710e"}
Sep 11 04:07:42.512129 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:42.512035    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:07:42.528171 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:42.528127    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl" podStartSLOduration=1.528112025 podStartE2EDuration="1.528112025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:07:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:07:42.525383201 +0000 UTC m=+1068.403575503" watchObservedRunningTime="2026-09-11 04:07:42.528112025 +0000 UTC m=+1068.406304370"
Sep 11 04:07:42.541925 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:42.541879    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq" podStartSLOduration=1.541865777 podStartE2EDuration="1.541865777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:07:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:07:42.541268354 +0000 UTC m=+1068.419460656" watchObservedRunningTime="2026-09-11 04:07:42.541865777 +0000 UTC m=+1068.420058148"
Sep 11 04:07:44.461579 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:44.461543    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:07:53.519432 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:53.519355    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:07:53.519846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:07:53.519458    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:08:14.323701 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.323667    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"]
Sep 11 04:08:14.328409 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.328389    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.331164 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.331143    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0347a9fa-openshift-default-dockercfg-pxmnq\""
Sep 11 04:08:14.344212 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.344189    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"]
Sep 11 04:08:14.374338 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.374308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-credential-socket\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.374429 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.374345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc5efe50-d8a7-4863-8654-37b6f642693e-istiod-ca-cert\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.374429 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.374371    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q4fg\" (UniqueName: \"kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-kube-api-access-8q4fg\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.374507 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.374422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-podinfo\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.374507 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.374490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-socket\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.374584 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.374533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-envoy\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.374584 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.374559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-certs\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.374697 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.374588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-data\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.374697 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.374653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-token\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.475728 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.475690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-credential-socket\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.475923 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.475737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc5efe50-d8a7-4863-8654-37b6f642693e-istiod-ca-cert\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.475923 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.475781    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q4fg\" (UniqueName: \"kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-kube-api-access-8q4fg\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.475923 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.475805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-podinfo\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.476043 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.475939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-socket\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.476043 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.476016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-envoy\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.476139 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.476064    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-certs\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.476194 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.476137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-data\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.476194 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.476166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-token\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.476423 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.476401    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-socket\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.476531 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.476141    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-credential-socket\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.476531 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.476471    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-certs\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.476531 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.476513    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-data\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.476531 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.476521    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc5efe50-d8a7-4863-8654-37b6f642693e-istiod-ca-cert\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.478530 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.478500    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-envoy\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.478840 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.478823    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-podinfo\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.488861 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.488836    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q4fg\" (UniqueName: \"kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-kube-api-access-8q4fg\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.489366 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.489350    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-token\") pod \"e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") " pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.639137 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.639077    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:14.923825 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.923802    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"]
Sep 11 04:08:14.925104 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:08:14.925084    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5efe50_d8a7_4863_8654_37b6f642693e.slice/crio-9018ce6b82e30a54f9d33ab092181d45cac7aceaffbb67fb2a3f5e9af5ccc5ea WatchSource:0}: Error finding container 9018ce6b82e30a54f9d33ab092181d45cac7aceaffbb67fb2a3f5e9af5ccc5ea: Status 404 returned error can't find the container with id 9018ce6b82e30a54f9d33ab092181d45cac7aceaffbb67fb2a3f5e9af5ccc5ea
Sep 11 04:08:14.927059 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.927023    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:08:14.927148 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.927087    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:08:14.927148 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:14.927122    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:08:15.717894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:15.717861    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" event={"ID":"fc5efe50-d8a7-4863-8654-37b6f642693e","Type":"ContainerStarted","Data":"4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2"}
Sep 11 04:08:15.718269 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:15.717914    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" event={"ID":"fc5efe50-d8a7-4863-8654-37b6f642693e","Type":"ContainerStarted","Data":"9018ce6b82e30a54f9d33ab092181d45cac7aceaffbb67fb2a3f5e9af5ccc5ea"}
Sep 11 04:08:15.745764 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:15.745714    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" podStartSLOduration=1.745697545 podStartE2EDuration="1.745697545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:08:15.743461035 +0000 UTC m=+1101.621653339" watchObservedRunningTime="2026-09-11 04:08:15.745697545 +0000 UTC m=+1101.623889849"
Sep 11 04:08:16.640200 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:16.640165    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:16.645263 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:16.645240    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:16.723634 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:16.723585    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:16.724514 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:16.724494    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:38.860547 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:38.860513    2575 generic.go:356] "Generic (PLEG): container finished" podID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerID="4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2" exitCode=0
Sep 11 04:08:38.860980 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:38.860570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" event={"ID":"fc5efe50-d8a7-4863-8654-37b6f642693e","Type":"ContainerDied","Data":"4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2"}
Sep 11 04:08:38.860980 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:38.860955    2575 scope.go:117] "RemoveContainer" containerID="4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2"
Sep 11 04:08:38.862039 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:38.862011    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:08:38.862093 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:38.862078    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:08:38.862129 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:38.862107    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:08:39.867821 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:39.867785    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" event={"ID":"fc5efe50-d8a7-4863-8654-37b6f642693e","Type":"ContainerStarted","Data":"2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5"}
Sep 11 04:08:40.639823 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:40.639791    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:40.639989 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:40.639969    2575 patch_prober.go:28] interesting pod/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 11 04:08:40.640051 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:40.640015    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 11 04:08:41.640358 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:41.640319    2575 patch_prober.go:28] interesting pod/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 11 04:08:41.640758 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:41.640375    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 11 04:08:42.639812 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:42.639782    2575 patch_prober.go:28] interesting pod/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 11 04:08:42.639995 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:42.639834    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 11 04:08:43.639804 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:43.639774    2575 patch_prober.go:28] interesting pod/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 11 04:08:43.640208 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:43.639825    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 11 04:08:44.639731 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:44.639703    2575 patch_prober.go:28] interesting pod/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 11 04:08:44.639940 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:44.639756    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 11 04:08:45.644419 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:45.644388    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:45.644983 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:45.644872    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:45.645556 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:45.645536    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:08:54.771354 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:08:54.771318    2575 scope.go:117] "RemoveContainer" containerID="36853549683d7addb3b0f5ddb7194b085d5d371a479defd7e5679036982575de"
Sep 11 04:09:21.779693 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:21.779594    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"]
Sep 11 04:09:21.783303 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:21.783282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"
Sep 11 04:09:21.786344 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:21.786322    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:09:21.793680 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:21.793657    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"]
Sep 11 04:09:21.886665 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:21.886634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58229f6e-e6c1-4051-8740-f914b57808a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg\" (UID: \"58229f6e-e6c1-4051-8740-f914b57808a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"
Sep 11 04:09:21.987946 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:21.987912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58229f6e-e6c1-4051-8740-f914b57808a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg\" (UID: \"58229f6e-e6c1-4051-8740-f914b57808a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"
Sep 11 04:09:21.988507 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:21.988483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58229f6e-e6c1-4051-8740-f914b57808a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg\" (UID: \"58229f6e-e6c1-4051-8740-f914b57808a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"
Sep 11 04:09:22.094376 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:22.094292    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"
Sep 11 04:09:22.369575 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:22.369481    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"]
Sep 11 04:09:22.374769 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:09:22.374738    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58229f6e_e6c1_4051_8740_f914b57808a1.slice/crio-7e999c9292fd9cefa6fd3b44d81e82058dee1def6f0093894bee3eec7ac81fff WatchSource:0}: Error finding container 7e999c9292fd9cefa6fd3b44d81e82058dee1def6f0093894bee3eec7ac81fff: Status 404 returned error can't find the container with id 7e999c9292fd9cefa6fd3b44d81e82058dee1def6f0093894bee3eec7ac81fff
Sep 11 04:09:23.134113 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:23.134082    2575 generic.go:356] "Generic (PLEG): container finished" podID="58229f6e-e6c1-4051-8740-f914b57808a1" containerID="6402c74a6b0d5e0c2d58da742beb8292ba18957c57b8394ca35d56e7c88ffc80" exitCode=0
Sep 11 04:09:23.134437 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:23.134160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg" event={"ID":"58229f6e-e6c1-4051-8740-f914b57808a1","Type":"ContainerDied","Data":"6402c74a6b0d5e0c2d58da742beb8292ba18957c57b8394ca35d56e7c88ffc80"}
Sep 11 04:09:23.134437 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:23.134212    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg" event={"ID":"58229f6e-e6c1-4051-8740-f914b57808a1","Type":"ContainerStarted","Data":"7e999c9292fd9cefa6fd3b44d81e82058dee1def6f0093894bee3eec7ac81fff"}
Sep 11 04:09:24.271555 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:24.271530    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"
Sep 11 04:09:24.309220 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:24.309191    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58229f6e-e6c1-4051-8740-f914b57808a1-maas-api-service-ca\") pod \"58229f6e-e6c1-4051-8740-f914b57808a1\" (UID: \"58229f6e-e6c1-4051-8740-f914b57808a1\") "
Sep 11 04:09:24.309505 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:24.309484    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58229f6e-e6c1-4051-8740-f914b57808a1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "58229f6e-e6c1-4051-8740-f914b57808a1" (UID: "58229f6e-e6c1-4051-8740-f914b57808a1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:09:24.309594 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:24.309582    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58229f6e-e6c1-4051-8740-f914b57808a1-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:09:25.148486 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:25.148457    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"
Sep 11 04:09:25.148722 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:25.148453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg" event={"ID":"58229f6e-e6c1-4051-8740-f914b57808a1","Type":"ContainerDied","Data":"7e999c9292fd9cefa6fd3b44d81e82058dee1def6f0093894bee3eec7ac81fff"}
Sep 11 04:09:25.148722 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:25.148576    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e999c9292fd9cefa6fd3b44d81e82058dee1def6f0093894bee3eec7ac81fff"
Sep 11 04:09:37.845419 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:37.845384    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"]
Sep 11 04:09:37.848645 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:37.848623    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0347a9fa-jk5cg"]
Sep 11 04:09:38.632493 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:38.632459    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58229f6e-e6c1-4051-8740-f914b57808a1" path="/var/lib/kubelet/pods/58229f6e-e6c1-4051-8740-f914b57808a1/volumes"
Sep 11 04:09:54.679308 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:54.679279    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 04:09:54.680137 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:54.680104    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 04:09:54.793066 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:54.793040    2575 scope.go:117] "RemoveContainer" containerID="bd4119c963290023f35e19ccd0aebcb326060a460c5009484994603177712e28"
Sep 11 04:09:54.803881 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:09:54.803859    2575 scope.go:117] "RemoveContainer" containerID="e4ffab532097f9fa849585f63e648d4fbc9a557f7ddff8548565a571371ad055"
Sep 11 04:10:29.817353 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:29.817317    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"]
Sep 11 04:10:29.818146 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:29.817520    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy" containerID="cri-o://2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5" gracePeriod=30
Sep 11 04:10:30.647327 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:30.647290    2575 patch_prober.go:28] interesting pod/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:10:30.647520 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:30.647347    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:10:35.084807 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.084741    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:10:35.234276 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234236    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-socket\") pod \"fc5efe50-d8a7-4863-8654-37b6f642693e\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") "
Sep 11 04:10:35.234276 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234281    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc5efe50-d8a7-4863-8654-37b6f642693e-istiod-ca-cert\") pod \"fc5efe50-d8a7-4863-8654-37b6f642693e\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") "
Sep 11 04:10:35.234516 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234361    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-certs\") pod \"fc5efe50-d8a7-4863-8654-37b6f642693e\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") "
Sep 11 04:10:35.234516 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234397    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-token\") pod \"fc5efe50-d8a7-4863-8654-37b6f642693e\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") "
Sep 11 04:10:35.234516 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234439    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-credential-socket\") pod \"fc5efe50-d8a7-4863-8654-37b6f642693e\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") "
Sep 11 04:10:35.234516 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234473    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-podinfo\") pod \"fc5efe50-d8a7-4863-8654-37b6f642693e\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") "
Sep 11 04:10:35.234516 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234507    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-envoy\") pod \"fc5efe50-d8a7-4863-8654-37b6f642693e\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") "
Sep 11 04:10:35.234812 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234532    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-data\") pod \"fc5efe50-d8a7-4863-8654-37b6f642693e\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") "
Sep 11 04:10:35.234812 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc5efe50-d8a7-4863-8654-37b6f642693e" (UID: "fc5efe50-d8a7-4863-8654-37b6f642693e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:10:35.234812 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234582    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q4fg\" (UniqueName: \"kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-kube-api-access-8q4fg\") pod \"fc5efe50-d8a7-4863-8654-37b6f642693e\" (UID: \"fc5efe50-d8a7-4863-8654-37b6f642693e\") "
Sep 11 04:10:35.234812 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234693    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc5efe50-d8a7-4863-8654-37b6f642693e" (UID: "fc5efe50-d8a7-4863-8654-37b6f642693e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:10:35.234992 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234805    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc5efe50-d8a7-4863-8654-37b6f642693e" (UID: "fc5efe50-d8a7-4863-8654-37b6f642693e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:10:35.234992 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234816    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc5efe50-d8a7-4863-8654-37b6f642693e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc5efe50-d8a7-4863-8654-37b6f642693e" (UID: "fc5efe50-d8a7-4863-8654-37b6f642693e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:10:35.234992 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234825    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc5efe50-d8a7-4863-8654-37b6f642693e" (UID: "fc5efe50-d8a7-4863-8654-37b6f642693e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:10:35.234992 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.234986    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:10:35.235203 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.235007    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:10:35.235203 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.235022    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc5efe50-d8a7-4863-8654-37b6f642693e-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:10:35.235203 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.235036    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:10:35.235203 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.235048    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:10:35.236873 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.236839    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc5efe50-d8a7-4863-8654-37b6f642693e" (UID: "fc5efe50-d8a7-4863-8654-37b6f642693e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:10:35.236992 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.236906    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-kube-api-access-8q4fg" (OuterVolumeSpecName: "kube-api-access-8q4fg") pod "fc5efe50-d8a7-4863-8654-37b6f642693e" (UID: "fc5efe50-d8a7-4863-8654-37b6f642693e"). InnerVolumeSpecName "kube-api-access-8q4fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:10:35.236992 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.236916    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc5efe50-d8a7-4863-8654-37b6f642693e" (UID: "fc5efe50-d8a7-4863-8654-37b6f642693e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:10:35.236992 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.236929    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc5efe50-d8a7-4863-8654-37b6f642693e" (UID: "fc5efe50-d8a7-4863-8654-37b6f642693e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:10:35.336561 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.336481    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:10:35.336561 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.336515    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:10:35.336561 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.336527    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc5efe50-d8a7-4863-8654-37b6f642693e-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:10:35.336561 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.336541    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q4fg\" (UniqueName: \"kubernetes.io/projected/fc5efe50-d8a7-4863-8654-37b6f642693e-kube-api-access-8q4fg\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:10:35.556208 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.556172    2575 generic.go:356] "Generic (PLEG): container finished" podID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerID="2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5" exitCode=0
Sep 11 04:10:35.556388 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.556221    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"
Sep 11 04:10:35.556388 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.556254    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" event={"ID":"fc5efe50-d8a7-4863-8654-37b6f642693e","Type":"ContainerDied","Data":"2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5"}
Sep 11 04:10:35.556388 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.556306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx" event={"ID":"fc5efe50-d8a7-4863-8654-37b6f642693e","Type":"ContainerDied","Data":"9018ce6b82e30a54f9d33ab092181d45cac7aceaffbb67fb2a3f5e9af5ccc5ea"}
Sep 11 04:10:35.556388 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.556327    2575 scope.go:117] "RemoveContainer" containerID="2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5"
Sep 11 04:10:35.566693 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.566676    2575 scope.go:117] "RemoveContainer" containerID="4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2"
Sep 11 04:10:35.574996 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.574982    2575 scope.go:117] "RemoveContainer" containerID="2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5"
Sep 11 04:10:35.575260 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:10:35.575243    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5\": container with ID starting with 2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5 not found: ID does not exist" containerID="2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5"
Sep 11 04:10:35.575304 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.575269    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5"} err="failed to get container status \"2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5\": rpc error: code = NotFound desc = could not find container \"2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5\": container with ID starting with 2de574e2315d41f61b1d8a5aa05c4843c777d0498ab4df025bf3706cf93cfbd5 not found: ID does not exist"
Sep 11 04:10:35.575304 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.575284    2575 scope.go:117] "RemoveContainer" containerID="4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2"
Sep 11 04:10:35.575514 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:10:35.575499    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2\": container with ID starting with 4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2 not found: ID does not exist" containerID="4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2"
Sep 11 04:10:35.575555 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.575519    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2"} err="failed to get container status \"4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2\": rpc error: code = NotFound desc = could not find container \"4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2\": container with ID starting with 4c0a02d3cf197510bf13d592f7f3c1d67ff9c157c628c7d6382bb484ddd6d7d2 not found: ID does not exist"
Sep 11 04:10:35.580501 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.580482    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"]
Sep 11 04:10:35.585865 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:35.585844    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx"]
Sep 11 04:10:36.639121 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:36.639079    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" path="/var/lib/kubelet/pods/fc5efe50-d8a7-4863-8654-37b6f642693e/volumes"
Sep 11 04:10:54.831490 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:54.831402    2575 scope.go:117] "RemoveContainer" containerID="656480f28b2e6755987f46150b5fd8c036fd888b2cddfd32109e7bac3553f324"
Sep 11 04:10:54.841457 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:10:54.841438    2575 scope.go:117] "RemoveContainer" containerID="1b82ddc4a20adac0df57708e2decb05bbccf68ef01c4dd13ac77c857268fcf0d"
Sep 11 04:11:23.830900 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.830868    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"]
Sep 11 04:11:23.831363 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.831252    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy"
Sep 11 04:11:23.831363 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.831264    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy"
Sep 11 04:11:23.831363 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.831279    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58229f6e-e6c1-4051-8740-f914b57808a1" containerName="revoke-keys"
Sep 11 04:11:23.831363 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.831285    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="58229f6e-e6c1-4051-8740-f914b57808a1" containerName="revoke-keys"
Sep 11 04:11:23.831363 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.831362    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy"
Sep 11 04:11:23.831539 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.831369    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy"
Sep 11 04:11:23.831539 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.831377    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="58229f6e-e6c1-4051-8740-f914b57808a1" containerName="revoke-keys"
Sep 11 04:11:23.834394 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.834378    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:23.837264 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.837243    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a7eaac-openshift-default-dockercfg-crqf6\""
Sep 11 04:11:23.847990 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.847965    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"]
Sep 11 04:11:23.968984 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.968945    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f7132a-6df6-43db-b787-0cfd584545b6-istio-podinfo\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:23.969158 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.968999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-data\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:23.969158 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.969027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-socket\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:23.969158 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.969101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-istio-token\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:23.969158 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.969133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f7132a-6df6-43db-b787-0cfd584545b6-istiod-ca-cert\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:23.969303 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.969205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-certs\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:23.969303 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.969231    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j54gl\" (UniqueName: \"kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-kube-api-access-j54gl\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:23.969303 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.969273    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-envoy\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:23.969400 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:23.969307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-credential-socket\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.069915 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.069878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-envoy\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070081 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.069926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-credential-socket\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070081 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.069954    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f7132a-6df6-43db-b787-0cfd584545b6-istio-podinfo\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070081 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.069987    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-data\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070081 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.070005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-socket\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070081 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.070041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-istio-token\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070081 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.070068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f7132a-6df6-43db-b787-0cfd584545b6-istiod-ca-cert\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070397 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.070120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-certs\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070397 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.070335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j54gl\" (UniqueName: \"kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-kube-api-access-j54gl\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070397 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.070365    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-credential-socket\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070509 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.070480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-data\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070733 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.070686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-socket\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070733 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.070703    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-certs\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.070927 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.070907    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f7132a-6df6-43db-b787-0cfd584545b6-istiod-ca-cert\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.072462 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.072427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-envoy\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.072688 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.072671    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f7132a-6df6-43db-b787-0cfd584545b6-istio-podinfo\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.080374 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.080351    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-istio-token\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.080579 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.080564    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j54gl\" (UniqueName: \"kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-kube-api-access-j54gl\") pod \"e2e-api-a-a7eaac-openshift-default-549f686644-9472b\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") " pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.146103 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.146035    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:24.429844 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.429802    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"]
Sep 11 04:11:24.431053 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:11:24.431024    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f7132a_6df6_43db_b787_0cfd584545b6.slice/crio-a2e498196e21b9f6a31085b7be3fc155d2d577dee1cc57dabac2fec741c745dc WatchSource:0}: Error finding container a2e498196e21b9f6a31085b7be3fc155d2d577dee1cc57dabac2fec741c745dc: Status 404 returned error can't find the container with id a2e498196e21b9f6a31085b7be3fc155d2d577dee1cc57dabac2fec741c745dc
Sep 11 04:11:24.433319 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.433285    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:11:24.433397 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.433352    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:11:24.433397 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.433378    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:11:24.836803 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.836765    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" event={"ID":"37f7132a-6df6-43db-b787-0cfd584545b6","Type":"ContainerStarted","Data":"c7407b0aee3652a0d4586b265e76ce41f346dca49627f6ea30e823485af08226"}
Sep 11 04:11:24.837198 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.836815    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" event={"ID":"37f7132a-6df6-43db-b787-0cfd584545b6","Type":"ContainerStarted","Data":"a2e498196e21b9f6a31085b7be3fc155d2d577dee1cc57dabac2fec741c745dc"}
Sep 11 04:11:24.861388 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:24.861346    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" podStartSLOduration=1.86133113 podStartE2EDuration="1.86133113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:11:24.859440395 +0000 UTC m=+1290.737632675" watchObservedRunningTime="2026-09-11 04:11:24.86133113 +0000 UTC m=+1290.739523432"
Sep 11 04:11:25.146909 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:25.146823    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:25.152432 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:25.152400    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:25.842157 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:25.842126    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:25.843166 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:25.843147    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:28.754610 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:28.754560    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"]
Sep 11 04:11:28.755001 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:28.754961    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy"
Sep 11 04:11:28.755001 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:28.754973    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc5efe50-d8a7-4863-8654-37b6f642693e" containerName="istio-proxy"
Sep 11 04:11:28.758317 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:28.758301    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:11:28.760816 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:28.760788    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a7eaac\""
Sep 11 04:11:28.761036 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:28.761020    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a7eaac-dockercfg-px7sg\""
Sep 11 04:11:28.767681 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:28.767657    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"]
Sep 11 04:11:28.918351 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:28.918321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd51e040-3a2a-47a9-b297-c384302f543f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn\" (UID: \"bd51e040-3a2a-47a9-b297-c384302f543f\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:11:28.918351 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:28.918353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5prk6\" (UniqueName: \"kubernetes.io/projected/bd51e040-3a2a-47a9-b297-c384302f543f-kube-api-access-5prk6\") pod \"payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn\" (UID: \"bd51e040-3a2a-47a9-b297-c384302f543f\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:11:29.019092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:29.019002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd51e040-3a2a-47a9-b297-c384302f543f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn\" (UID: \"bd51e040-3a2a-47a9-b297-c384302f543f\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:11:29.019092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:29.019043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5prk6\" (UniqueName: \"kubernetes.io/projected/bd51e040-3a2a-47a9-b297-c384302f543f-kube-api-access-5prk6\") pod \"payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn\" (UID: \"bd51e040-3a2a-47a9-b297-c384302f543f\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:11:29.019744 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:29.019725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd51e040-3a2a-47a9-b297-c384302f543f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn\" (UID: \"bd51e040-3a2a-47a9-b297-c384302f543f\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:11:29.027499 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:29.027466    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5prk6\" (UniqueName: \"kubernetes.io/projected/bd51e040-3a2a-47a9-b297-c384302f543f-kube-api-access-5prk6\") pod \"payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn\" (UID: \"bd51e040-3a2a-47a9-b297-c384302f543f\") " pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:11:29.070935 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:29.070896    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:11:29.360097 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:29.360069    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"]
Sep 11 04:11:29.361700 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:11:29.361671    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd51e040_3a2a_47a9_b297_c384302f543f.slice/crio-78e077a6a779cd6ad5fc78631bd4983cf0a6f3ba9af8ed87f3b1ccbe88fb5fda WatchSource:0}: Error finding container 78e077a6a779cd6ad5fc78631bd4983cf0a6f3ba9af8ed87f3b1ccbe88fb5fda: Status 404 returned error can't find the container with id 78e077a6a779cd6ad5fc78631bd4983cf0a6f3ba9af8ed87f3b1ccbe88fb5fda
Sep 11 04:11:29.869544 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:29.869505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn" event={"ID":"bd51e040-3a2a-47a9-b297-c384302f543f","Type":"ContainerStarted","Data":"5af368f70827c94d3db2246e9ba8207301f01e8718baac1463a74e30e28d513f"}
Sep 11 04:11:29.869961 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:29.869634    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:11:29.869961 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:29.869678    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn" event={"ID":"bd51e040-3a2a-47a9-b297-c384302f543f","Type":"ContainerStarted","Data":"78e077a6a779cd6ad5fc78631bd4983cf0a6f3ba9af8ed87f3b1ccbe88fb5fda"}
Sep 11 04:11:29.887682 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:29.887628    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn" podStartSLOduration=1.8876111880000002 podStartE2EDuration="1.887611188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:11:29.886150131 +0000 UTC m=+1295.764342433" watchObservedRunningTime="2026-09-11 04:11:29.887611188 +0000 UTC m=+1295.765803480"
Sep 11 04:11:40.877654 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:40.877592    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:11:48.988991 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:48.988952    2575 generic.go:356] "Generic (PLEG): container finished" podID="37f7132a-6df6-43db-b787-0cfd584545b6" containerID="c7407b0aee3652a0d4586b265e76ce41f346dca49627f6ea30e823485af08226" exitCode=0
Sep 11 04:11:48.989399 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:48.989028    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" event={"ID":"37f7132a-6df6-43db-b787-0cfd584545b6","Type":"ContainerDied","Data":"c7407b0aee3652a0d4586b265e76ce41f346dca49627f6ea30e823485af08226"}
Sep 11 04:11:48.989445 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:48.989415    2575 scope.go:117] "RemoveContainer" containerID="c7407b0aee3652a0d4586b265e76ce41f346dca49627f6ea30e823485af08226"
Sep 11 04:11:48.990575 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:48.990551    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:11:48.990647 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:48.990635    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:11:48.990685 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:48.990664    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:11:50.009624 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:50.009573    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" event={"ID":"37f7132a-6df6-43db-b787-0cfd584545b6","Type":"ContainerStarted","Data":"01e96618e10918ec783cf7178d422bb8973bc221332c5b91752607fd8ec1df5d"}
Sep 11 04:11:50.146810 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:50.146771    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:50.147017 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:50.146994    2575 patch_prober.go:28] interesting pod/e2e-api-a-a7eaac-openshift-default-549f686644-9472b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 11 04:11:50.147099 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:50.147052    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 11 04:11:51.146441 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:51.146403    2575 patch_prober.go:28] interesting pod/e2e-api-a-a7eaac-openshift-default-549f686644-9472b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 11 04:11:51.146874 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:51.146469    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 11 04:11:52.147132 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.147098    2575 patch_prober.go:28] interesting pod/e2e-api-a-a7eaac-openshift-default-549f686644-9472b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 11 04:11:52.147536 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.147169    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 11 04:11:52.417508 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.417423    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"]
Sep 11 04:11:52.421105 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.421082    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.424030 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.423998    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4c6f83-openshift-default-dockercfg-sjndz\""
Sep 11 04:11:52.433306 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.433284    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"]
Sep 11 04:11:52.545092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.545049    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-certs\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.545092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.545098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-data\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.545310 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.545116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-podinfo\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.545310 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.545226    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-credential-socket\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.545310 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.545273    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-envoy\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.545310 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.545297    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-token\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.545442 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.545351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-socket\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.545442 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.545399    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e24af83b-8cdb-48c2-86d3-e537086c7260-istiod-ca-cert\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.545506 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.545471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkcnx\" (UniqueName: \"kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-kube-api-access-mkcnx\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646175 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-credential-socket\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646175 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-envoy\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646426 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-token\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646426 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646331    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-socket\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646426 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e24af83b-8cdb-48c2-86d3-e537086c7260-istiod-ca-cert\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646586 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkcnx\" (UniqueName: \"kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-kube-api-access-mkcnx\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646586 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-certs\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646586 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646563    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-credential-socket\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646788 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646654    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-socket\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646788 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-data\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646788 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-podinfo\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.646967 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646947    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-data\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.647021 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.646970    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-certs\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.647313 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.647127    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e24af83b-8cdb-48c2-86d3-e537086c7260-istiod-ca-cert\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.648764 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.648747    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-envoy\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.649118 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.649103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-podinfo\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.654470 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.654450    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-token\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.654836 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.654815    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkcnx\" (UniqueName: \"kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-kube-api-access-mkcnx\") pod \"e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") " pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:52.733076 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:52.733046    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:53.035772 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:53.035741    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"]
Sep 11 04:11:53.037109 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:11:53.037080    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24af83b_8cdb_48c2_86d3_e537086c7260.slice/crio-736148186d89fd0d15b973e6d6d1ade21fc8aec05be0541d1116340ec0bc5292 WatchSource:0}: Error finding container 736148186d89fd0d15b973e6d6d1ade21fc8aec05be0541d1116340ec0bc5292: Status 404 returned error can't find the container with id 736148186d89fd0d15b973e6d6d1ade21fc8aec05be0541d1116340ec0bc5292
Sep 11 04:11:53.039441 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:53.039398    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:11:53.039527 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:53.039485    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:11:53.039527 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:53.039520    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:11:53.147021 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:53.146992    2575 patch_prober.go:28] interesting pod/e2e-api-a-a7eaac-openshift-default-549f686644-9472b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 11 04:11:53.147126 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:53.147030    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 11 04:11:54.035957 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:54.035917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" event={"ID":"e24af83b-8cdb-48c2-86d3-e537086c7260","Type":"ContainerStarted","Data":"6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa"}
Sep 11 04:11:54.036349 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:54.035981    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" event={"ID":"e24af83b-8cdb-48c2-86d3-e537086c7260","Type":"ContainerStarted","Data":"736148186d89fd0d15b973e6d6d1ade21fc8aec05be0541d1116340ec0bc5292"}
Sep 11 04:11:54.057174 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:54.057125    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" podStartSLOduration=2.05711095 podStartE2EDuration="2.05711095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:11:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:11:54.055462429 +0000 UTC m=+1319.933654730" watchObservedRunningTime="2026-09-11 04:11:54.05711095 +0000 UTC m=+1319.935303252"
Sep 11 04:11:54.147085 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:54.147057    2575 patch_prober.go:28] interesting pod/e2e-api-a-a7eaac-openshift-default-549f686644-9472b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 11 04:11:54.147242 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:54.147106    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 11 04:11:54.733771 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:54.733738    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:54.738965 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:54.738936    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:54.869575 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:54.869544    2575 scope.go:117] "RemoveContainer" containerID="16237f80afa05e4887d6de3479c45688a3379cf727e6ee3bddee9d6d84f7ca96"
Sep 11 04:11:55.043149 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:55.043054    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:55.044254 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:55.044230    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:11:55.195828 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:55.195797    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:55.196157 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:55.196134    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:11:55.197271 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:11:55.197242    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:12:11.084782 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:11.084731    2575 patch_prober.go:28] interesting pod/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:12:11.085145 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:11.084823    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:12:12.159181 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:12.159149    2575 generic.go:356] "Generic (PLEG): container finished" podID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerID="6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa" exitCode=0
Sep 11 04:12:12.159628 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:12.159218    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" event={"ID":"e24af83b-8cdb-48c2-86d3-e537086c7260","Type":"ContainerDied","Data":"6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa"}
Sep 11 04:12:12.159680 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:12.159668    2575 scope.go:117] "RemoveContainer" containerID="6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa"
Sep 11 04:12:12.160805 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:12.160773    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:12:12.160874 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:12.160853    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:12:12.160911 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:12.160883    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:12:13.166868 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:13.166832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" event={"ID":"e24af83b-8cdb-48c2-86d3-e537086c7260","Type":"ContainerStarted","Data":"097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614"}
Sep 11 04:12:13.733948 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:13.733914    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:12:13.734205 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:13.734183    2575 patch_prober.go:28] interesting pod/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 11 04:12:13.734261 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:13.734229    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 11 04:12:14.733811 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:14.733775    2575 patch_prober.go:28] interesting pod/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 11 04:12:14.734282 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:14.733838    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 11 04:12:15.734384 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:15.734304    2575 patch_prober.go:28] interesting pod/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 11 04:12:15.734384 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:15.734358    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 11 04:12:16.733917 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:16.733882    2575 patch_prober.go:28] interesting pod/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 11 04:12:16.734111 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:16.733937    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 11 04:12:17.733584 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:17.733542    2575 patch_prober.go:28] interesting pod/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 11 04:12:17.734082 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:17.733626    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 11 04:12:18.736890 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:18.736861    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:12:18.737284 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:18.737178    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:12:18.737725 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:18.737708    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:12:23.677859 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:23.677825    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"]
Sep 11 04:12:23.681338 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:23.681320    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"
Sep 11 04:12:23.684491 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:23.684464    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:12:23.690967 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:23.690941    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"]
Sep 11 04:12:23.757075 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:23.757029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b4cf314-04bf-4a4d-9e2d-221819678deb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r\" (UID: \"8b4cf314-04bf-4a4d-9e2d-221819678deb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"
Sep 11 04:12:23.857919 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:23.857880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b4cf314-04bf-4a4d-9e2d-221819678deb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r\" (UID: \"8b4cf314-04bf-4a4d-9e2d-221819678deb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"
Sep 11 04:12:23.858469 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:23.858449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b4cf314-04bf-4a4d-9e2d-221819678deb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r\" (UID: \"8b4cf314-04bf-4a4d-9e2d-221819678deb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"
Sep 11 04:12:23.994117 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:23.994091    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"
Sep 11 04:12:24.270356 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:24.270334    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"]
Sep 11 04:12:24.272118 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:12:24.272095    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b4cf314_04bf_4a4d_9e2d_221819678deb.slice/crio-e8ffaae5ddacccbb7bbfb8bcfae3d55b99bd59198c6f7cc5052a710e5f9236fe WatchSource:0}: Error finding container e8ffaae5ddacccbb7bbfb8bcfae3d55b99bd59198c6f7cc5052a710e5f9236fe: Status 404 returned error can't find the container with id e8ffaae5ddacccbb7bbfb8bcfae3d55b99bd59198c6f7cc5052a710e5f9236fe
Sep 11 04:12:25.253266 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:25.253177    2575 generic.go:356] "Generic (PLEG): container finished" podID="8b4cf314-04bf-4a4d-9e2d-221819678deb" containerID="6e25cc8ee532482c99ee43c054e54289718002ff21d245b91fd8d9195a71195d" exitCode=0
Sep 11 04:12:25.253266 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:25.253219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r" event={"ID":"8b4cf314-04bf-4a4d-9e2d-221819678deb","Type":"ContainerDied","Data":"6e25cc8ee532482c99ee43c054e54289718002ff21d245b91fd8d9195a71195d"}
Sep 11 04:12:25.253729 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:25.253276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r" event={"ID":"8b4cf314-04bf-4a4d-9e2d-221819678deb","Type":"ContainerStarted","Data":"e8ffaae5ddacccbb7bbfb8bcfae3d55b99bd59198c6f7cc5052a710e5f9236fe"}
Sep 11 04:12:26.393860 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:26.393829    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"
Sep 11 04:12:26.481101 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:26.481071    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b4cf314-04bf-4a4d-9e2d-221819678deb-maas-api-service-ca\") pod \"8b4cf314-04bf-4a4d-9e2d-221819678deb\" (UID: \"8b4cf314-04bf-4a4d-9e2d-221819678deb\") "
Sep 11 04:12:26.481407 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:26.481385    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b4cf314-04bf-4a4d-9e2d-221819678deb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b4cf314-04bf-4a4d-9e2d-221819678deb" (UID: "8b4cf314-04bf-4a4d-9e2d-221819678deb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:12:26.582083 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:26.582018    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b4cf314-04bf-4a4d-9e2d-221819678deb-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:27.266975 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:27.266946    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"
Sep 11 04:12:27.267148 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:27.266982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r" event={"ID":"8b4cf314-04bf-4a4d-9e2d-221819678deb","Type":"ContainerDied","Data":"e8ffaae5ddacccbb7bbfb8bcfae3d55b99bd59198c6f7cc5052a710e5f9236fe"}
Sep 11 04:12:27.267148 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:27.267030    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8ffaae5ddacccbb7bbfb8bcfae3d55b99bd59198c6f7cc5052a710e5f9236fe"
Sep 11 04:12:39.200587 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.200550    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"]
Sep 11 04:12:39.201034 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.200836    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn" podUID="bd51e040-3a2a-47a9-b297-c384302f543f" containerName="payload-processing" containerID="cri-o://5af368f70827c94d3db2246e9ba8207301f01e8718baac1463a74e30e28d513f" gracePeriod=30
Sep 11 04:12:39.336369 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.336334    2575 generic.go:356] "Generic (PLEG): container finished" podID="bd51e040-3a2a-47a9-b297-c384302f543f" containerID="5af368f70827c94d3db2246e9ba8207301f01e8718baac1463a74e30e28d513f" exitCode=0
Sep 11 04:12:39.336536 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.336508    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn" event={"ID":"bd51e040-3a2a-47a9-b297-c384302f543f","Type":"ContainerDied","Data":"5af368f70827c94d3db2246e9ba8207301f01e8718baac1463a74e30e28d513f"}
Sep 11 04:12:39.394434 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.394400    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"]
Sep 11 04:12:39.398728 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.398699    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7eaac-gf49r"]
Sep 11 04:12:39.455787 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.455733    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:12:39.596307 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.596276    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd51e040-3a2a-47a9-b297-c384302f543f-plugins-config-volume\") pod \"bd51e040-3a2a-47a9-b297-c384302f543f\" (UID: \"bd51e040-3a2a-47a9-b297-c384302f543f\") "
Sep 11 04:12:39.596307 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.596324    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5prk6\" (UniqueName: \"kubernetes.io/projected/bd51e040-3a2a-47a9-b297-c384302f543f-kube-api-access-5prk6\") pod \"bd51e040-3a2a-47a9-b297-c384302f543f\" (UID: \"bd51e040-3a2a-47a9-b297-c384302f543f\") "
Sep 11 04:12:39.596747 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.596721    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd51e040-3a2a-47a9-b297-c384302f543f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bd51e040-3a2a-47a9-b297-c384302f543f" (UID: "bd51e040-3a2a-47a9-b297-c384302f543f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:12:39.598583 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.598560    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd51e040-3a2a-47a9-b297-c384302f543f-kube-api-access-5prk6" (OuterVolumeSpecName: "kube-api-access-5prk6") pod "bd51e040-3a2a-47a9-b297-c384302f543f" (UID: "bd51e040-3a2a-47a9-b297-c384302f543f"). InnerVolumeSpecName "kube-api-access-5prk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:12:39.697524 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.697489    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd51e040-3a2a-47a9-b297-c384302f543f-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:39.697736 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:39.697580    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5prk6\" (UniqueName: \"kubernetes.io/projected/bd51e040-3a2a-47a9-b297-c384302f543f-kube-api-access-5prk6\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:40.344014 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:40.343982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn" event={"ID":"bd51e040-3a2a-47a9-b297-c384302f543f","Type":"ContainerDied","Data":"78e077a6a779cd6ad5fc78631bd4983cf0a6f3ba9af8ed87f3b1ccbe88fb5fda"}
Sep 11 04:12:40.344474 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:40.344037    2575 scope.go:117] "RemoveContainer" containerID="5af368f70827c94d3db2246e9ba8207301f01e8718baac1463a74e30e28d513f"
Sep 11 04:12:40.344474 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:40.343998    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"
Sep 11 04:12:40.371130 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:40.371100    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"]
Sep 11 04:12:40.373569 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:40.373550    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn"]
Sep 11 04:12:40.633726 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:40.633653    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b4cf314-04bf-4a4d-9e2d-221819678deb" path="/var/lib/kubelet/pods/8b4cf314-04bf-4a4d-9e2d-221819678deb/volumes"
Sep 11 04:12:40.634025 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:40.634012    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd51e040-3a2a-47a9-b297-c384302f543f" path="/var/lib/kubelet/pods/bd51e040-3a2a-47a9-b297-c384302f543f/volumes"
Sep 11 04:12:46.199312 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.199277    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"]
Sep 11 04:12:46.199799 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.199563    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy" containerID="cri-o://01e96618e10918ec783cf7178d422bb8973bc221332c5b91752607fd8ec1df5d" gracePeriod=30
Sep 11 04:12:46.551971 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.551941    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"]
Sep 11 04:12:46.552357 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.552345    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b4cf314-04bf-4a4d-9e2d-221819678deb" containerName="revoke-keys"
Sep 11 04:12:46.552401 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.552359    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b4cf314-04bf-4a4d-9e2d-221819678deb" containerName="revoke-keys"
Sep 11 04:12:46.552401 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.552377    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd51e040-3a2a-47a9-b297-c384302f543f" containerName="payload-processing"
Sep 11 04:12:46.552401 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.552383    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd51e040-3a2a-47a9-b297-c384302f543f" containerName="payload-processing"
Sep 11 04:12:46.552495 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.552441    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd51e040-3a2a-47a9-b297-c384302f543f" containerName="payload-processing"
Sep 11 04:12:46.552495 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.552453    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b4cf314-04bf-4a4d-9e2d-221819678deb" containerName="revoke-keys"
Sep 11 04:12:46.556766 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.556750    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"
Sep 11 04:12:46.559372 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.559351    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:12:46.566379 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.566351    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"]
Sep 11 04:12:46.660341 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.660304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa40820-ab53-44e9-b4c9-5cccc3ab46ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t\" (UID: \"1aa40820-ab53-44e9-b4c9-5cccc3ab46ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"
Sep 11 04:12:46.761301 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.761260    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa40820-ab53-44e9-b4c9-5cccc3ab46ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t\" (UID: \"1aa40820-ab53-44e9-b4c9-5cccc3ab46ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"
Sep 11 04:12:46.761899 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.761878    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa40820-ab53-44e9-b4c9-5cccc3ab46ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t\" (UID: \"1aa40820-ab53-44e9-b4c9-5cccc3ab46ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"
Sep 11 04:12:46.869250 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:46.869182    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"
Sep 11 04:12:47.143792 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:47.143769    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"]
Sep 11 04:12:47.144996 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:12:47.144967    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa40820_ab53_44e9_b4c9_5cccc3ab46ea.slice/crio-9739a8cc85ac7bf9184997d7665872d47cfc5b02f1af03d50f91072f89c92c58 WatchSource:0}: Error finding container 9739a8cc85ac7bf9184997d7665872d47cfc5b02f1af03d50f91072f89c92c58: Status 404 returned error can't find the container with id 9739a8cc85ac7bf9184997d7665872d47cfc5b02f1af03d50f91072f89c92c58
Sep 11 04:12:47.387086 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:47.387054    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t" event={"ID":"1aa40820-ab53-44e9-b4c9-5cccc3ab46ea","Type":"ContainerStarted","Data":"9739a8cc85ac7bf9184997d7665872d47cfc5b02f1af03d50f91072f89c92c58"}
Sep 11 04:12:48.394072 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:48.394029    2575 generic.go:356] "Generic (PLEG): container finished" podID="1aa40820-ab53-44e9-b4c9-5cccc3ab46ea" containerID="e574ed6822edbec8f9fee894310f90768ea1eb3c46cf15e55f493d17719d96e3" exitCode=0
Sep 11 04:12:48.394452 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:48.394112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t" event={"ID":"1aa40820-ab53-44e9-b4c9-5cccc3ab46ea","Type":"ContainerDied","Data":"e574ed6822edbec8f9fee894310f90768ea1eb3c46cf15e55f493d17719d96e3"}
Sep 11 04:12:49.539414 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:49.539390    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"
Sep 11 04:12:49.687185 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:49.687104    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa40820-ab53-44e9-b4c9-5cccc3ab46ea-maas-api-service-ca\") pod \"1aa40820-ab53-44e9-b4c9-5cccc3ab46ea\" (UID: \"1aa40820-ab53-44e9-b4c9-5cccc3ab46ea\") "
Sep 11 04:12:49.687449 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:49.687417    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aa40820-ab53-44e9-b4c9-5cccc3ab46ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1aa40820-ab53-44e9-b4c9-5cccc3ab46ea" (UID: "1aa40820-ab53-44e9-b4c9-5cccc3ab46ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:12:49.687536 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:49.687522    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa40820-ab53-44e9-b4c9-5cccc3ab46ea-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:50.406458 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:50.406432    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"
Sep 11 04:12:50.406655 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:50.406431    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t" event={"ID":"1aa40820-ab53-44e9-b4c9-5cccc3ab46ea","Type":"ContainerDied","Data":"9739a8cc85ac7bf9184997d7665872d47cfc5b02f1af03d50f91072f89c92c58"}
Sep 11 04:12:50.406655 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:50.406549    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9739a8cc85ac7bf9184997d7665872d47cfc5b02f1af03d50f91072f89c92c58"
Sep 11 04:12:51.415308 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.415268    2575 generic.go:356] "Generic (PLEG): container finished" podID="37f7132a-6df6-43db-b787-0cfd584545b6" containerID="01e96618e10918ec783cf7178d422bb8973bc221332c5b91752607fd8ec1df5d" exitCode=0
Sep 11 04:12:51.415700 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.415336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" event={"ID":"37f7132a-6df6-43db-b787-0cfd584545b6","Type":"ContainerDied","Data":"01e96618e10918ec783cf7178d422bb8973bc221332c5b91752607fd8ec1df5d"}
Sep 11 04:12:51.415700 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.415423    2575 scope.go:117] "RemoveContainer" containerID="c7407b0aee3652a0d4586b265e76ce41f346dca49627f6ea30e823485af08226"
Sep 11 04:12:51.471142 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.471122    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:12:51.605594 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.605557    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-socket\") pod \"37f7132a-6df6-43db-b787-0cfd584545b6\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") "
Sep 11 04:12:51.605778 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.605634    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-data\") pod \"37f7132a-6df6-43db-b787-0cfd584545b6\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") "
Sep 11 04:12:51.605778 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.605667    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-envoy\") pod \"37f7132a-6df6-43db-b787-0cfd584545b6\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") "
Sep 11 04:12:51.605778 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.605704    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f7132a-6df6-43db-b787-0cfd584545b6-istio-podinfo\") pod \"37f7132a-6df6-43db-b787-0cfd584545b6\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") "
Sep 11 04:12:51.605778 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.605736    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-credential-socket\") pod \"37f7132a-6df6-43db-b787-0cfd584545b6\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") "
Sep 11 04:12:51.605778 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.605772    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-istio-token\") pod \"37f7132a-6df6-43db-b787-0cfd584545b6\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") "
Sep 11 04:12:51.606052 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.605819    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f7132a-6df6-43db-b787-0cfd584545b6-istiod-ca-cert\") pod \"37f7132a-6df6-43db-b787-0cfd584545b6\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") "
Sep 11 04:12:51.606052 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.605877    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37f7132a-6df6-43db-b787-0cfd584545b6" (UID: "37f7132a-6df6-43db-b787-0cfd584545b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:12:51.606052 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.605899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-certs\") pod \"37f7132a-6df6-43db-b787-0cfd584545b6\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") "
Sep 11 04:12:51.606052 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.606020    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j54gl\" (UniqueName: \"kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-kube-api-access-j54gl\") pod \"37f7132a-6df6-43db-b787-0cfd584545b6\" (UID: \"37f7132a-6df6-43db-b787-0cfd584545b6\") "
Sep 11 04:12:51.606052 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.606034    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "37f7132a-6df6-43db-b787-0cfd584545b6" (UID: "37f7132a-6df6-43db-b787-0cfd584545b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:12:51.606306 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.606082    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37f7132a-6df6-43db-b787-0cfd584545b6" (UID: "37f7132a-6df6-43db-b787-0cfd584545b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:12:51.606306 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.606171    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37f7132a-6df6-43db-b787-0cfd584545b6" (UID: "37f7132a-6df6-43db-b787-0cfd584545b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:12:51.606306 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.606237    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f7132a-6df6-43db-b787-0cfd584545b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37f7132a-6df6-43db-b787-0cfd584545b6" (UID: "37f7132a-6df6-43db-b787-0cfd584545b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:12:51.606476 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.606449    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f7132a-6df6-43db-b787-0cfd584545b6-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:51.606476 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.606462    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:51.606476 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.606470    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:51.606476 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.606478    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:51.606876 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.606486    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:51.608154 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.608129    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37f7132a-6df6-43db-b787-0cfd584545b6" (UID: "37f7132a-6df6-43db-b787-0cfd584545b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:12:51.608154 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.608137    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "37f7132a-6df6-43db-b787-0cfd584545b6" (UID: "37f7132a-6df6-43db-b787-0cfd584545b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:12:51.608326 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.608219    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37f7132a-6df6-43db-b787-0cfd584545b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37f7132a-6df6-43db-b787-0cfd584545b6" (UID: "37f7132a-6df6-43db-b787-0cfd584545b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:12:51.608414 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.608400    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-kube-api-access-j54gl" (OuterVolumeSpecName: "kube-api-access-j54gl") pod "37f7132a-6df6-43db-b787-0cfd584545b6" (UID: "37f7132a-6df6-43db-b787-0cfd584545b6"). InnerVolumeSpecName "kube-api-access-j54gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:12:51.707442 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.707405    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:51.707442 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.707440    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j54gl\" (UniqueName: \"kubernetes.io/projected/37f7132a-6df6-43db-b787-0cfd584545b6-kube-api-access-j54gl\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:51.707630 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.707454    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f7132a-6df6-43db-b787-0cfd584545b6-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:51.707630 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:51.707466    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f7132a-6df6-43db-b787-0cfd584545b6-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:12:52.422526 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:52.422502    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"
Sep 11 04:12:52.422920 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:52.422549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b" event={"ID":"37f7132a-6df6-43db-b787-0cfd584545b6","Type":"ContainerDied","Data":"a2e498196e21b9f6a31085b7be3fc155d2d577dee1cc57dabac2fec741c745dc"}
Sep 11 04:12:52.422920 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:52.422623    2575 scope.go:117] "RemoveContainer" containerID="01e96618e10918ec783cf7178d422bb8973bc221332c5b91752607fd8ec1df5d"
Sep 11 04:12:52.447719 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:52.447687    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"]
Sep 11 04:12:52.450239 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:52.450221    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b"]
Sep 11 04:12:52.638979 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:52.634996    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" path="/var/lib/kubelet/pods/37f7132a-6df6-43db-b787-0cfd584545b6/volumes"
Sep 11 04:12:54.893224 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:54.893185    2575 scope.go:117] "RemoveContainer" containerID="eef9e01d4f98d183463fb1926735eb50c0889a12134fd63ff0e0321400d50189"
Sep 11 04:12:54.902179 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:54.902160    2575 scope.go:117] "RemoveContainer" containerID="e873de78d7cb6ac3e656f5e4230671ce6c1f85a9f2e7dd040a9511a2937ff65b"
Sep 11 04:12:54.910839 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:12:54.910813    2575 scope.go:117] "RemoveContainer" containerID="a488dac4ecabc3cea7139af257328c46027706a77b4c4f4e6759d6e12c336696"
Sep 11 04:13:02.620167 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:02.620127    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"]
Sep 11 04:13:02.622738 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:02.622707    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4c6f83-hcv7t"]
Sep 11 04:13:02.632130 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:02.632105    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aa40820-ab53-44e9-b4c9-5cccc3ab46ea" path="/var/lib/kubelet/pods/1aa40820-ab53-44e9-b4c9-5cccc3ab46ea/volumes"
Sep 11 04:13:09.240078 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.240044    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"]
Sep 11 04:13:09.240540 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.240242    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy" containerID="cri-o://097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614" gracePeriod=30
Sep 11 04:13:09.571475 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.571382    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"]
Sep 11 04:13:09.571890 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.571871    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy"
Sep 11 04:13:09.571996 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.571892    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy"
Sep 11 04:13:09.571996 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.571906    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa40820-ab53-44e9-b4c9-5cccc3ab46ea" containerName="revoke-keys"
Sep 11 04:13:09.571996 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.571914    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa40820-ab53-44e9-b4c9-5cccc3ab46ea" containerName="revoke-keys"
Sep 11 04:13:09.572149 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.572078    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy"
Sep 11 04:13:09.572149 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.572091    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aa40820-ab53-44e9-b4c9-5cccc3ab46ea" containerName="revoke-keys"
Sep 11 04:13:09.572149 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.572101    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy"
Sep 11 04:13:09.575465 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.575444    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"
Sep 11 04:13:09.577906 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.577889    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:13:09.582496 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.582472    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"]
Sep 11 04:13:09.673133 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.673104    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286dfda1-0a76-4a77-9b1c-87027d18f326-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl\" (UID: \"286dfda1-0a76-4a77-9b1c-87027d18f326\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"
Sep 11 04:13:09.773977 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.773944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286dfda1-0a76-4a77-9b1c-87027d18f326-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl\" (UID: \"286dfda1-0a76-4a77-9b1c-87027d18f326\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"
Sep 11 04:13:09.774574 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.774554    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286dfda1-0a76-4a77-9b1c-87027d18f326-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl\" (UID: \"286dfda1-0a76-4a77-9b1c-87027d18f326\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"
Sep 11 04:13:09.888660 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:09.888538    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"
Sep 11 04:13:10.161517 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:10.161486    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"]
Sep 11 04:13:10.162799 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:13:10.162772    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286dfda1_0a76_4a77_9b1c_87027d18f326.slice/crio-9f6354af53279ecd50dcefd65ff70f162fbbd8ff78d3ce11c1cbe67e278e624f WatchSource:0}: Error finding container 9f6354af53279ecd50dcefd65ff70f162fbbd8ff78d3ce11c1cbe67e278e624f: Status 404 returned error can't find the container with id 9f6354af53279ecd50dcefd65ff70f162fbbd8ff78d3ce11c1cbe67e278e624f
Sep 11 04:13:10.527285 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:10.527251    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl" event={"ID":"286dfda1-0a76-4a77-9b1c-87027d18f326","Type":"ContainerStarted","Data":"91c59c14c346e9dd614f38c98c2cd9367096481d09675f7feab68ea356ca6457"}
Sep 11 04:13:10.527702 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:10.527311    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl" event={"ID":"286dfda1-0a76-4a77-9b1c-87027d18f326","Type":"ContainerStarted","Data":"9f6354af53279ecd50dcefd65ff70f162fbbd8ff78d3ce11c1cbe67e278e624f"}
Sep 11 04:13:10.543668 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:10.543610    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl" podStartSLOduration=1.543582314 podStartE2EDuration="1.543582314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:13:10.541536758 +0000 UTC m=+1396.419729061" watchObservedRunningTime="2026-09-11 04:13:10.543582314 +0000 UTC m=+1396.421774615"
Sep 11 04:13:11.534474 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:11.534436    2575 generic.go:356] "Generic (PLEG): container finished" podID="286dfda1-0a76-4a77-9b1c-87027d18f326" containerID="91c59c14c346e9dd614f38c98c2cd9367096481d09675f7feab68ea356ca6457" exitCode=0
Sep 11 04:13:11.534957 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:11.534519    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl" event={"ID":"286dfda1-0a76-4a77-9b1c-87027d18f326","Type":"ContainerDied","Data":"91c59c14c346e9dd614f38c98c2cd9367096481d09675f7feab68ea356ca6457"}
Sep 11 04:13:12.676047 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:12.676024    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"
Sep 11 04:13:12.700885 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:12.700856    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286dfda1-0a76-4a77-9b1c-87027d18f326-maas-api-service-ca\") pod \"286dfda1-0a76-4a77-9b1c-87027d18f326\" (UID: \"286dfda1-0a76-4a77-9b1c-87027d18f326\") "
Sep 11 04:13:12.701252 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:12.701226    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/286dfda1-0a76-4a77-9b1c-87027d18f326-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "286dfda1-0a76-4a77-9b1c-87027d18f326" (UID: "286dfda1-0a76-4a77-9b1c-87027d18f326"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:13:12.802564 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:12.802475    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286dfda1-0a76-4a77-9b1c-87027d18f326-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:13.547796 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:13.547769    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"
Sep 11 04:13:13.547963 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:13.547804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl" event={"ID":"286dfda1-0a76-4a77-9b1c-87027d18f326","Type":"ContainerDied","Data":"9f6354af53279ecd50dcefd65ff70f162fbbd8ff78d3ce11c1cbe67e278e624f"}
Sep 11 04:13:13.547963 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:13.547847    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f6354af53279ecd50dcefd65ff70f162fbbd8ff78d3ce11c1cbe67e278e624f"
Sep 11 04:13:14.497438 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.497406    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:13:14.556854 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.556769    2575 generic.go:356] "Generic (PLEG): container finished" podID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerID="097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614" exitCode=0
Sep 11 04:13:14.556996 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.556880    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"
Sep 11 04:13:14.556996 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.556911    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" event={"ID":"e24af83b-8cdb-48c2-86d3-e537086c7260","Type":"ContainerDied","Data":"097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614"}
Sep 11 04:13:14.556996 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.556953    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6" event={"ID":"e24af83b-8cdb-48c2-86d3-e537086c7260","Type":"ContainerDied","Data":"736148186d89fd0d15b973e6d6d1ade21fc8aec05be0541d1116340ec0bc5292"}
Sep 11 04:13:14.556996 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.556974    2575 scope.go:117] "RemoveContainer" containerID="097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614"
Sep 11 04:13:14.566310 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.566291    2575 scope.go:117] "RemoveContainer" containerID="6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa"
Sep 11 04:13:14.574746 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.574721    2575 scope.go:117] "RemoveContainer" containerID="097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614"
Sep 11 04:13:14.575016 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:13:14.574999    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614\": container with ID starting with 097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614 not found: ID does not exist" containerID="097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614"
Sep 11 04:13:14.575063 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.575025    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614"} err="failed to get container status \"097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614\": rpc error: code = NotFound desc = could not find container \"097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614\": container with ID starting with 097d97c30ffd61646274e48cf4c7925b757ce9f62c24fb1bf6d9ed0d5281e614 not found: ID does not exist"
Sep 11 04:13:14.575063 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.575040    2575 scope.go:117] "RemoveContainer" containerID="6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa"
Sep 11 04:13:14.575268 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:13:14.575254    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa\": container with ID starting with 6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa not found: ID does not exist" containerID="6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa"
Sep 11 04:13:14.575305 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.575273    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa"} err="failed to get container status \"6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa\": rpc error: code = NotFound desc = could not find container \"6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa\": container with ID starting with 6b0b5919373adfccd4a90d048ed5830ce5c07c1678210f0a76a0ca436e6dabfa not found: ID does not exist"
Sep 11 04:13:14.619292 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619271    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkcnx\" (UniqueName: \"kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-kube-api-access-mkcnx\") pod \"e24af83b-8cdb-48c2-86d3-e537086c7260\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") "
Sep 11 04:13:14.619371 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619311    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-credential-socket\") pod \"e24af83b-8cdb-48c2-86d3-e537086c7260\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") "
Sep 11 04:13:14.619371 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619333    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e24af83b-8cdb-48c2-86d3-e537086c7260-istiod-ca-cert\") pod \"e24af83b-8cdb-48c2-86d3-e537086c7260\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") "
Sep 11 04:13:14.619458 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619370    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-token\") pod \"e24af83b-8cdb-48c2-86d3-e537086c7260\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") "
Sep 11 04:13:14.619458 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619389    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-socket\") pod \"e24af83b-8cdb-48c2-86d3-e537086c7260\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") "
Sep 11 04:13:14.619458 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619420    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-podinfo\") pod \"e24af83b-8cdb-48c2-86d3-e537086c7260\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") "
Sep 11 04:13:14.619628 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619472    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-data\") pod \"e24af83b-8cdb-48c2-86d3-e537086c7260\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") "
Sep 11 04:13:14.619628 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619505    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-certs\") pod \"e24af83b-8cdb-48c2-86d3-e537086c7260\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") "
Sep 11 04:13:14.619628 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619559    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-envoy\") pod \"e24af83b-8cdb-48c2-86d3-e537086c7260\" (UID: \"e24af83b-8cdb-48c2-86d3-e537086c7260\") "
Sep 11 04:13:14.619628 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619561    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e24af83b-8cdb-48c2-86d3-e537086c7260" (UID: "e24af83b-8cdb-48c2-86d3-e537086c7260"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:13:14.619846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619677    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e24af83b-8cdb-48c2-86d3-e537086c7260" (UID: "e24af83b-8cdb-48c2-86d3-e537086c7260"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:13:14.619846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619789    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-data" (OuterVolumeSpecName: "istio-data") pod "e24af83b-8cdb-48c2-86d3-e537086c7260" (UID: "e24af83b-8cdb-48c2-86d3-e537086c7260"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:13:14.619846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619799    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e24af83b-8cdb-48c2-86d3-e537086c7260-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e24af83b-8cdb-48c2-86d3-e537086c7260" (UID: "e24af83b-8cdb-48c2-86d3-e537086c7260"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:13:14.620012 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619918    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:14.620012 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619954    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e24af83b-8cdb-48c2-86d3-e537086c7260-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:14.620012 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619967    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:14.620012 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.619978    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:14.620384 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.620141    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e24af83b-8cdb-48c2-86d3-e537086c7260" (UID: "e24af83b-8cdb-48c2-86d3-e537086c7260"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:13:14.621611 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.621572    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-token" (OuterVolumeSpecName: "istio-token") pod "e24af83b-8cdb-48c2-86d3-e537086c7260" (UID: "e24af83b-8cdb-48c2-86d3-e537086c7260"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:13:14.621710 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.621594    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-kube-api-access-mkcnx" (OuterVolumeSpecName: "kube-api-access-mkcnx") pod "e24af83b-8cdb-48c2-86d3-e537086c7260" (UID: "e24af83b-8cdb-48c2-86d3-e537086c7260"). InnerVolumeSpecName "kube-api-access-mkcnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:13:14.621753 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.621721    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e24af83b-8cdb-48c2-86d3-e537086c7260" (UID: "e24af83b-8cdb-48c2-86d3-e537086c7260"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:13:14.621982 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.621962    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e24af83b-8cdb-48c2-86d3-e537086c7260" (UID: "e24af83b-8cdb-48c2-86d3-e537086c7260"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:13:14.720611 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.720585    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:14.720711 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.720628    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:14.720711 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.720637    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:14.720711 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.720645    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e24af83b-8cdb-48c2-86d3-e537086c7260-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:14.720711 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.720654    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkcnx\" (UniqueName: \"kubernetes.io/projected/e24af83b-8cdb-48c2-86d3-e537086c7260-kube-api-access-mkcnx\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:14.875330 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.875253    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"]
Sep 11 04:13:14.878720 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:14.878696    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6"]
Sep 11 04:13:16.632689 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:16.632655    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" path="/var/lib/kubelet/pods/e24af83b-8cdb-48c2-86d3-e537086c7260/volumes"
Sep 11 04:13:20.198397 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.198361    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"]
Sep 11 04:13:20.198815 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.198657    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x" podUID="671b291c-a584-4aef-b120-863800f2c463" containerName="payload-processing" containerID="cri-o://dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186" gracePeriod=30
Sep 11 04:13:20.359946 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.359905    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"]
Sep 11 04:13:20.362151 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.362120    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-68ec26-q9qzl"]
Sep 11 04:13:20.460592 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.460536    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:13:20.574199 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.574168    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/671b291c-a584-4aef-b120-863800f2c463-plugins-config-volume\") pod \"671b291c-a584-4aef-b120-863800f2c463\" (UID: \"671b291c-a584-4aef-b120-863800f2c463\") "
Sep 11 04:13:20.574366 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.574205    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jdjs\" (UniqueName: \"kubernetes.io/projected/671b291c-a584-4aef-b120-863800f2c463-kube-api-access-2jdjs\") pod \"671b291c-a584-4aef-b120-863800f2c463\" (UID: \"671b291c-a584-4aef-b120-863800f2c463\") "
Sep 11 04:13:20.574537 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.574512    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/671b291c-a584-4aef-b120-863800f2c463-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "671b291c-a584-4aef-b120-863800f2c463" (UID: "671b291c-a584-4aef-b120-863800f2c463"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:13:20.576502 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.576483    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/671b291c-a584-4aef-b120-863800f2c463-kube-api-access-2jdjs" (OuterVolumeSpecName: "kube-api-access-2jdjs") pod "671b291c-a584-4aef-b120-863800f2c463" (UID: "671b291c-a584-4aef-b120-863800f2c463"). InnerVolumeSpecName "kube-api-access-2jdjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:13:20.594060 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.594035    2575 generic.go:356] "Generic (PLEG): container finished" podID="671b291c-a584-4aef-b120-863800f2c463" containerID="dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186" exitCode=0
Sep 11 04:13:20.594165 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.594083    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"
Sep 11 04:13:20.594165 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.594126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x" event={"ID":"671b291c-a584-4aef-b120-863800f2c463","Type":"ContainerDied","Data":"dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186"}
Sep 11 04:13:20.594297 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.594186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x" event={"ID":"671b291c-a584-4aef-b120-863800f2c463","Type":"ContainerDied","Data":"86ec0c071a28deddee92db7eb7e91ccd453458edcdb71c5c3aeef122ceb63015"}
Sep 11 04:13:20.594297 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.594218    2575 scope.go:117] "RemoveContainer" containerID="dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186"
Sep 11 04:13:20.603590 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.603573    2575 scope.go:117] "RemoveContainer" containerID="dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186"
Sep 11 04:13:20.603910 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:13:20.603893    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186\": container with ID starting with dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186 not found: ID does not exist" containerID="dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186"
Sep 11 04:13:20.603961 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.603916    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186"} err="failed to get container status \"dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186\": rpc error: code = NotFound desc = could not find container \"dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186\": container with ID starting with dcc63013e592d49780f71219273eb3b9392f292cd64f8f37bbef84e1afce9186 not found: ID does not exist"
Sep 11 04:13:20.616266 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.616242    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"]
Sep 11 04:13:20.621718 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.621686    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x"]
Sep 11 04:13:20.631943 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.631920    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="286dfda1-0a76-4a77-9b1c-87027d18f326" path="/var/lib/kubelet/pods/286dfda1-0a76-4a77-9b1c-87027d18f326/volumes"
Sep 11 04:13:20.632261 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.632248    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="671b291c-a584-4aef-b120-863800f2c463" path="/var/lib/kubelet/pods/671b291c-a584-4aef-b120-863800f2c463/volumes"
Sep 11 04:13:20.675515 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.675493    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/671b291c-a584-4aef-b120-863800f2c463-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:20.675621 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:20.675516    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jdjs\" (UniqueName: \"kubernetes.io/projected/671b291c-a584-4aef-b120-863800f2c463-kube-api-access-2jdjs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:22.699706 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.699673    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"]
Sep 11 04:13:22.700246 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700225    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286dfda1-0a76-4a77-9b1c-87027d18f326" containerName="revoke-keys"
Sep 11 04:13:22.700246 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700248    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="286dfda1-0a76-4a77-9b1c-87027d18f326" containerName="revoke-keys"
Sep 11 04:13:22.700368 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700268    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="671b291c-a584-4aef-b120-863800f2c463" containerName="payload-processing"
Sep 11 04:13:22.700368 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700274    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="671b291c-a584-4aef-b120-863800f2c463" containerName="payload-processing"
Sep 11 04:13:22.700368 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700282    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy"
Sep 11 04:13:22.700368 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700289    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f7132a-6df6-43db-b787-0cfd584545b6" containerName="istio-proxy"
Sep 11 04:13:22.700368 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700298    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy"
Sep 11 04:13:22.700368 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700302    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy"
Sep 11 04:13:22.700368 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700310    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy"
Sep 11 04:13:22.700368 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700315    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy"
Sep 11 04:13:22.700808 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700381    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="286dfda1-0a76-4a77-9b1c-87027d18f326" containerName="revoke-keys"
Sep 11 04:13:22.700808 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700389    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="671b291c-a584-4aef-b120-863800f2c463" containerName="payload-processing"
Sep 11 04:13:22.700808 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700396    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy"
Sep 11 04:13:22.700808 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.700402    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e24af83b-8cdb-48c2-86d3-e537086c7260" containerName="istio-proxy"
Sep 11 04:13:22.704676 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.704656    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.707371 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.707343    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-ef4b62-openshift-default-dockercfg-v72nm\""
Sep 11 04:13:22.716278 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.716255    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"]
Sep 11 04:13:22.795070 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.795041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/137d9cad-2318-4c78-aae1-6e67b2887034-istio-podinfo\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.795070 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.795075    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-certs\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.795331 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.795103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/137d9cad-2318-4c78-aae1-6e67b2887034-istiod-ca-cert\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.795331 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.795128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-data\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.795331 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.795153    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kmc4\" (UniqueName: \"kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-kube-api-access-6kmc4\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.795331 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.795225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-istio-token\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.795331 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.795242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-envoy\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.795331 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.795257    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-socket\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.795331 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.795289    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-credential-socket\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.896442 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.896405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/137d9cad-2318-4c78-aae1-6e67b2887034-istiod-ca-cert\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.896442 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.896448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-data\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.896712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.896467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kmc4\" (UniqueName: \"kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-kube-api-access-6kmc4\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.896712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.896539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-istio-token\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.896712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.896571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-envoy\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.896712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.896626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-socket\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.896712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.896710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-credential-socket\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.897015 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.896758    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/137d9cad-2318-4c78-aae1-6e67b2887034-istio-podinfo\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.897015 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.896792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-certs\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.897015 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.896922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-data\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.897139 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.897029    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-socket\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.897139 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.897115    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-credential-socket\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.897206 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.897144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-certs\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.897275 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.897256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/137d9cad-2318-4c78-aae1-6e67b2887034-istiod-ca-cert\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.899017 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.898989    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-envoy\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.899264 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.899249    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/137d9cad-2318-4c78-aae1-6e67b2887034-istio-podinfo\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.905693 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.905664    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-istio-token\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:22.905840 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:22.905824    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kmc4\" (UniqueName: \"kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-kube-api-access-6kmc4\") pod \"e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") " pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:23.016302 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:23.016274    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:23.298719 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:23.298695    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"]
Sep 11 04:13:23.299711 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:13:23.299672    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137d9cad_2318_4c78_aae1_6e67b2887034.slice/crio-fe016424b7a1c1ec85ffafef6821db22611f936a5e0de4b5a660319e03deda3c WatchSource:0}: Error finding container fe016424b7a1c1ec85ffafef6821db22611f936a5e0de4b5a660319e03deda3c: Status 404 returned error can't find the container with id fe016424b7a1c1ec85ffafef6821db22611f936a5e0de4b5a660319e03deda3c
Sep 11 04:13:23.302022 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:23.301991    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:13:23.302103 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:23.302053    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:13:23.302103 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:23.302079    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:13:23.613902 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:23.613816    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" event={"ID":"137d9cad-2318-4c78-aae1-6e67b2887034","Type":"ContainerStarted","Data":"395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622"}
Sep 11 04:13:23.613902 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:23.613868    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" event={"ID":"137d9cad-2318-4c78-aae1-6e67b2887034","Type":"ContainerStarted","Data":"fe016424b7a1c1ec85ffafef6821db22611f936a5e0de4b5a660319e03deda3c"}
Sep 11 04:13:23.634546 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:23.634496    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" podStartSLOduration=1.634480773 podStartE2EDuration="1.634480773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:13:23.632470288 +0000 UTC m=+1409.510662590" watchObservedRunningTime="2026-09-11 04:13:23.634480773 +0000 UTC m=+1409.512673074"
Sep 11 04:13:24.017405 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:24.017375    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:24.022689 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:24.022665    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:24.620051 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:24.620019    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:24.620978 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:24.620958    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:27.675343 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.675261    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"]
Sep 11 04:13:27.679813 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.679783    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:13:27.682768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.682727    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-ef4b62\""
Sep 11 04:13:27.683153 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.682838    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-ef4b62-dockercfg-n7gmb\""
Sep 11 04:13:27.689663 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.689632    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"]
Sep 11 04:13:27.741663 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.741631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6ffcf4-8612-4b01-866c-b5df5db57bba-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj\" (UID: \"ad6ffcf4-8612-4b01-866c-b5df5db57bba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:13:27.741827 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.741674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsx6t\" (UniqueName: \"kubernetes.io/projected/ad6ffcf4-8612-4b01-866c-b5df5db57bba-kube-api-access-wsx6t\") pod \"payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj\" (UID: \"ad6ffcf4-8612-4b01-866c-b5df5db57bba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:13:27.785668 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.785638    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"]
Sep 11 04:13:27.789168 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.789152    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"
Sep 11 04:13:27.791574 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.791555    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:13:27.797506 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.797481    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"]
Sep 11 04:13:27.843105 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.843079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6ffcf4-8612-4b01-866c-b5df5db57bba-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj\" (UID: \"ad6ffcf4-8612-4b01-866c-b5df5db57bba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:13:27.843256 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.843114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsx6t\" (UniqueName: \"kubernetes.io/projected/ad6ffcf4-8612-4b01-866c-b5df5db57bba-kube-api-access-wsx6t\") pod \"payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj\" (UID: \"ad6ffcf4-8612-4b01-866c-b5df5db57bba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:13:27.843894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.843875    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6ffcf4-8612-4b01-866c-b5df5db57bba-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj\" (UID: \"ad6ffcf4-8612-4b01-866c-b5df5db57bba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:13:27.864947 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.864924    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsx6t\" (UniqueName: \"kubernetes.io/projected/ad6ffcf4-8612-4b01-866c-b5df5db57bba-kube-api-access-wsx6t\") pod \"payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj\" (UID: \"ad6ffcf4-8612-4b01-866c-b5df5db57bba\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:13:27.944693 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.944596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4c6c6-7300-449b-9f28-d3804bcfba6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6\" (UID: \"e4a4c6c6-7300-449b-9f28-d3804bcfba6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"
Sep 11 04:13:27.994714 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:27.994686    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:13:28.046157 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:28.046117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4c6c6-7300-449b-9f28-d3804bcfba6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6\" (UID: \"e4a4c6c6-7300-449b-9f28-d3804bcfba6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"
Sep 11 04:13:28.047082 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:28.047042    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4c6c6-7300-449b-9f28-d3804bcfba6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6\" (UID: \"e4a4c6c6-7300-449b-9f28-d3804bcfba6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"
Sep 11 04:13:28.101388 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:28.101357    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"
Sep 11 04:13:28.289776 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:28.289746    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"]
Sep 11 04:13:28.294508 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:13:28.294479    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6ffcf4_8612_4b01_866c_b5df5db57bba.slice/crio-809180b71695cd48dcdb064565a1174425bfdf229468261bb0e22d19b65c4fe9 WatchSource:0}: Error finding container 809180b71695cd48dcdb064565a1174425bfdf229468261bb0e22d19b65c4fe9: Status 404 returned error can't find the container with id 809180b71695cd48dcdb064565a1174425bfdf229468261bb0e22d19b65c4fe9
Sep 11 04:13:28.381098 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:28.381069    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"]
Sep 11 04:13:28.382829 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:13:28.382798    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a4c6c6_7300_449b_9f28_d3804bcfba6c.slice/crio-4a6244b9d1aa5f22632ebd3aa92e888eaef7061565516d117437cf6a49a53368 WatchSource:0}: Error finding container 4a6244b9d1aa5f22632ebd3aa92e888eaef7061565516d117437cf6a49a53368: Status 404 returned error can't find the container with id 4a6244b9d1aa5f22632ebd3aa92e888eaef7061565516d117437cf6a49a53368
Sep 11 04:13:28.644088 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:28.644047    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj" event={"ID":"ad6ffcf4-8612-4b01-866c-b5df5db57bba","Type":"ContainerStarted","Data":"d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48"}
Sep 11 04:13:28.644260 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:28.644096    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj" event={"ID":"ad6ffcf4-8612-4b01-866c-b5df5db57bba","Type":"ContainerStarted","Data":"809180b71695cd48dcdb064565a1174425bfdf229468261bb0e22d19b65c4fe9"}
Sep 11 04:13:28.644260 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:28.644135    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:13:28.645436 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:28.645412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6" event={"ID":"e4a4c6c6-7300-449b-9f28-d3804bcfba6c","Type":"ContainerStarted","Data":"4a6244b9d1aa5f22632ebd3aa92e888eaef7061565516d117437cf6a49a53368"}
Sep 11 04:13:28.663139 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:28.663094    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj" podStartSLOduration=1.66307934 podStartE2EDuration="1.66307934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:13:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:13:28.661280062 +0000 UTC m=+1414.539472364" watchObservedRunningTime="2026-09-11 04:13:28.66307934 +0000 UTC m=+1414.541271646"
Sep 11 04:13:29.659980 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:29.659945    2575 generic.go:356] "Generic (PLEG): container finished" podID="e4a4c6c6-7300-449b-9f28-d3804bcfba6c" containerID="5eebd52474fd6ae8f27b95f4f96b8f3b77cc650cec8dfec740e51965f9d37d93" exitCode=0
Sep 11 04:13:29.660338 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:29.660001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6" event={"ID":"e4a4c6c6-7300-449b-9f28-d3804bcfba6c","Type":"ContainerDied","Data":"5eebd52474fd6ae8f27b95f4f96b8f3b77cc650cec8dfec740e51965f9d37d93"}
Sep 11 04:13:30.802284 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:30.802259    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"
Sep 11 04:13:30.873283 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:30.873257    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4c6c6-7300-449b-9f28-d3804bcfba6c-maas-api-service-ca\") pod \"e4a4c6c6-7300-449b-9f28-d3804bcfba6c\" (UID: \"e4a4c6c6-7300-449b-9f28-d3804bcfba6c\") "
Sep 11 04:13:30.873632 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:30.873583    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4a4c6c6-7300-449b-9f28-d3804bcfba6c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e4a4c6c6-7300-449b-9f28-d3804bcfba6c" (UID: "e4a4c6c6-7300-449b-9f28-d3804bcfba6c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:13:30.974965 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:30.974934    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4c6c6-7300-449b-9f28-d3804bcfba6c-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:31.672593 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:31.672568    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"
Sep 11 04:13:31.672764 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:31.672630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6" event={"ID":"e4a4c6c6-7300-449b-9f28-d3804bcfba6c","Type":"ContainerDied","Data":"4a6244b9d1aa5f22632ebd3aa92e888eaef7061565516d117437cf6a49a53368"}
Sep 11 04:13:31.672764 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:31.672673    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a6244b9d1aa5f22632ebd3aa92e888eaef7061565516d117437cf6a49a53368"
Sep 11 04:13:38.311729 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.311694    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"]
Sep 11 04:13:38.312521 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.312083    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl" podUID="82b275fc-fd22-4d45-a64c-f6c256703356" containerName="payload-processing" containerID="cri-o://37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921" gracePeriod=30
Sep 11 04:13:38.318662 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.318634    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"]
Sep 11 04:13:38.318895 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.318869    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq" podUID="a07155fa-f0c4-4ccc-936f-a75b73e85196" containerName="payload-pre-processing" containerID="cri-o://812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50" gracePeriod=30
Sep 11 04:13:38.510380 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.510305    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"]
Sep 11 04:13:38.515155 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.514416    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-604323-8gdl6"]
Sep 11 04:13:38.616614 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.616577    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:13:38.633680 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.633653    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4a4c6c6-7300-449b-9f28-d3804bcfba6c" path="/var/lib/kubelet/pods/e4a4c6c6-7300-449b-9f28-d3804bcfba6c/volumes"
Sep 11 04:13:38.656652 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.656630    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:13:38.717364 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.717329    2575 generic.go:356] "Generic (PLEG): container finished" podID="82b275fc-fd22-4d45-a64c-f6c256703356" containerID="37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921" exitCode=0
Sep 11 04:13:38.717563 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.717377    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"
Sep 11 04:13:38.717563 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.717419    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl" event={"ID":"82b275fc-fd22-4d45-a64c-f6c256703356","Type":"ContainerDied","Data":"37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921"}
Sep 11 04:13:38.717563 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.717477    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl" event={"ID":"82b275fc-fd22-4d45-a64c-f6c256703356","Type":"ContainerDied","Data":"e4a6e62935352a16f11f8e0d87ea790c5b7d5d67573f31e0c4d815f5c52377ef"}
Sep 11 04:13:38.717563 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.717507    2575 scope.go:117] "RemoveContainer" containerID="37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921"
Sep 11 04:13:38.719663 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.719641    2575 generic.go:356] "Generic (PLEG): container finished" podID="a07155fa-f0c4-4ccc-936f-a75b73e85196" containerID="812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50" exitCode=0
Sep 11 04:13:38.719993 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.719715    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq" event={"ID":"a07155fa-f0c4-4ccc-936f-a75b73e85196","Type":"ContainerDied","Data":"812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50"}
Sep 11 04:13:38.719993 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.719745    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq" event={"ID":"a07155fa-f0c4-4ccc-936f-a75b73e85196","Type":"ContainerDied","Data":"fa3dc2181e8ee0f971dfb89c7cb3491de2ae2bcd1c372682cd35ab5b1525710e"}
Sep 11 04:13:38.719993 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.719766    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"
Sep 11 04:13:38.730752 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.730730    2575 scope.go:117] "RemoveContainer" containerID="37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921"
Sep 11 04:13:38.731102 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:13:38.731077    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921\": container with ID starting with 37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921 not found: ID does not exist" containerID="37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921"
Sep 11 04:13:38.731183 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.731117    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921"} err="failed to get container status \"37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921\": rpc error: code = NotFound desc = could not find container \"37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921\": container with ID starting with 37937c89ff122f299b43551eb73632c91215ddbb8ce1984dc24dde0428d43921 not found: ID does not exist"
Sep 11 04:13:38.731183 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.731139    2575 scope.go:117] "RemoveContainer" containerID="812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50"
Sep 11 04:13:38.739487 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.739470    2575 scope.go:117] "RemoveContainer" containerID="812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50"
Sep 11 04:13:38.739806 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:13:38.739790    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50\": container with ID starting with 812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50 not found: ID does not exist" containerID="812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50"
Sep 11 04:13:38.739860 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.739811    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50"} err="failed to get container status \"812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50\": rpc error: code = NotFound desc = could not find container \"812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50\": container with ID starting with 812806e1edf1afb42d10cd578b38b0a2d61362673e47d8c1960781434499bb50 not found: ID does not exist"
Sep 11 04:13:38.747242 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.747219    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82b275fc-fd22-4d45-a64c-f6c256703356-plugins-config-volume\") pod \"82b275fc-fd22-4d45-a64c-f6c256703356\" (UID: \"82b275fc-fd22-4d45-a64c-f6c256703356\") "
Sep 11 04:13:38.747323 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.747282    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4mx9\" (UniqueName: \"kubernetes.io/projected/82b275fc-fd22-4d45-a64c-f6c256703356-kube-api-access-r4mx9\") pod \"82b275fc-fd22-4d45-a64c-f6c256703356\" (UID: \"82b275fc-fd22-4d45-a64c-f6c256703356\") "
Sep 11 04:13:38.747374 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.747365    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a07155fa-f0c4-4ccc-936f-a75b73e85196-plugins-config-volume\") pod \"a07155fa-f0c4-4ccc-936f-a75b73e85196\" (UID: \"a07155fa-f0c4-4ccc-936f-a75b73e85196\") "
Sep 11 04:13:38.747452 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.747436    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxvtv\" (UniqueName: \"kubernetes.io/projected/a07155fa-f0c4-4ccc-936f-a75b73e85196-kube-api-access-bxvtv\") pod \"a07155fa-f0c4-4ccc-936f-a75b73e85196\" (UID: \"a07155fa-f0c4-4ccc-936f-a75b73e85196\") "
Sep 11 04:13:38.747668 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.747646    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b275fc-fd22-4d45-a64c-f6c256703356-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "82b275fc-fd22-4d45-a64c-f6c256703356" (UID: "82b275fc-fd22-4d45-a64c-f6c256703356"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:13:38.747768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.747724    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a07155fa-f0c4-4ccc-936f-a75b73e85196-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a07155fa-f0c4-4ccc-936f-a75b73e85196" (UID: "a07155fa-f0c4-4ccc-936f-a75b73e85196"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:13:38.748044 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.747997    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a07155fa-f0c4-4ccc-936f-a75b73e85196-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:38.748044 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.748034    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82b275fc-fd22-4d45-a64c-f6c256703356-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:38.749588 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.749562    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b275fc-fd22-4d45-a64c-f6c256703356-kube-api-access-r4mx9" (OuterVolumeSpecName: "kube-api-access-r4mx9") pod "82b275fc-fd22-4d45-a64c-f6c256703356" (UID: "82b275fc-fd22-4d45-a64c-f6c256703356"). InnerVolumeSpecName "kube-api-access-r4mx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:13:38.749588 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.749592    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a07155fa-f0c4-4ccc-936f-a75b73e85196-kube-api-access-bxvtv" (OuterVolumeSpecName: "kube-api-access-bxvtv") pod "a07155fa-f0c4-4ccc-936f-a75b73e85196" (UID: "a07155fa-f0c4-4ccc-936f-a75b73e85196"). InnerVolumeSpecName "kube-api-access-bxvtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:13:38.849102 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.849020    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxvtv\" (UniqueName: \"kubernetes.io/projected/a07155fa-f0c4-4ccc-936f-a75b73e85196-kube-api-access-bxvtv\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:38.849102 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:38.849047    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4mx9\" (UniqueName: \"kubernetes.io/projected/82b275fc-fd22-4d45-a64c-f6c256703356-kube-api-access-r4mx9\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:13:39.042333 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:39.042300    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"]
Sep 11 04:13:39.044734 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:39.044711    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl"]
Sep 11 04:13:39.053274 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:39.053249    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"]
Sep 11 04:13:39.059047 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:39.059023    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq"]
Sep 11 04:13:39.662948 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:39.662865    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:13:40.632768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:40.632730    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b275fc-fd22-4d45-a64c-f6c256703356" path="/var/lib/kubelet/pods/82b275fc-fd22-4d45-a64c-f6c256703356/volumes"
Sep 11 04:13:40.633112 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:40.633097    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a07155fa-f0c4-4ccc-936f-a75b73e85196" path="/var/lib/kubelet/pods/a07155fa-f0c4-4ccc-936f-a75b73e85196/volumes"
Sep 11 04:13:45.766010 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:45.765924    2575 generic.go:356] "Generic (PLEG): container finished" podID="137d9cad-2318-4c78-aae1-6e67b2887034" containerID="395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622" exitCode=0
Sep 11 04:13:45.766532 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:45.766000    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" event={"ID":"137d9cad-2318-4c78-aae1-6e67b2887034","Type":"ContainerDied","Data":"395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622"}
Sep 11 04:13:45.766532 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:45.766490    2575 scope.go:117] "RemoveContainer" containerID="395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622"
Sep 11 04:13:45.767698 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:45.767666    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:13:45.767794 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:45.767768    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:13:45.767836 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:45.767815    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:13:46.773284 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:46.773245    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" event={"ID":"137d9cad-2318-4c78-aae1-6e67b2887034","Type":"ContainerStarted","Data":"cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d"}
Sep 11 04:13:47.017155 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:47.017119    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:47.017385 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:47.017361    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 11 04:13:47.017432 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:47.017415    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 11 04:13:48.017274 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:48.017241    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 11 04:13:48.017703 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:48.017297    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 11 04:13:49.016648 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:49.016594    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 11 04:13:49.016832 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:49.016674    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 11 04:13:50.017168 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:50.017132    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 11 04:13:50.017590 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:50.017189    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 11 04:13:51.016763 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:51.016721    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 11 04:13:51.016971 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:51.016785    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 11 04:13:52.024876 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:52.024838    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:52.025638 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:52.025592    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:52.026893 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:52.026846    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:13:56.266712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.266684    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"]
Sep 11 04:13:56.267092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.267050    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b275fc-fd22-4d45-a64c-f6c256703356" containerName="payload-processing"
Sep 11 04:13:56.267092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.267062    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b275fc-fd22-4d45-a64c-f6c256703356" containerName="payload-processing"
Sep 11 04:13:56.267092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.267078    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4a4c6c6-7300-449b-9f28-d3804bcfba6c" containerName="revoke-keys"
Sep 11 04:13:56.267092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.267083    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4a4c6c6-7300-449b-9f28-d3804bcfba6c" containerName="revoke-keys"
Sep 11 04:13:56.267227 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.267101    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07155fa-f0c4-4ccc-936f-a75b73e85196" containerName="payload-pre-processing"
Sep 11 04:13:56.267227 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.267108    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07155fa-f0c4-4ccc-936f-a75b73e85196" containerName="payload-pre-processing"
Sep 11 04:13:56.267227 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.267168    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4a4c6c6-7300-449b-9f28-d3804bcfba6c" containerName="revoke-keys"
Sep 11 04:13:56.267227 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.267177    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a07155fa-f0c4-4ccc-936f-a75b73e85196" containerName="payload-pre-processing"
Sep 11 04:13:56.267227 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.267184    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b275fc-fd22-4d45-a64c-f6c256703356" containerName="payload-processing"
Sep 11 04:13:56.271762 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.271746    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:13:56.274805 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.274770    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-85dc29-dockercfg-fqp7n\""
Sep 11 04:13:56.274947 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.274922    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-85dc29\""
Sep 11 04:13:56.283087 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.281720    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"]
Sep 11 04:13:56.302880 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.302850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v\" (UID: \"1c719dd4-3cec-4be1-b66d-cce3cf3c764a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:13:56.302987 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.302905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5dxx\" (UniqueName: \"kubernetes.io/projected/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-kube-api-access-s5dxx\") pod \"payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v\" (UID: \"1c719dd4-3cec-4be1-b66d-cce3cf3c764a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:13:56.403358 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.403322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5dxx\" (UniqueName: \"kubernetes.io/projected/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-kube-api-access-s5dxx\") pod \"payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v\" (UID: \"1c719dd4-3cec-4be1-b66d-cce3cf3c764a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:13:56.403534 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.403405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v\" (UID: \"1c719dd4-3cec-4be1-b66d-cce3cf3c764a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:13:56.404074 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.404055    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v\" (UID: \"1c719dd4-3cec-4be1-b66d-cce3cf3c764a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:13:56.413281 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.413252    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5dxx\" (UniqueName: \"kubernetes.io/projected/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-kube-api-access-s5dxx\") pod \"payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v\" (UID: \"1c719dd4-3cec-4be1-b66d-cce3cf3c764a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:13:56.588743 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.588674    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:13:56.866938 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:56.866913    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"]
Sep 11 04:13:56.868826 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:13:56.868798    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c719dd4_3cec_4be1_b66d_cce3cf3c764a.slice/crio-a38c1b5db9e324fee35155e4ac3e29c8b1e087ca0f3a8a80d508dbc388dca94e WatchSource:0}: Error finding container a38c1b5db9e324fee35155e4ac3e29c8b1e087ca0f3a8a80d508dbc388dca94e: Status 404 returned error can't find the container with id a38c1b5db9e324fee35155e4ac3e29c8b1e087ca0f3a8a80d508dbc388dca94e
Sep 11 04:13:57.852139 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:57.852107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v" event={"ID":"1c719dd4-3cec-4be1-b66d-cce3cf3c764a","Type":"ContainerStarted","Data":"976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87"}
Sep 11 04:13:57.852642 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:57.852164    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:13:57.852642 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:57.852183    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v" event={"ID":"1c719dd4-3cec-4be1-b66d-cce3cf3c764a","Type":"ContainerStarted","Data":"a38c1b5db9e324fee35155e4ac3e29c8b1e087ca0f3a8a80d508dbc388dca94e"}
Sep 11 04:13:57.870978 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:13:57.870933    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v" podStartSLOduration=1.8709203030000001 podStartE2EDuration="1.870920303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:13:57.868633426 +0000 UTC m=+1443.746825729" watchObservedRunningTime="2026-09-11 04:13:57.870920303 +0000 UTC m=+1443.749112643"
Sep 11 04:14:08.862319 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:14:08.862283    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:14:54.720120 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:14:54.720089    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 04:14:54.721676 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:14:54.721652    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 04:15:00.141871 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.141834    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp"]
Sep 11 04:15:00.145396 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.145373    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd"]
Sep 11 04:15:00.145542 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.145487    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp"
Sep 11 04:15:00.148145 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.148123    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:15:00.149282 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.149265    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7"]
Sep 11 04:15:00.149392 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.149373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd"
Sep 11 04:15:00.155261 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.154580    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7"
Sep 11 04:15:00.156530 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.156477    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp"]
Sep 11 04:15:00.160005 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.159849    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd"]
Sep 11 04:15:00.160796 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.160778    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp"
Sep 11 04:15:00.162833 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.162810    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7"]
Sep 11 04:15:00.171118 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.171096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd"
Sep 11 04:15:00.205544 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.205518    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7"
Sep 11 04:15:00.449344 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.449321    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp"]
Sep 11 04:15:00.451342 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:15:00.451318    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6fe9dec_fbce_4518_a438_6d71f081042e.slice/crio-1bfdaa5814c5be57d2e8ff5cc511042a3057b63190b84e649505a7d6058a9686 WatchSource:0}: Error finding container 1bfdaa5814c5be57d2e8ff5cc511042a3057b63190b84e649505a7d6058a9686: Status 404 returned error can't find the container with id 1bfdaa5814c5be57d2e8ff5cc511042a3057b63190b84e649505a7d6058a9686
Sep 11 04:15:00.459812 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.459791    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd"]
Sep 11 04:15:00.464692 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:15:00.464664    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6302e99_e61e_45fb_9da1_2a53d1d95ef7.slice/crio-966a51470aab64b6577fafc59eda0c7756857f50d26f95630976699b643361d1 WatchSource:0}: Error finding container 966a51470aab64b6577fafc59eda0c7756857f50d26f95630976699b643361d1: Status 404 returned error can't find the container with id 966a51470aab64b6577fafc59eda0c7756857f50d26f95630976699b643361d1
Sep 11 04:15:00.499774 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:00.499751    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7"]
Sep 11 04:15:01.233675 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:01.233640    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd" event={"ID":"c6302e99-e61e-45fb-9da1-2a53d1d95ef7","Type":"ContainerStarted","Data":"4f54f3700193d89c0881f3d136c52678bab12c57cd2382c769149820ea6c2e65"}
Sep 11 04:15:01.234103 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:01.233702    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd" event={"ID":"c6302e99-e61e-45fb-9da1-2a53d1d95ef7","Type":"ContainerStarted","Data":"966a51470aab64b6577fafc59eda0c7756857f50d26f95630976699b643361d1"}
Sep 11 04:15:01.235245 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:01.235215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7" event={"ID":"e8a0afd5-c64f-462c-b461-cb4a10b90b0a","Type":"ContainerStarted","Data":"eeac95ae1e09649c5e0c6bfbb437118bea474e9c703dd24456ffd0df0e9a6152"}
Sep 11 04:15:01.235382 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:01.235265    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7" event={"ID":"e8a0afd5-c64f-462c-b461-cb4a10b90b0a","Type":"ContainerStarted","Data":"6f5655feddc864e9677428b88e4a80ab869416fa71ddea1e4f1870525db16376"}
Sep 11 04:15:01.236689 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:01.236668    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp" event={"ID":"c6fe9dec-fbce-4518-a438-6d71f081042e","Type":"ContainerStarted","Data":"f80edaca87376460efa94e1d466d90238824b380851b6cfcfaaf3832587321e1"}
Sep 11 04:15:01.236783 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:01.236713    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp" event={"ID":"c6fe9dec-fbce-4518-a438-6d71f081042e","Type":"ContainerStarted","Data":"1bfdaa5814c5be57d2e8ff5cc511042a3057b63190b84e649505a7d6058a9686"}
Sep 11 04:15:01.250078 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:01.250038    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd" podStartSLOduration=1.250025814 podStartE2EDuration="1.250025814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:15:01.248227819 +0000 UTC m=+1507.126420120" watchObservedRunningTime="2026-09-11 04:15:01.250025814 +0000 UTC m=+1507.128218147"
Sep 11 04:15:01.263692 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:01.263654    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7" podStartSLOduration=1.263641856 podStartE2EDuration="1.263641856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:15:01.262109462 +0000 UTC m=+1507.140301766" watchObservedRunningTime="2026-09-11 04:15:01.263641856 +0000 UTC m=+1507.141834157"
Sep 11 04:15:01.278686 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:01.278573    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp" podStartSLOduration=1.2785562289999999 podStartE2EDuration="1.278556229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:15:01.278215869 +0000 UTC m=+1507.156408172" watchObservedRunningTime="2026-09-11 04:15:01.278556229 +0000 UTC m=+1507.156748532"
Sep 11 04:15:02.244829 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:02.244798    2575 generic.go:356] "Generic (PLEG): container finished" podID="e8a0afd5-c64f-462c-b461-cb4a10b90b0a" containerID="eeac95ae1e09649c5e0c6bfbb437118bea474e9c703dd24456ffd0df0e9a6152" exitCode=0
Sep 11 04:15:02.245288 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:02.244885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7" event={"ID":"e8a0afd5-c64f-462c-b461-cb4a10b90b0a","Type":"ContainerDied","Data":"eeac95ae1e09649c5e0c6bfbb437118bea474e9c703dd24456ffd0df0e9a6152"}
Sep 11 04:15:02.246389 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:02.246361    2575 generic.go:356] "Generic (PLEG): container finished" podID="c6fe9dec-fbce-4518-a438-6d71f081042e" containerID="f80edaca87376460efa94e1d466d90238824b380851b6cfcfaaf3832587321e1" exitCode=0
Sep 11 04:15:02.246494 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:02.246422    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp" event={"ID":"c6fe9dec-fbce-4518-a438-6d71f081042e","Type":"ContainerDied","Data":"f80edaca87376460efa94e1d466d90238824b380851b6cfcfaaf3832587321e1"}
Sep 11 04:15:02.254685 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:02.254659    2575 generic.go:356] "Generic (PLEG): container finished" podID="c6302e99-e61e-45fb-9da1-2a53d1d95ef7" containerID="4f54f3700193d89c0881f3d136c52678bab12c57cd2382c769149820ea6c2e65" exitCode=0
Sep 11 04:15:02.254822 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:02.254742    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd" event={"ID":"c6302e99-e61e-45fb-9da1-2a53d1d95ef7","Type":"ContainerDied","Data":"4f54f3700193d89c0881f3d136c52678bab12c57cd2382c769149820ea6c2e65"}
Sep 11 04:15:03.398141 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:03.398114    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp"
Sep 11 04:15:03.450448 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:03.450417    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7"
Sep 11 04:15:03.453248 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:03.453231    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd"
Sep 11 04:15:04.268186 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:04.268155    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7"
Sep 11 04:15:04.268359 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:04.268155    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7" event={"ID":"e8a0afd5-c64f-462c-b461-cb4a10b90b0a","Type":"ContainerDied","Data":"6f5655feddc864e9677428b88e4a80ab869416fa71ddea1e4f1870525db16376"}
Sep 11 04:15:04.268359 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:04.268290    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f5655feddc864e9677428b88e4a80ab869416fa71ddea1e4f1870525db16376"
Sep 11 04:15:04.269547 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:04.269527    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp"
Sep 11 04:15:04.269697 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:04.269571    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp" event={"ID":"c6fe9dec-fbce-4518-a438-6d71f081042e","Type":"ContainerDied","Data":"1bfdaa5814c5be57d2e8ff5cc511042a3057b63190b84e649505a7d6058a9686"}
Sep 11 04:15:04.269697 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:04.269642    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bfdaa5814c5be57d2e8ff5cc511042a3057b63190b84e649505a7d6058a9686"
Sep 11 04:15:04.270956 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:04.270926    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd"
Sep 11 04:15:04.271044 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:04.270978    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd" event={"ID":"c6302e99-e61e-45fb-9da1-2a53d1d95ef7","Type":"ContainerDied","Data":"966a51470aab64b6577fafc59eda0c7756857f50d26f95630976699b643361d1"}
Sep 11 04:15:04.271044 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:04.271014    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="966a51470aab64b6577fafc59eda0c7756857f50d26f95630976699b643361d1"
Sep 11 04:15:10.283103 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:10.283077    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj_ad6ffcf4-8612-4b01-866c-b5df5db57bba/payload-processing/0.log"
Sep 11 04:15:11.054160 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.054123    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"]
Sep 11 04:15:11.054580 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.054566    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6fe9dec-fbce-4518-a438-6d71f081042e" containerName="cleanup"
Sep 11 04:15:11.054656 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.054581    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6fe9dec-fbce-4518-a438-6d71f081042e" containerName="cleanup"
Sep 11 04:15:11.054656 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.054619    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a0afd5-c64f-462c-b461-cb4a10b90b0a" containerName="cleanup"
Sep 11 04:15:11.054656 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.054625    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a0afd5-c64f-462c-b461-cb4a10b90b0a" containerName="cleanup"
Sep 11 04:15:11.054656 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.054634    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6302e99-e61e-45fb-9da1-2a53d1d95ef7" containerName="cleanup"
Sep 11 04:15:11.054656 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.054639    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6302e99-e61e-45fb-9da1-2a53d1d95ef7" containerName="cleanup"
Sep 11 04:15:11.054814 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.054712    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8a0afd5-c64f-462c-b461-cb4a10b90b0a" containerName="cleanup"
Sep 11 04:15:11.054814 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.054721    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6fe9dec-fbce-4518-a438-6d71f081042e" containerName="cleanup"
Sep 11 04:15:11.054814 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.054730    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6302e99-e61e-45fb-9da1-2a53d1d95ef7" containerName="cleanup"
Sep 11 04:15:11.058085 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.058062    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.061960 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.061942    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-27c12d-openshift-default-dockercfg-455n9\""
Sep 11 04:15:11.081780 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.081759    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"]
Sep 11 04:15:11.186559 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.186520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-socket\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.186559 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.186560    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-certs\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.186801 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.186645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-podinfo\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.186801 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.186685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istiod-ca-cert\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.186801 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.186761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-data\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.186941 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.186853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-credential-socket\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.186941 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.186889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-token\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.186941 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.186924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-envoy\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.187040 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.186993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86nxb\" (UniqueName: \"kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-kube-api-access-86nxb\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.287667 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.287595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-token\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288123 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.287683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-envoy\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288123 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.287712    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nxb\" (UniqueName: \"kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-kube-api-access-86nxb\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288123 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.287749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-socket\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288123 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.287771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-certs\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288123 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.287794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-podinfo\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288123 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.287913    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istiod-ca-cert\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288123 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.287967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-data\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288123 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.288046    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-credential-socket\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288536 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.288179    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-socket\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288536 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.288226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-certs\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288536 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.288384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-data\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288536 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.288424    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-credential-socket\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.288720 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.288549    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istiod-ca-cert\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.290189 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.290167    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-envoy\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.290357 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.290337    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-podinfo\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.302260 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.302230    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-token\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.302446 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.302429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86nxb\" (UniqueName: \"kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-kube-api-access-86nxb\") pod \"e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") " pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.369268 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.369215    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:11.647805 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.647780    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"]
Sep 11 04:15:11.648490 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:15:11.648468    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16250ad3_e93a_42bc_b56a_e4b6b61fd2ca.slice/crio-c3f7b166d33bc84ec6efe358ea952958af269f3670885dbad653dca38a7d56e6 WatchSource:0}: Error finding container c3f7b166d33bc84ec6efe358ea952958af269f3670885dbad653dca38a7d56e6: Status 404 returned error can't find the container with id c3f7b166d33bc84ec6efe358ea952958af269f3670885dbad653dca38a7d56e6
Sep 11 04:15:11.650716 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.650683    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:15:11.650792 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.650749    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:15:11.650792 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:11.650779    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:15:12.317527 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:12.317491    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" event={"ID":"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca","Type":"ContainerStarted","Data":"17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61"}
Sep 11 04:15:12.317938 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:12.317551    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" event={"ID":"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca","Type":"ContainerStarted","Data":"c3f7b166d33bc84ec6efe358ea952958af269f3670885dbad653dca38a7d56e6"}
Sep 11 04:15:12.340041 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:12.339993    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" podStartSLOduration=1.339977446 podStartE2EDuration="1.339977446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:15:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:15:12.338895118 +0000 UTC m=+1518.217087447" watchObservedRunningTime="2026-09-11 04:15:12.339977446 +0000 UTC m=+1518.218169747"
Sep 11 04:15:12.370346 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:12.370316    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:12.375959 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:12.375938    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:13.324288 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:13.324257    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:13.325202 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:13.325182    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:16.401809 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.401721    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"]
Sep 11 04:15:16.406755 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.406729    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:16.410030 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.409997    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-27c12d-dockercfg-c8fws\""
Sep 11 04:15:16.410300 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.410276    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-27c12d\""
Sep 11 04:15:16.419807 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.419502    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"]
Sep 11 04:15:16.536969 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.536933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk2z2\" (UniqueName: \"kubernetes.io/projected/0a7da20a-c171-492b-ae6a-a9e657645c29-kube-api-access-gk2z2\") pod \"payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs\" (UID: \"0a7da20a-c171-492b-ae6a-a9e657645c29\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:16.537135 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.536977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a7da20a-c171-492b-ae6a-a9e657645c29-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs\" (UID: \"0a7da20a-c171-492b-ae6a-a9e657645c29\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:16.638116 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.638083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk2z2\" (UniqueName: \"kubernetes.io/projected/0a7da20a-c171-492b-ae6a-a9e657645c29-kube-api-access-gk2z2\") pod \"payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs\" (UID: \"0a7da20a-c171-492b-ae6a-a9e657645c29\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:16.638277 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.638123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a7da20a-c171-492b-ae6a-a9e657645c29-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs\" (UID: \"0a7da20a-c171-492b-ae6a-a9e657645c29\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:16.638817 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.638800    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a7da20a-c171-492b-ae6a-a9e657645c29-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs\" (UID: \"0a7da20a-c171-492b-ae6a-a9e657645c29\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:16.647462 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.647434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk2z2\" (UniqueName: \"kubernetes.io/projected/0a7da20a-c171-492b-ae6a-a9e657645c29-kube-api-access-gk2z2\") pod \"payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs\" (UID: \"0a7da20a-c171-492b-ae6a-a9e657645c29\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:16.723998 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.723973    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:16.997784 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:16.997752    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"]
Sep 11 04:15:16.998964 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:15:16.998938    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7da20a_c171_492b_ae6a_a9e657645c29.slice/crio-1de585c21ceb3815122ec47f1eec973a7240726722e55abfb46bd8c558aebf19 WatchSource:0}: Error finding container 1de585c21ceb3815122ec47f1eec973a7240726722e55abfb46bd8c558aebf19: Status 404 returned error can't find the container with id 1de585c21ceb3815122ec47f1eec973a7240726722e55abfb46bd8c558aebf19
Sep 11 04:15:17.348722 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:17.348637    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs" event={"ID":"0a7da20a-c171-492b-ae6a-a9e657645c29","Type":"ContainerStarted","Data":"21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129"}
Sep 11 04:15:17.348722 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:17.348690    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs" event={"ID":"0a7da20a-c171-492b-ae6a-a9e657645c29","Type":"ContainerStarted","Data":"1de585c21ceb3815122ec47f1eec973a7240726722e55abfb46bd8c558aebf19"}
Sep 11 04:15:17.348722 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:17.348709    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:17.366171 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:17.366124    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs" podStartSLOduration=1.366109933 podStartE2EDuration="1.366109933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:15:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:15:17.365097513 +0000 UTC m=+1523.243289819" watchObservedRunningTime="2026-09-11 04:15:17.366109933 +0000 UTC m=+1523.244302235"
Sep 11 04:15:28.356868 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:28.356828    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:32.451046 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:32.451015    2575 generic.go:356] "Generic (PLEG): container finished" podID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerID="17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61" exitCode=0
Sep 11 04:15:32.451453 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:32.451092    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" event={"ID":"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca","Type":"ContainerDied","Data":"17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61"}
Sep 11 04:15:32.451545 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:32.451527    2575 scope.go:117] "RemoveContainer" containerID="17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61"
Sep 11 04:15:32.452771 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:32.452746    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:15:32.452835 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:32.452814    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:15:32.452873 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:32.452843    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 11 04:15:33.458903 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:33.458872    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" event={"ID":"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca","Type":"ContainerStarted","Data":"b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d"}
Sep 11 04:15:34.370003 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:34.369962    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:34.370203 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:34.370154    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 11 04:15:34.370281 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:34.370210    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 11 04:15:35.370195 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:35.370159    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 11 04:15:35.370587 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:35.370216    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 11 04:15:36.370362 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:36.370326    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 11 04:15:36.370788 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:36.370381    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 11 04:15:37.369960 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:37.369926    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 11 04:15:37.370137 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:37.369984    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 11 04:15:38.369493 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:38.369457    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 11 04:15:38.369923 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:38.369512    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 11 04:15:39.373866 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:39.373839    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:39.374338 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:39.374220    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:39.374959 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:39.374939    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:39.845301 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:39.845265    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"]
Sep 11 04:15:39.848962 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:39.848946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"
Sep 11 04:15:39.851407 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:39.851382    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:15:39.855593 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:39.855571    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"]
Sep 11 04:15:39.958486 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:39.958451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4ee9e61-8a99-4e26-aa4a-85cb40562897-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g\" (UID: \"f4ee9e61-8a99-4e26-aa4a-85cb40562897\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"
Sep 11 04:15:40.059255 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:40.059223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4ee9e61-8a99-4e26-aa4a-85cb40562897-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g\" (UID: \"f4ee9e61-8a99-4e26-aa4a-85cb40562897\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"
Sep 11 04:15:40.059941 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:40.059917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4ee9e61-8a99-4e26-aa4a-85cb40562897-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g\" (UID: \"f4ee9e61-8a99-4e26-aa4a-85cb40562897\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"
Sep 11 04:15:40.162801 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:40.162708    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"
Sep 11 04:15:40.445572 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:40.445542    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"]
Sep 11 04:15:40.446745 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:15:40.446718    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ee9e61_8a99_4e26_aa4a_85cb40562897.slice/crio-e46b3509525bd6d4aa8a733c7a0383137f88993b334130abf4c82a01c8b1cbee WatchSource:0}: Error finding container e46b3509525bd6d4aa8a733c7a0383137f88993b334130abf4c82a01c8b1cbee: Status 404 returned error can't find the container with id e46b3509525bd6d4aa8a733c7a0383137f88993b334130abf4c82a01c8b1cbee
Sep 11 04:15:40.528611 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:40.528578    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g" event={"ID":"f4ee9e61-8a99-4e26-aa4a-85cb40562897","Type":"ContainerStarted","Data":"e46b3509525bd6d4aa8a733c7a0383137f88993b334130abf4c82a01c8b1cbee"}
Sep 11 04:15:41.536681 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:41.536647    2575 generic.go:356] "Generic (PLEG): container finished" podID="f4ee9e61-8a99-4e26-aa4a-85cb40562897" containerID="182860f12b0000b1d285fd12afca7281563fe716242c69f55d04f1b72c729173" exitCode=0
Sep 11 04:15:41.537069 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:41.536691    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g" event={"ID":"f4ee9e61-8a99-4e26-aa4a-85cb40562897","Type":"ContainerDied","Data":"182860f12b0000b1d285fd12afca7281563fe716242c69f55d04f1b72c729173"}
Sep 11 04:15:42.682443 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:42.682415    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"
Sep 11 04:15:42.782946 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:42.782916    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4ee9e61-8a99-4e26-aa4a-85cb40562897-maas-api-service-ca\") pod \"f4ee9e61-8a99-4e26-aa4a-85cb40562897\" (UID: \"f4ee9e61-8a99-4e26-aa4a-85cb40562897\") "
Sep 11 04:15:42.783265 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:42.783242    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ee9e61-8a99-4e26-aa4a-85cb40562897-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f4ee9e61-8a99-4e26-aa4a-85cb40562897" (UID: "f4ee9e61-8a99-4e26-aa4a-85cb40562897"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:15:42.883858 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:42.883774    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4ee9e61-8a99-4e26-aa4a-85cb40562897-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:43.550200 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:43.550162    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"
Sep 11 04:15:43.550200 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:43.550173    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g" event={"ID":"f4ee9e61-8a99-4e26-aa4a-85cb40562897","Type":"ContainerDied","Data":"e46b3509525bd6d4aa8a733c7a0383137f88993b334130abf4c82a01c8b1cbee"}
Sep 11 04:15:43.550410 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:43.550215    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e46b3509525bd6d4aa8a733c7a0383137f88993b334130abf4c82a01c8b1cbee"
Sep 11 04:15:45.999233 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:45.999188    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"]
Sep 11 04:15:45.999837 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:45.999407    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs" podUID="0a7da20a-c171-492b-ae6a-a9e657645c29" containerName="payload-processing" containerID="cri-o://21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129" gracePeriod=30
Sep 11 04:15:46.181473 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.181441    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"]
Sep 11 04:15:46.186129 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.186086    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-27c12d-hhj4g"]
Sep 11 04:15:46.256842 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.256780    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:46.317758 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.317730    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a7da20a-c171-492b-ae6a-a9e657645c29-plugins-config-volume\") pod \"0a7da20a-c171-492b-ae6a-a9e657645c29\" (UID: \"0a7da20a-c171-492b-ae6a-a9e657645c29\") "
Sep 11 04:15:46.317901 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.317850    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk2z2\" (UniqueName: \"kubernetes.io/projected/0a7da20a-c171-492b-ae6a-a9e657645c29-kube-api-access-gk2z2\") pod \"0a7da20a-c171-492b-ae6a-a9e657645c29\" (UID: \"0a7da20a-c171-492b-ae6a-a9e657645c29\") "
Sep 11 04:15:46.318157 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.318132    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a7da20a-c171-492b-ae6a-a9e657645c29-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a7da20a-c171-492b-ae6a-a9e657645c29" (UID: "0a7da20a-c171-492b-ae6a-a9e657645c29"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:15:46.320462 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.320412    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a7da20a-c171-492b-ae6a-a9e657645c29-kube-api-access-gk2z2" (OuterVolumeSpecName: "kube-api-access-gk2z2") pod "0a7da20a-c171-492b-ae6a-a9e657645c29" (UID: "0a7da20a-c171-492b-ae6a-a9e657645c29"). InnerVolumeSpecName "kube-api-access-gk2z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:15:46.418744 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.418709    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk2z2\" (UniqueName: \"kubernetes.io/projected/0a7da20a-c171-492b-ae6a-a9e657645c29-kube-api-access-gk2z2\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:46.418744 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.418740    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a7da20a-c171-492b-ae6a-a9e657645c29-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:46.571586 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.571490    2575 generic.go:356] "Generic (PLEG): container finished" podID="0a7da20a-c171-492b-ae6a-a9e657645c29" containerID="21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129" exitCode=0
Sep 11 04:15:46.571586 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.571540    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"
Sep 11 04:15:46.571809 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.571582    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs" event={"ID":"0a7da20a-c171-492b-ae6a-a9e657645c29","Type":"ContainerDied","Data":"21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129"}
Sep 11 04:15:46.571809 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.571646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs" event={"ID":"0a7da20a-c171-492b-ae6a-a9e657645c29","Type":"ContainerDied","Data":"1de585c21ceb3815122ec47f1eec973a7240726722e55abfb46bd8c558aebf19"}
Sep 11 04:15:46.571809 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.571667    2575 scope.go:117] "RemoveContainer" containerID="21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129"
Sep 11 04:15:46.582464 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.582453    2575 scope.go:117] "RemoveContainer" containerID="21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129"
Sep 11 04:15:46.582779 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:15:46.582759    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129\": container with ID starting with 21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129 not found: ID does not exist" containerID="21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129"
Sep 11 04:15:46.582846 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.582788    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129"} err="failed to get container status \"21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129\": rpc error: code = NotFound desc = could not find container \"21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129\": container with ID starting with 21ab54f77cbf8ad52a3e2f45ff43fe806804123d15f61b8d9d0a346219522129 not found: ID does not exist"
Sep 11 04:15:46.599820 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.599794    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"]
Sep 11 04:15:46.609135 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.609114    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs"]
Sep 11 04:15:46.633357 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.633331    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a7da20a-c171-492b-ae6a-a9e657645c29" path="/var/lib/kubelet/pods/0a7da20a-c171-492b-ae6a-a9e657645c29/volumes"
Sep 11 04:15:46.633682 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:46.633669    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4ee9e61-8a99-4e26-aa4a-85cb40562897" path="/var/lib/kubelet/pods/f4ee9e61-8a99-4e26-aa4a-85cb40562897/volumes"
Sep 11 04:15:52.777365 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:52.777327    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"]
Sep 11 04:15:52.777824 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:52.777552    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy" containerID="cri-o://b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d" gracePeriod=30
Sep 11 04:15:54.376151 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:54.376118    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:15:54.376525 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:54.376206    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:15:54.993720 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:54.993689    2575 scope.go:117] "RemoveContainer" containerID="6402c74a6b0d5e0c2d58da742beb8292ba18957c57b8394ca35d56e7c88ffc80"
Sep 11 04:15:56.210163 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.210134    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"]
Sep 11 04:15:56.210540 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.210531    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a7da20a-c171-492b-ae6a-a9e657645c29" containerName="payload-processing"
Sep 11 04:15:56.210584 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.210543    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a7da20a-c171-492b-ae6a-a9e657645c29" containerName="payload-processing"
Sep 11 04:15:56.210584 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.210569    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ee9e61-8a99-4e26-aa4a-85cb40562897" containerName="revoke-keys"
Sep 11 04:15:56.210584 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.210575    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ee9e61-8a99-4e26-aa4a-85cb40562897" containerName="revoke-keys"
Sep 11 04:15:56.210712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.210695    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a7da20a-c171-492b-ae6a-a9e657645c29" containerName="payload-processing"
Sep 11 04:15:56.210712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.210707    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ee9e61-8a99-4e26-aa4a-85cb40562897" containerName="revoke-keys"
Sep 11 04:15:56.215199 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.215183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"
Sep 11 04:15:56.218521 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.218382    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:15:56.221181 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.221163    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"]
Sep 11 04:15:56.311004 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.310975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b17aaea-c161-4b8f-a837-b5488c4f0c64-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh\" (UID: \"2b17aaea-c161-4b8f-a837-b5488c4f0c64\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"
Sep 11 04:15:56.412048 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.412018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b17aaea-c161-4b8f-a837-b5488c4f0c64-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh\" (UID: \"2b17aaea-c161-4b8f-a837-b5488c4f0c64\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"
Sep 11 04:15:56.412621 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.412580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b17aaea-c161-4b8f-a837-b5488c4f0c64-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh\" (UID: \"2b17aaea-c161-4b8f-a837-b5488c4f0c64\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"
Sep 11 04:15:56.528643 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.528577    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"
Sep 11 04:15:56.803965 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:56.803938    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"]
Sep 11 04:15:56.805161 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:15:56.805130    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b17aaea_c161_4b8f_a837_b5488c4f0c64.slice/crio-b1ee6088f5d45e15d0094836d6ae981a17440186035e10abb07e1ff8d31493cd WatchSource:0}: Error finding container b1ee6088f5d45e15d0094836d6ae981a17440186035e10abb07e1ff8d31493cd: Status 404 returned error can't find the container with id b1ee6088f5d45e15d0094836d6ae981a17440186035e10abb07e1ff8d31493cd
Sep 11 04:15:57.649794 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:57.649760    2575 generic.go:356] "Generic (PLEG): container finished" podID="2b17aaea-c161-4b8f-a837-b5488c4f0c64" containerID="f2ef8b0c1f04f64165c08c4a0d8e14e5cbae0feb62b5f8226fb4281f4eef5cb5" exitCode=0
Sep 11 04:15:57.650165 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:57.649862    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh" event={"ID":"2b17aaea-c161-4b8f-a837-b5488c4f0c64","Type":"ContainerDied","Data":"f2ef8b0c1f04f64165c08c4a0d8e14e5cbae0feb62b5f8226fb4281f4eef5cb5"}
Sep 11 04:15:57.650165 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:57.649898    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh" event={"ID":"2b17aaea-c161-4b8f-a837-b5488c4f0c64","Type":"ContainerStarted","Data":"b1ee6088f5d45e15d0094836d6ae981a17440186035e10abb07e1ff8d31493cd"}
Sep 11 04:15:58.032235 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.032208    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:58.125880 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.125802    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-data\") pod \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") "
Sep 11 04:15:58.125880 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.125854    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-credential-socket\") pod \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") "
Sep 11 04:15:58.126076 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.125882    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-envoy\") pod \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") "
Sep 11 04:15:58.126076 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.125900    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-socket\") pod \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") "
Sep 11 04:15:58.126076 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.125935    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86nxb\" (UniqueName: \"kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-kube-api-access-86nxb\") pod \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") "
Sep 11 04:15:58.126076 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.125958    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istiod-ca-cert\") pod \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") "
Sep 11 04:15:58.126076 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.126024    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-podinfo\") pod \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") "
Sep 11 04:15:58.126076 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.126057    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-token\") pod \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") "
Sep 11 04:15:58.126076 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.126064    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" (UID: "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:15:58.126411 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.126214    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" (UID: "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:15:58.126411 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.126232    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-certs\") pod \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\" (UID: \"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca\") "
Sep 11 04:15:58.126556 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.126228    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" (UID: "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:15:58.126556 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.126537    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:58.126695 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.126559    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:58.126695 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.126535    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" (UID: "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:15:58.126695 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.126442    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" (UID: "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:15:58.128217 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.128190    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" (UID: "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:15:58.128322 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.128302    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" (UID: "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:15:58.128747 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.128727    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" (UID: "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:15:58.128831 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.128744    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-kube-api-access-86nxb" (OuterVolumeSpecName: "kube-api-access-86nxb") pod "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" (UID: "16250ad3-e93a-42bc-b56a-e4b6b61fd2ca"). InnerVolumeSpecName "kube-api-access-86nxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:15:58.228012 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.227983    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:58.228012 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.228008    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:58.228012 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.228017    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:58.228217 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.228025    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:58.228217 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.228033    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:58.228217 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.228040    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86nxb\" (UniqueName: \"kubernetes.io/projected/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-kube-api-access-86nxb\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:58.228217 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.228049    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:58.657965 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.657932    2575 generic.go:356] "Generic (PLEG): container finished" podID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerID="b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d" exitCode=0
Sep 11 04:15:58.658336 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.657981    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"
Sep 11 04:15:58.658336 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.658011    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" event={"ID":"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca","Type":"ContainerDied","Data":"b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d"}
Sep 11 04:15:58.658336 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.658070    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b" event={"ID":"16250ad3-e93a-42bc-b56a-e4b6b61fd2ca","Type":"ContainerDied","Data":"c3f7b166d33bc84ec6efe358ea952958af269f3670885dbad653dca38a7d56e6"}
Sep 11 04:15:58.658336 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.658096    2575 scope.go:117] "RemoveContainer" containerID="b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d"
Sep 11 04:15:58.669677 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.669658    2575 scope.go:117] "RemoveContainer" containerID="17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61"
Sep 11 04:15:58.679354 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.679335    2575 scope.go:117] "RemoveContainer" containerID="b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d"
Sep 11 04:15:58.679701 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:15:58.679682    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d\": container with ID starting with b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d not found: ID does not exist" containerID="b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d"
Sep 11 04:15:58.679796 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.679710    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d"} err="failed to get container status \"b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d\": rpc error: code = NotFound desc = could not find container \"b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d\": container with ID starting with b12a59270cef90308c068763f7ef02b851c48d1ed4fbf568f9515ac0d509994d not found: ID does not exist"
Sep 11 04:15:58.679796 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.679730    2575 scope.go:117] "RemoveContainer" containerID="17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61"
Sep 11 04:15:58.680046 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:15:58.680012    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61\": container with ID starting with 17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61 not found: ID does not exist" containerID="17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61"
Sep 11 04:15:58.680152 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.680044    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61"} err="failed to get container status \"17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61\": rpc error: code = NotFound desc = could not find container \"17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61\": container with ID starting with 17c76298818e0f85919d1539ed037483cf1abed7e67165e3369a3f26a3cc4a61 not found: ID does not exist"
Sep 11 04:15:58.680947 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.680923    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"]
Sep 11 04:15:58.684353 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.684331    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b"]
Sep 11 04:15:58.790231 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.790206    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"
Sep 11 04:15:58.933410 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.933337    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b17aaea-c161-4b8f-a837-b5488c4f0c64-maas-api-service-ca\") pod \"2b17aaea-c161-4b8f-a837-b5488c4f0c64\" (UID: \"2b17aaea-c161-4b8f-a837-b5488c4f0c64\") "
Sep 11 04:15:58.933738 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:58.933717    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b17aaea-c161-4b8f-a837-b5488c4f0c64-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b17aaea-c161-4b8f-a837-b5488c4f0c64" (UID: "2b17aaea-c161-4b8f-a837-b5488c4f0c64"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:15:59.034159 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:59.034126    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b17aaea-c161-4b8f-a837-b5488c4f0c64-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:15:59.665991 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:59.665962    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"
Sep 11 04:15:59.666411 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:59.665956    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh" event={"ID":"2b17aaea-c161-4b8f-a837-b5488c4f0c64","Type":"ContainerDied","Data":"b1ee6088f5d45e15d0094836d6ae981a17440186035e10abb07e1ff8d31493cd"}
Sep 11 04:15:59.666411 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:15:59.666093    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1ee6088f5d45e15d0094836d6ae981a17440186035e10abb07e1ff8d31493cd"
Sep 11 04:16:00.635812 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:00.634221    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" path="/var/lib/kubelet/pods/16250ad3-e93a-42bc-b56a-e4b6b61fd2ca/volumes"
Sep 11 04:16:11.746745 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:11.746713    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"]
Sep 11 04:16:11.747203 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:11.746919    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj" podUID="ad6ffcf4-8612-4b01-866c-b5df5db57bba" containerName="payload-processing" containerID="cri-o://d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48" gracePeriod=30
Sep 11 04:16:11.912594 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:11.912557    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"]
Sep 11 04:16:11.915015 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:11.914987    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ef4b62-5mrhh"]
Sep 11 04:16:12.016224 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.016198    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:16:12.151477 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.151440    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsx6t\" (UniqueName: \"kubernetes.io/projected/ad6ffcf4-8612-4b01-866c-b5df5db57bba-kube-api-access-wsx6t\") pod \"ad6ffcf4-8612-4b01-866c-b5df5db57bba\" (UID: \"ad6ffcf4-8612-4b01-866c-b5df5db57bba\") "
Sep 11 04:16:12.151695 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.151543    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6ffcf4-8612-4b01-866c-b5df5db57bba-plugins-config-volume\") pod \"ad6ffcf4-8612-4b01-866c-b5df5db57bba\" (UID: \"ad6ffcf4-8612-4b01-866c-b5df5db57bba\") "
Sep 11 04:16:12.151888 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.151864    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad6ffcf4-8612-4b01-866c-b5df5db57bba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad6ffcf4-8612-4b01-866c-b5df5db57bba" (UID: "ad6ffcf4-8612-4b01-866c-b5df5db57bba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:16:12.153686 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.153660    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad6ffcf4-8612-4b01-866c-b5df5db57bba-kube-api-access-wsx6t" (OuterVolumeSpecName: "kube-api-access-wsx6t") pod "ad6ffcf4-8612-4b01-866c-b5df5db57bba" (UID: "ad6ffcf4-8612-4b01-866c-b5df5db57bba"). InnerVolumeSpecName "kube-api-access-wsx6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:16:12.253230 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.253158    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6ffcf4-8612-4b01-866c-b5df5db57bba-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:16:12.253230 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.253196    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsx6t\" (UniqueName: \"kubernetes.io/projected/ad6ffcf4-8612-4b01-866c-b5df5db57bba-kube-api-access-wsx6t\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:16:12.638779 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.638698    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b17aaea-c161-4b8f-a837-b5488c4f0c64" path="/var/lib/kubelet/pods/2b17aaea-c161-4b8f-a837-b5488c4f0c64/volumes"
Sep 11 04:16:12.744806 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.744772    2575 generic.go:356] "Generic (PLEG): container finished" podID="ad6ffcf4-8612-4b01-866c-b5df5db57bba" containerID="d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48" exitCode=0
Sep 11 04:16:12.744945 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.744810    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj" event={"ID":"ad6ffcf4-8612-4b01-866c-b5df5db57bba","Type":"ContainerDied","Data":"d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48"}
Sep 11 04:16:12.744945 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.744831    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"
Sep 11 04:16:12.744945 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.744865    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj" event={"ID":"ad6ffcf4-8612-4b01-866c-b5df5db57bba","Type":"ContainerDied","Data":"809180b71695cd48dcdb064565a1174425bfdf229468261bb0e22d19b65c4fe9"}
Sep 11 04:16:12.744945 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.744892    2575 scope.go:117] "RemoveContainer" containerID="d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48"
Sep 11 04:16:12.756736 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.755989    2575 scope.go:117] "RemoveContainer" containerID="d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48"
Sep 11 04:16:12.757082 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:16:12.757058    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48\": container with ID starting with d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48 not found: ID does not exist" containerID="d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48"
Sep 11 04:16:12.757147 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.757094    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48"} err="failed to get container status \"d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48\": rpc error: code = NotFound desc = could not find container \"d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48\": container with ID starting with d7186ea2a63ee24ae5c1c5a5fc75eb7ae8af4382b9834f53d1051af57bdbfa48 not found: ID does not exist"
Sep 11 04:16:12.770674 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.770652    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"]
Sep 11 04:16:12.774568 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:12.774547    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj"]
Sep 11 04:16:14.634325 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:16:14.634289    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad6ffcf4-8612-4b01-866c-b5df5db57bba" path="/var/lib/kubelet/pods/ad6ffcf4-8612-4b01-866c-b5df5db57bba/volumes"
Sep 11 04:17:05.769214 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:05.769181    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"]
Sep 11 04:17:05.769683 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:05.769441    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy" containerID="cri-o://cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d" gracePeriod=30
Sep 11 04:17:06.145209 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.145130    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"]
Sep 11 04:17:06.145533 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.145520    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy"
Sep 11 04:17:06.145576 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.145535    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy"
Sep 11 04:17:06.145576 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.145545    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad6ffcf4-8612-4b01-866c-b5df5db57bba" containerName="payload-processing"
Sep 11 04:17:06.145576 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.145550    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad6ffcf4-8612-4b01-866c-b5df5db57bba" containerName="payload-processing"
Sep 11 04:17:06.145576 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.145569    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b17aaea-c161-4b8f-a837-b5488c4f0c64" containerName="revoke-keys"
Sep 11 04:17:06.145576 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.145574    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b17aaea-c161-4b8f-a837-b5488c4f0c64" containerName="revoke-keys"
Sep 11 04:17:06.145762 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.145649    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad6ffcf4-8612-4b01-866c-b5df5db57bba" containerName="payload-processing"
Sep 11 04:17:06.145762 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.145660    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy"
Sep 11 04:17:06.145762 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.145665    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b17aaea-c161-4b8f-a837-b5488c4f0c64" containerName="revoke-keys"
Sep 11 04:17:06.149984 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.149968    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"
Sep 11 04:17:06.152751 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.152731    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:17:06.157308 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.157283    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"]
Sep 11 04:17:06.225446 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.225411    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b63f14-cff8-4f20-bed2-a3c848b51cb1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2\" (UID: \"b1b63f14-cff8-4f20-bed2-a3c848b51cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"
Sep 11 04:17:06.326064 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.326029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b63f14-cff8-4f20-bed2-a3c848b51cb1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2\" (UID: \"b1b63f14-cff8-4f20-bed2-a3c848b51cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"
Sep 11 04:17:06.326691 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.326672    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b63f14-cff8-4f20-bed2-a3c848b51cb1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2\" (UID: \"b1b63f14-cff8-4f20-bed2-a3c848b51cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"
Sep 11 04:17:06.463186 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.463100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"
Sep 11 04:17:06.745074 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:06.745049    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"]
Sep 11 04:17:06.746504 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:17:06.746479    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b63f14_cff8_4f20_bed2_a3c848b51cb1.slice/crio-2e940cff08a0d67628936d23c02dcb43d2c967f3e100f8fc9edc6c4b086a0d86 WatchSource:0}: Error finding container 2e940cff08a0d67628936d23c02dcb43d2c967f3e100f8fc9edc6c4b086a0d86: Status 404 returned error can't find the container with id 2e940cff08a0d67628936d23c02dcb43d2c967f3e100f8fc9edc6c4b086a0d86
Sep 11 04:17:07.028657 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:07.028622    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:17:07.029049 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:07.028681    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:17:07.079159 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:07.079119    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2" event={"ID":"b1b63f14-cff8-4f20-bed2-a3c848b51cb1","Type":"ContainerStarted","Data":"7bcdd344b7534177cbbb8261fe459caca59f7b29c173f1d00c9f25c88f52e6b8"}
Sep 11 04:17:07.079352 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:07.079182    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2" event={"ID":"b1b63f14-cff8-4f20-bed2-a3c848b51cb1","Type":"ContainerStarted","Data":"2e940cff08a0d67628936d23c02dcb43d2c967f3e100f8fc9edc6c4b086a0d86"}
Sep 11 04:17:07.096557 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:07.096507    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2" podStartSLOduration=1.096491006 podStartE2EDuration="1.096491006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:17:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:17:07.093817468 +0000 UTC m=+1632.972009774" watchObservedRunningTime="2026-09-11 04:17:07.096491006 +0000 UTC m=+1632.974683307"
Sep 11 04:17:08.086236 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:08.086205    2575 generic.go:356] "Generic (PLEG): container finished" podID="b1b63f14-cff8-4f20-bed2-a3c848b51cb1" containerID="7bcdd344b7534177cbbb8261fe459caca59f7b29c173f1d00c9f25c88f52e6b8" exitCode=0
Sep 11 04:17:08.086648 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:08.086289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2" event={"ID":"b1b63f14-cff8-4f20-bed2-a3c848b51cb1","Type":"ContainerDied","Data":"7bcdd344b7534177cbbb8261fe459caca59f7b29c173f1d00c9f25c88f52e6b8"}
Sep 11 04:17:09.231402 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:09.231380    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"
Sep 11 04:17:09.251817 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:09.251786    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b63f14-cff8-4f20-bed2-a3c848b51cb1-maas-api-service-ca\") pod \"b1b63f14-cff8-4f20-bed2-a3c848b51cb1\" (UID: \"b1b63f14-cff8-4f20-bed2-a3c848b51cb1\") "
Sep 11 04:17:09.252169 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:09.252143    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1b63f14-cff8-4f20-bed2-a3c848b51cb1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b1b63f14-cff8-4f20-bed2-a3c848b51cb1" (UID: "b1b63f14-cff8-4f20-bed2-a3c848b51cb1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:17:09.353242 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:09.353157    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b63f14-cff8-4f20-bed2-a3c848b51cb1-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:10.099666 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:10.099637    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"
Sep 11 04:17:10.099666 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:10.099648    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2" event={"ID":"b1b63f14-cff8-4f20-bed2-a3c848b51cb1","Type":"ContainerDied","Data":"2e940cff08a0d67628936d23c02dcb43d2c967f3e100f8fc9edc6c4b086a0d86"}
Sep 11 04:17:10.099879 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:10.099695    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e940cff08a0d67628936d23c02dcb43d2c967f3e100f8fc9edc6c4b086a0d86"
Sep 11 04:17:11.034848 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.034790    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:17:11.069442 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.069413    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-credential-socket\") pod \"137d9cad-2318-4c78-aae1-6e67b2887034\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") "
Sep 11 04:17:11.069626 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.069476    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/137d9cad-2318-4c78-aae1-6e67b2887034-istio-podinfo\") pod \"137d9cad-2318-4c78-aae1-6e67b2887034\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") "
Sep 11 04:17:11.069626 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.069506    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-envoy\") pod \"137d9cad-2318-4c78-aae1-6e67b2887034\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") "
Sep 11 04:17:11.069626 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.069532    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kmc4\" (UniqueName: \"kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-kube-api-access-6kmc4\") pod \"137d9cad-2318-4c78-aae1-6e67b2887034\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") "
Sep 11 04:17:11.069795 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.069650    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-data\") pod \"137d9cad-2318-4c78-aae1-6e67b2887034\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") "
Sep 11 04:17:11.069795 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.069694    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "137d9cad-2318-4c78-aae1-6e67b2887034" (UID: "137d9cad-2318-4c78-aae1-6e67b2887034"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:17:11.069795 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.069718    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-certs\") pod \"137d9cad-2318-4c78-aae1-6e67b2887034\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") "
Sep 11 04:17:11.069795 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.069762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-socket\") pod \"137d9cad-2318-4c78-aae1-6e67b2887034\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") "
Sep 11 04:17:11.070008 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.069796    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-istio-token\") pod \"137d9cad-2318-4c78-aae1-6e67b2887034\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") "
Sep 11 04:17:11.070008 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.069824    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/137d9cad-2318-4c78-aae1-6e67b2887034-istiod-ca-cert\") pod \"137d9cad-2318-4c78-aae1-6e67b2887034\" (UID: \"137d9cad-2318-4c78-aae1-6e67b2887034\") "
Sep 11 04:17:11.070008 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.069964    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-data" (OuterVolumeSpecName: "istio-data") pod "137d9cad-2318-4c78-aae1-6e67b2887034" (UID: "137d9cad-2318-4c78-aae1-6e67b2887034"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:17:11.070207 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.070019    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "137d9cad-2318-4c78-aae1-6e67b2887034" (UID: "137d9cad-2318-4c78-aae1-6e67b2887034"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:17:11.070207 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.070189    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:11.070207 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.070198    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "137d9cad-2318-4c78-aae1-6e67b2887034" (UID: "137d9cad-2318-4c78-aae1-6e67b2887034"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:17:11.070359 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.070208    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:11.070359 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.070223    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:11.070359 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.070288    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/137d9cad-2318-4c78-aae1-6e67b2887034-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "137d9cad-2318-4c78-aae1-6e67b2887034" (UID: "137d9cad-2318-4c78-aae1-6e67b2887034"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:17:11.072066 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.072012    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "137d9cad-2318-4c78-aae1-6e67b2887034" (UID: "137d9cad-2318-4c78-aae1-6e67b2887034"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:17:11.072293 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.072265    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-istio-token" (OuterVolumeSpecName: "istio-token") pod "137d9cad-2318-4c78-aae1-6e67b2887034" (UID: "137d9cad-2318-4c78-aae1-6e67b2887034"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:17:11.072389 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.072310    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/137d9cad-2318-4c78-aae1-6e67b2887034-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "137d9cad-2318-4c78-aae1-6e67b2887034" (UID: "137d9cad-2318-4c78-aae1-6e67b2887034"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:17:11.072575 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.072557    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-kube-api-access-6kmc4" (OuterVolumeSpecName: "kube-api-access-6kmc4") pod "137d9cad-2318-4c78-aae1-6e67b2887034" (UID: "137d9cad-2318-4c78-aae1-6e67b2887034"). InnerVolumeSpecName "kube-api-access-6kmc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:17:11.107963 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.107928    2575 generic.go:356] "Generic (PLEG): container finished" podID="137d9cad-2318-4c78-aae1-6e67b2887034" containerID="cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d" exitCode=0
Sep 11 04:17:11.108088 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.107973    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"
Sep 11 04:17:11.108088 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.107997    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" event={"ID":"137d9cad-2318-4c78-aae1-6e67b2887034","Type":"ContainerDied","Data":"cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d"}
Sep 11 04:17:11.108088 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.108047    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q" event={"ID":"137d9cad-2318-4c78-aae1-6e67b2887034","Type":"ContainerDied","Data":"fe016424b7a1c1ec85ffafef6821db22611f936a5e0de4b5a660319e03deda3c"}
Sep 11 04:17:11.108088 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.108072    2575 scope.go:117] "RemoveContainer" containerID="cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d"
Sep 11 04:17:11.119113 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.119094    2575 scope.go:117] "RemoveContainer" containerID="395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622"
Sep 11 04:17:11.127842 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.127826    2575 scope.go:117] "RemoveContainer" containerID="cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d"
Sep 11 04:17:11.128118 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:17:11.128095    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d\": container with ID starting with cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d not found: ID does not exist" containerID="cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d"
Sep 11 04:17:11.128222 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.128125    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d"} err="failed to get container status \"cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d\": rpc error: code = NotFound desc = could not find container \"cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d\": container with ID starting with cf59a733b5a60da01d27b4b3b4cef116e8a5f62f599092f920b3a2ee34ec4a6d not found: ID does not exist"
Sep 11 04:17:11.128222 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.128150    2575 scope.go:117] "RemoveContainer" containerID="395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622"
Sep 11 04:17:11.128405 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:17:11.128388    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622\": container with ID starting with 395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622 not found: ID does not exist" containerID="395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622"
Sep 11 04:17:11.128453 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.128414    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622"} err="failed to get container status \"395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622\": rpc error: code = NotFound desc = could not find container \"395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622\": container with ID starting with 395f0e7c818f97dce4f1cfc7879490a9e2365bfe5869323b2962b7899c9e8622 not found: ID does not exist"
Sep 11 04:17:11.132522 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.132498    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"]
Sep 11 04:17:11.137786 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.137765    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q"]
Sep 11 04:17:11.171092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.171068    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:11.171092 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.171088    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/137d9cad-2318-4c78-aae1-6e67b2887034-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:11.171238 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.171097    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/137d9cad-2318-4c78-aae1-6e67b2887034-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:11.171238 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.171105    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:11.171238 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.171113    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kmc4\" (UniqueName: \"kubernetes.io/projected/137d9cad-2318-4c78-aae1-6e67b2887034-kube-api-access-6kmc4\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:11.171238 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:11.171121    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/137d9cad-2318-4c78-aae1-6e67b2887034-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:12.632996 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:12.632963    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" path="/var/lib/kubelet/pods/137d9cad-2318-4c78-aae1-6e67b2887034/volumes"
Sep 11 04:17:16.743801 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:16.743770    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7"]
Sep 11 04:17:16.747121 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:16.747095    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-85dc29-29818335-kglm7"]
Sep 11 04:17:16.787812 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:16.787775    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"]
Sep 11 04:17:16.788084 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:16.788058    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v" podUID="1c719dd4-3cec-4be1-b66d-cce3cf3c764a" containerName="payload-pre-processing" containerID="cri-o://976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87" gracePeriod=30
Sep 11 04:17:16.974626 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:16.974580    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"]
Sep 11 04:17:16.980285 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:16.980256    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-85dc29-qq4s2"]
Sep 11 04:17:17.040573 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.040553    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:17:17.129183 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.129141    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5dxx\" (UniqueName: \"kubernetes.io/projected/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-kube-api-access-s5dxx\") pod \"1c719dd4-3cec-4be1-b66d-cce3cf3c764a\" (UID: \"1c719dd4-3cec-4be1-b66d-cce3cf3c764a\") "
Sep 11 04:17:17.129355 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.129207    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-plugins-config-volume\") pod \"1c719dd4-3cec-4be1-b66d-cce3cf3c764a\" (UID: \"1c719dd4-3cec-4be1-b66d-cce3cf3c764a\") "
Sep 11 04:17:17.129571 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.129542    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1c719dd4-3cec-4be1-b66d-cce3cf3c764a" (UID: "1c719dd4-3cec-4be1-b66d-cce3cf3c764a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:17:17.131335 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.131315    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-kube-api-access-s5dxx" (OuterVolumeSpecName: "kube-api-access-s5dxx") pod "1c719dd4-3cec-4be1-b66d-cce3cf3c764a" (UID: "1c719dd4-3cec-4be1-b66d-cce3cf3c764a"). InnerVolumeSpecName "kube-api-access-s5dxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:17:17.147149 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.147125    2575 generic.go:356] "Generic (PLEG): container finished" podID="1c719dd4-3cec-4be1-b66d-cce3cf3c764a" containerID="976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87" exitCode=0
Sep 11 04:17:17.147238 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.147170    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"
Sep 11 04:17:17.147238 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.147207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v" event={"ID":"1c719dd4-3cec-4be1-b66d-cce3cf3c764a","Type":"ContainerDied","Data":"976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87"}
Sep 11 04:17:17.147311 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.147260    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v" event={"ID":"1c719dd4-3cec-4be1-b66d-cce3cf3c764a","Type":"ContainerDied","Data":"a38c1b5db9e324fee35155e4ac3e29c8b1e087ca0f3a8a80d508dbc388dca94e"}
Sep 11 04:17:17.147311 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.147290    2575 scope.go:117] "RemoveContainer" containerID="976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87"
Sep 11 04:17:17.157066 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.157048    2575 scope.go:117] "RemoveContainer" containerID="976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87"
Sep 11 04:17:17.157347 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:17:17.157330    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87\": container with ID starting with 976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87 not found: ID does not exist" containerID="976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87"
Sep 11 04:17:17.157406 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.157354    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87"} err="failed to get container status \"976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87\": rpc error: code = NotFound desc = could not find container \"976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87\": container with ID starting with 976d495a3fab3e826f685e26a7b55333857bdddd040523ae110af0b97b8d3d87 not found: ID does not exist"
Sep 11 04:17:17.169478 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.169459    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"]
Sep 11 04:17:17.173159 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.173140    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v"]
Sep 11 04:17:17.230912 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.230881    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5dxx\" (UniqueName: \"kubernetes.io/projected/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-kube-api-access-s5dxx\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:17.230912 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:17.230906    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c719dd4-3cec-4be1-b66d-cce3cf3c764a-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:18.633081 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:18.633047    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c719dd4-3cec-4be1-b66d-cce3cf3c764a" path="/var/lib/kubelet/pods/1c719dd4-3cec-4be1-b66d-cce3cf3c764a/volumes"
Sep 11 04:17:18.633465 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:18.633381    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1b63f14-cff8-4f20-bed2-a3c848b51cb1" path="/var/lib/kubelet/pods/b1b63f14-cff8-4f20-bed2-a3c848b51cb1/volumes"
Sep 11 04:17:18.633631 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:18.633595    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8a0afd5-c64f-462c-b461-cb4a10b90b0a" path="/var/lib/kubelet/pods/e8a0afd5-c64f-462c-b461-cb4a10b90b0a/volumes"
Sep 11 04:17:24.091020 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.090983    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"]
Sep 11 04:17:24.091400 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091339    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b63f14-cff8-4f20-bed2-a3c848b51cb1" containerName="revoke-keys"
Sep 11 04:17:24.091400 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091350    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b63f14-cff8-4f20-bed2-a3c848b51cb1" containerName="revoke-keys"
Sep 11 04:17:24.091400 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091363    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c719dd4-3cec-4be1-b66d-cce3cf3c764a" containerName="payload-pre-processing"
Sep 11 04:17:24.091400 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091368    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c719dd4-3cec-4be1-b66d-cce3cf3c764a" containerName="payload-pre-processing"
Sep 11 04:17:24.091400 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091386    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy"
Sep 11 04:17:24.091400 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091391    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy"
Sep 11 04:17:24.091400 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091398    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy"
Sep 11 04:17:24.091400 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091402    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy"
Sep 11 04:17:24.091698 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091409    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy"
Sep 11 04:17:24.091698 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091423    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy"
Sep 11 04:17:24.091698 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091476    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="16250ad3-e93a-42bc-b56a-e4b6b61fd2ca" containerName="istio-proxy"
Sep 11 04:17:24.091698 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091484    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1b63f14-cff8-4f20-bed2-a3c848b51cb1" containerName="revoke-keys"
Sep 11 04:17:24.091698 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091489    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy"
Sep 11 04:17:24.091698 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.091495    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c719dd4-3cec-4be1-b66d-cce3cf3c764a" containerName="payload-pre-processing"
Sep 11 04:17:24.095840 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.095822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"
Sep 11 04:17:24.099501 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.099469    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:17:24.103066 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.103039    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"]
Sep 11 04:17:24.197542 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.197507    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe271fe6-850e-4591-8b46-3bcfe174d2f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m\" (UID: \"fe271fe6-850e-4591-8b46-3bcfe174d2f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"
Sep 11 04:17:24.298894 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.298856    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe271fe6-850e-4591-8b46-3bcfe174d2f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m\" (UID: \"fe271fe6-850e-4591-8b46-3bcfe174d2f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"
Sep 11 04:17:24.299812 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.299783    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe271fe6-850e-4591-8b46-3bcfe174d2f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m\" (UID: \"fe271fe6-850e-4591-8b46-3bcfe174d2f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"
Sep 11 04:17:24.407780 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.407677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"
Sep 11 04:17:24.683048 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:24.683021    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"]
Sep 11 04:17:24.684800 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:17:24.684774    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe271fe6_850e_4591_8b46_3bcfe174d2f2.slice/crio-a9bb45e0f33dff57181d3f53068131e4760c22b2f6c08bf5f06b44af85167c58 WatchSource:0}: Error finding container a9bb45e0f33dff57181d3f53068131e4760c22b2f6c08bf5f06b44af85167c58: Status 404 returned error can't find the container with id a9bb45e0f33dff57181d3f53068131e4760c22b2f6c08bf5f06b44af85167c58
Sep 11 04:17:25.197319 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:25.197283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m" event={"ID":"fe271fe6-850e-4591-8b46-3bcfe174d2f2","Type":"ContainerStarted","Data":"45e8f9bfa547aa30df5f3c1fd6f113f775b7859043ca97d27983ec0bee15b470"}
Sep 11 04:17:25.197848 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:25.197352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m" event={"ID":"fe271fe6-850e-4591-8b46-3bcfe174d2f2","Type":"ContainerStarted","Data":"a9bb45e0f33dff57181d3f53068131e4760c22b2f6c08bf5f06b44af85167c58"}
Sep 11 04:17:25.219032 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:25.218985    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m" podStartSLOduration=1.218968258 podStartE2EDuration="1.218968258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:17:25.217691279 +0000 UTC m=+1651.095883605" watchObservedRunningTime="2026-09-11 04:17:25.218968258 +0000 UTC m=+1651.097160560"
Sep 11 04:17:26.204303 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:26.204266    2575 generic.go:356] "Generic (PLEG): container finished" podID="fe271fe6-850e-4591-8b46-3bcfe174d2f2" containerID="45e8f9bfa547aa30df5f3c1fd6f113f775b7859043ca97d27983ec0bee15b470" exitCode=0
Sep 11 04:17:26.204963 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:26.204348    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m" event={"ID":"fe271fe6-850e-4591-8b46-3bcfe174d2f2","Type":"ContainerDied","Data":"45e8f9bfa547aa30df5f3c1fd6f113f775b7859043ca97d27983ec0bee15b470"}
Sep 11 04:17:27.337121 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:27.337098    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"
Sep 11 04:17:27.429903 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:27.429862    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe271fe6-850e-4591-8b46-3bcfe174d2f2-maas-api-service-ca\") pod \"fe271fe6-850e-4591-8b46-3bcfe174d2f2\" (UID: \"fe271fe6-850e-4591-8b46-3bcfe174d2f2\") "
Sep 11 04:17:27.430220 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:27.430195    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe271fe6-850e-4591-8b46-3bcfe174d2f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe271fe6-850e-4591-8b46-3bcfe174d2f2" (UID: "fe271fe6-850e-4591-8b46-3bcfe174d2f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:17:27.530792 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:27.530748    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe271fe6-850e-4591-8b46-3bcfe174d2f2-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:28.216734 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:28.216696    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"
Sep 11 04:17:28.216734 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:28.216703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m" event={"ID":"fe271fe6-850e-4591-8b46-3bcfe174d2f2","Type":"ContainerDied","Data":"a9bb45e0f33dff57181d3f53068131e4760c22b2f6c08bf5f06b44af85167c58"}
Sep 11 04:17:28.216945 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:28.216744    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9bb45e0f33dff57181d3f53068131e4760c22b2f6c08bf5f06b44af85167c58"
Sep 11 04:17:34.584003 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.583968    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp"]
Sep 11 04:17:34.587869 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.587839    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-9d031d-29818335-xgpdp"]
Sep 11 04:17:34.609281 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.609248    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"]
Sep 11 04:17:34.609532 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.609501    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh" podUID="c2f2d203-39ba-477d-98bc-781f7cd6d143" containerName="payload-processing" containerID="cri-o://2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671" gracePeriod=30
Sep 11 04:17:34.616532 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.616504    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"]
Sep 11 04:17:34.616734 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.616713    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn" podUID="f7a126e9-33d2-4dae-a884-21701a8e630b" containerName="payload-pre-processing" containerID="cri-o://b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963" gracePeriod=30
Sep 11 04:17:34.638469 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.638437    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6fe9dec-fbce-4518-a438-6d71f081042e" path="/var/lib/kubelet/pods/c6fe9dec-fbce-4518-a438-6d71f081042e/volumes"
Sep 11 04:17:34.827823 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.827790    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"]
Sep 11 04:17:34.833326 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.833302    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-9d031d-zxj5m"]
Sep 11 04:17:34.869103 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.869079    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:17:34.902399 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.902376    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:17:34.995387 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.995354    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7a126e9-33d2-4dae-a884-21701a8e630b-plugins-config-volume\") pod \"f7a126e9-33d2-4dae-a884-21701a8e630b\" (UID: \"f7a126e9-33d2-4dae-a884-21701a8e630b\") "
Sep 11 04:17:34.995638 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.995399    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czfcp\" (UniqueName: \"kubernetes.io/projected/c2f2d203-39ba-477d-98bc-781f7cd6d143-kube-api-access-czfcp\") pod \"c2f2d203-39ba-477d-98bc-781f7cd6d143\" (UID: \"c2f2d203-39ba-477d-98bc-781f7cd6d143\") "
Sep 11 04:17:34.995638 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.995445    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72n7w\" (UniqueName: \"kubernetes.io/projected/f7a126e9-33d2-4dae-a884-21701a8e630b-kube-api-access-72n7w\") pod \"f7a126e9-33d2-4dae-a884-21701a8e630b\" (UID: \"f7a126e9-33d2-4dae-a884-21701a8e630b\") "
Sep 11 04:17:34.995638 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.995493    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2f2d203-39ba-477d-98bc-781f7cd6d143-plugins-config-volume\") pod \"c2f2d203-39ba-477d-98bc-781f7cd6d143\" (UID: \"c2f2d203-39ba-477d-98bc-781f7cd6d143\") "
Sep 11 04:17:34.995830 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.995769    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7a126e9-33d2-4dae-a884-21701a8e630b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f7a126e9-33d2-4dae-a884-21701a8e630b" (UID: "f7a126e9-33d2-4dae-a884-21701a8e630b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:17:34.995937 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.995915    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2f2d203-39ba-477d-98bc-781f7cd6d143-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c2f2d203-39ba-477d-98bc-781f7cd6d143" (UID: "c2f2d203-39ba-477d-98bc-781f7cd6d143"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:17:34.997768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.997750    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7a126e9-33d2-4dae-a884-21701a8e630b-kube-api-access-72n7w" (OuterVolumeSpecName: "kube-api-access-72n7w") pod "f7a126e9-33d2-4dae-a884-21701a8e630b" (UID: "f7a126e9-33d2-4dae-a884-21701a8e630b"). InnerVolumeSpecName "kube-api-access-72n7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:17:34.997768 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:34.997757    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2f2d203-39ba-477d-98bc-781f7cd6d143-kube-api-access-czfcp" (OuterVolumeSpecName: "kube-api-access-czfcp") pod "c2f2d203-39ba-477d-98bc-781f7cd6d143" (UID: "c2f2d203-39ba-477d-98bc-781f7cd6d143"). InnerVolumeSpecName "kube-api-access-czfcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:17:35.096229 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.096195    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7a126e9-33d2-4dae-a884-21701a8e630b-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:35.096229 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.096227    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czfcp\" (UniqueName: \"kubernetes.io/projected/c2f2d203-39ba-477d-98bc-781f7cd6d143-kube-api-access-czfcp\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:35.096465 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.096240    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72n7w\" (UniqueName: \"kubernetes.io/projected/f7a126e9-33d2-4dae-a884-21701a8e630b-kube-api-access-72n7w\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:35.096465 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.096253    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2f2d203-39ba-477d-98bc-781f7cd6d143-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:35.258407 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.258371    2575 generic.go:356] "Generic (PLEG): container finished" podID="c2f2d203-39ba-477d-98bc-781f7cd6d143" containerID="2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671" exitCode=0
Sep 11 04:17:35.258640 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.258425    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"
Sep 11 04:17:35.258640 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.258465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh" event={"ID":"c2f2d203-39ba-477d-98bc-781f7cd6d143","Type":"ContainerDied","Data":"2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671"}
Sep 11 04:17:35.258640 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.258522    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh" event={"ID":"c2f2d203-39ba-477d-98bc-781f7cd6d143","Type":"ContainerDied","Data":"d124601c2b03b5490d548dc9b69d31957f49188a9cc1d450238968057da74153"}
Sep 11 04:17:35.258640 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.258559    2575 scope.go:117] "RemoveContainer" containerID="2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671"
Sep 11 04:17:35.259889 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.259859    2575 generic.go:356] "Generic (PLEG): container finished" podID="f7a126e9-33d2-4dae-a884-21701a8e630b" containerID="b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963" exitCode=0
Sep 11 04:17:35.260023 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.259897    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"
Sep 11 04:17:35.260023 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.259950    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn" event={"ID":"f7a126e9-33d2-4dae-a884-21701a8e630b","Type":"ContainerDied","Data":"b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963"}
Sep 11 04:17:35.260023 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.259998    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn" event={"ID":"f7a126e9-33d2-4dae-a884-21701a8e630b","Type":"ContainerDied","Data":"a5cba096f4741be970861d8347f4589955743581caec9d54b03868481d308fd3"}
Sep 11 04:17:35.268837 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.268817    2575 scope.go:117] "RemoveContainer" containerID="2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671"
Sep 11 04:17:35.269119 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:17:35.269078    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671\": container with ID starting with 2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671 not found: ID does not exist" containerID="2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671"
Sep 11 04:17:35.269119 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.269101    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671"} err="failed to get container status \"2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671\": rpc error: code = NotFound desc = could not find container \"2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671\": container with ID starting with 2812755b585b37a6f0ab8e51d81ef66650930f5ff7cee72254f8d7a97f66a671 not found: ID does not exist"
Sep 11 04:17:35.269119 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.269118    2575 scope.go:117] "RemoveContainer" containerID="b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963"
Sep 11 04:17:35.280643 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.280595    2575 scope.go:117] "RemoveContainer" containerID="b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963"
Sep 11 04:17:35.280921 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:17:35.280903    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963\": container with ID starting with b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963 not found: ID does not exist" containerID="b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963"
Sep 11 04:17:35.280979 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.280927    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963"} err="failed to get container status \"b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963\": rpc error: code = NotFound desc = could not find container \"b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963\": container with ID starting with b71e6d346303bd21bfac65028ed15dddb1cb42165a3510aa09876fb851a6a963 not found: ID does not exist"
Sep 11 04:17:35.285152 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.285129    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"]
Sep 11 04:17:35.288918 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.288898    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh"]
Sep 11 04:17:35.299494 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.299475    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"]
Sep 11 04:17:35.306297 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:35.306264    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn"]
Sep 11 04:17:36.632854 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:36.632823    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2f2d203-39ba-477d-98bc-781f7cd6d143" path="/var/lib/kubelet/pods/c2f2d203-39ba-477d-98bc-781f7cd6d143/volumes"
Sep 11 04:17:36.633235 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:36.633164    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7a126e9-33d2-4dae-a884-21701a8e630b" path="/var/lib/kubelet/pods/f7a126e9-33d2-4dae-a884-21701a8e630b/volumes"
Sep 11 04:17:36.633440 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:36.633427    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe271fe6-850e-4591-8b46-3bcfe174d2f2" path="/var/lib/kubelet/pods/fe271fe6-850e-4591-8b46-3bcfe174d2f2/volumes"
Sep 11 04:17:41.605911 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.605878    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"]
Sep 11 04:17:41.606285 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.606057    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy" containerID="cri-o://c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2" gracePeriod=30
Sep 11 04:17:41.907363 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.907287    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"]
Sep 11 04:17:41.907697 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.907682    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7a126e9-33d2-4dae-a884-21701a8e630b" containerName="payload-pre-processing"
Sep 11 04:17:41.907747 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.907699    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7a126e9-33d2-4dae-a884-21701a8e630b" containerName="payload-pre-processing"
Sep 11 04:17:41.907747 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.907710    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe271fe6-850e-4591-8b46-3bcfe174d2f2" containerName="revoke-keys"
Sep 11 04:17:41.907747 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.907716    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe271fe6-850e-4591-8b46-3bcfe174d2f2" containerName="revoke-keys"
Sep 11 04:17:41.907747 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.907733    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2f2d203-39ba-477d-98bc-781f7cd6d143" containerName="payload-processing"
Sep 11 04:17:41.907747 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.907739    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2f2d203-39ba-477d-98bc-781f7cd6d143" containerName="payload-processing"
Sep 11 04:17:41.907904 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.907790    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe271fe6-850e-4591-8b46-3bcfe174d2f2" containerName="revoke-keys"
Sep 11 04:17:41.907904 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.907798    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="137d9cad-2318-4c78-aae1-6e67b2887034" containerName="istio-proxy"
Sep 11 04:17:41.907904 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.907804    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2f2d203-39ba-477d-98bc-781f7cd6d143" containerName="payload-processing"
Sep 11 04:17:41.907904 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.907810    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7a126e9-33d2-4dae-a884-21701a8e630b" containerName="payload-pre-processing"
Sep 11 04:17:41.912185 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.912167    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"
Sep 11 04:17:41.915593 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.915568    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wbtxz\""
Sep 11 04:17:41.920310 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:41.920291    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"]
Sep 11 04:17:42.061467 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:42.061434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cfcd7ba-68bf-41a8-892e-85a87fe3b13c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r\" (UID: \"0cfcd7ba-68bf-41a8-892e-85a87fe3b13c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"
Sep 11 04:17:42.162742 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:42.162656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cfcd7ba-68bf-41a8-892e-85a87fe3b13c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r\" (UID: \"0cfcd7ba-68bf-41a8-892e-85a87fe3b13c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"
Sep 11 04:17:42.163264 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:42.163244    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cfcd7ba-68bf-41a8-892e-85a87fe3b13c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r\" (UID: \"0cfcd7ba-68bf-41a8-892e-85a87fe3b13c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"
Sep 11 04:17:42.223512 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:42.223481    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"
Sep 11 04:17:42.496980 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:42.496950    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"]
Sep 11 04:17:42.498390 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:17:42.498363    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfcd7ba_68bf_41a8_892e_85a87fe3b13c.slice/crio-a06b135b04cc029d17bdd89c8f1e9089636ee6819a7636c5fc8f69ce3c4fc2d1 WatchSource:0}: Error finding container a06b135b04cc029d17bdd89c8f1e9089636ee6819a7636c5fc8f69ce3c4fc2d1: Status 404 returned error can't find the container with id a06b135b04cc029d17bdd89c8f1e9089636ee6819a7636c5fc8f69ce3c4fc2d1
Sep 11 04:17:43.310435 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:43.310404    2575 generic.go:356] "Generic (PLEG): container finished" podID="0cfcd7ba-68bf-41a8-892e-85a87fe3b13c" containerID="1c2d5aff0f732e215e6eb19c477c23a609fe3f1a19d419bc9326378c9a025f69" exitCode=0
Sep 11 04:17:43.310818 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:43.310487    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r" event={"ID":"0cfcd7ba-68bf-41a8-892e-85a87fe3b13c","Type":"ContainerDied","Data":"1c2d5aff0f732e215e6eb19c477c23a609fe3f1a19d419bc9326378c9a025f69"}
Sep 11 04:17:43.310818 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:43.310543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r" event={"ID":"0cfcd7ba-68bf-41a8-892e-85a87fe3b13c","Type":"ContainerStarted","Data":"a06b135b04cc029d17bdd89c8f1e9089636ee6819a7636c5fc8f69ce3c4fc2d1"}
Sep 11 04:17:44.449672 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:44.449649    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"
Sep 11 04:17:44.584567 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:44.584475    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cfcd7ba-68bf-41a8-892e-85a87fe3b13c-maas-api-service-ca\") pod \"0cfcd7ba-68bf-41a8-892e-85a87fe3b13c\" (UID: \"0cfcd7ba-68bf-41a8-892e-85a87fe3b13c\") "
Sep 11 04:17:44.584880 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:44.584857    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cfcd7ba-68bf-41a8-892e-85a87fe3b13c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0cfcd7ba-68bf-41a8-892e-85a87fe3b13c" (UID: "0cfcd7ba-68bf-41a8-892e-85a87fe3b13c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:17:44.685298 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:44.685275    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cfcd7ba-68bf-41a8-892e-85a87fe3b13c-maas-api-service-ca\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:45.324272 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:45.324239    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r" event={"ID":"0cfcd7ba-68bf-41a8-892e-85a87fe3b13c","Type":"ContainerDied","Data":"a06b135b04cc029d17bdd89c8f1e9089636ee6819a7636c5fc8f69ce3c4fc2d1"}
Sep 11 04:17:45.324445 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:45.324288    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a06b135b04cc029d17bdd89c8f1e9089636ee6819a7636c5fc8f69ce3c4fc2d1"
Sep 11 04:17:45.324445 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:45.324252    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"
Sep 11 04:17:46.860080 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:46.860056    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:17:47.007510 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.007480    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-certs\") pod \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") "
Sep 11 04:17:47.007744 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.007538    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-credential-socket\") pod \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") "
Sep 11 04:17:47.007744 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.007577    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istiod-ca-cert\") pod \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") "
Sep 11 04:17:47.007744 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.007640    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjll5\" (UniqueName: \"kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-kube-api-access-vjll5\") pod \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") "
Sep 11 04:17:47.007744 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.007692    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-data\") pod \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") "
Sep 11 04:17:47.007744 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.007713    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-token\") pod \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") "
Sep 11 04:17:47.008013 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.007816    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7205d0d6-6947-49b9-b776-d8b01f1f3fbb" (UID: "7205d0d6-6947-49b9-b776-d8b01f1f3fbb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:17:47.008013 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.007857    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-podinfo\") pod \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") "
Sep 11 04:17:47.008013 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.007883    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7205d0d6-6947-49b9-b776-d8b01f1f3fbb" (UID: "7205d0d6-6947-49b9-b776-d8b01f1f3fbb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:17:47.008013 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.007915    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-envoy\") pod \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") "
Sep 11 04:17:47.008013 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.007954    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-socket\") pod \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\" (UID: \"7205d0d6-6947-49b9-b776-d8b01f1f3fbb\") "
Sep 11 04:17:47.008261 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.008013    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-data" (OuterVolumeSpecName: "istio-data") pod "7205d0d6-6947-49b9-b776-d8b01f1f3fbb" (UID: "7205d0d6-6947-49b9-b776-d8b01f1f3fbb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:17:47.008261 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.008091    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7205d0d6-6947-49b9-b776-d8b01f1f3fbb" (UID: "7205d0d6-6947-49b9-b776-d8b01f1f3fbb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:17:47.008368 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.008266    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7205d0d6-6947-49b9-b776-d8b01f1f3fbb" (UID: "7205d0d6-6947-49b9-b776-d8b01f1f3fbb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:17:47.008474 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.008372    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:47.008474 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.008387    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-workload-certs\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:47.008474 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.008396    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-credential-socket\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:47.008474 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.008404    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istiod-ca-cert\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:47.008474 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.008412    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-data\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:47.010188 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.010159    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7205d0d6-6947-49b9-b776-d8b01f1f3fbb" (UID: "7205d0d6-6947-49b9-b776-d8b01f1f3fbb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:17:47.010188 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.010163    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7205d0d6-6947-49b9-b776-d8b01f1f3fbb" (UID: "7205d0d6-6947-49b9-b776-d8b01f1f3fbb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:17:47.010474 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.010454    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-token" (OuterVolumeSpecName: "istio-token") pod "7205d0d6-6947-49b9-b776-d8b01f1f3fbb" (UID: "7205d0d6-6947-49b9-b776-d8b01f1f3fbb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:17:47.010563 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.010469    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-kube-api-access-vjll5" (OuterVolumeSpecName: "kube-api-access-vjll5") pod "7205d0d6-6947-49b9-b776-d8b01f1f3fbb" (UID: "7205d0d6-6947-49b9-b776-d8b01f1f3fbb"). InnerVolumeSpecName "kube-api-access-vjll5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:17:47.109939 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.109902    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-token\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:47.109939 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.109938    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-podinfo\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:47.110151 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.109953    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-istio-envoy\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:47.110151 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.109967    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjll5\" (UniqueName: \"kubernetes.io/projected/7205d0d6-6947-49b9-b776-d8b01f1f3fbb-kube-api-access-vjll5\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:47.338816 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.338719    2575 generic.go:356] "Generic (PLEG): container finished" podID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerID="c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2" exitCode=0
Sep 11 04:17:47.338816 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.338773    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"
Sep 11 04:17:47.339018 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.338808    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" event={"ID":"7205d0d6-6947-49b9-b776-d8b01f1f3fbb","Type":"ContainerDied","Data":"c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2"}
Sep 11 04:17:47.339018 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.338868    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz" event={"ID":"7205d0d6-6947-49b9-b776-d8b01f1f3fbb","Type":"ContainerDied","Data":"26466c407ec04355d114c7fa276ec95fe808f0577fe2e9c21f2656b1b928920d"}
Sep 11 04:17:47.339018 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.338896    2575 scope.go:117] "RemoveContainer" containerID="c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2"
Sep 11 04:17:47.349068 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.349048    2575 scope.go:117] "RemoveContainer" containerID="5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd"
Sep 11 04:17:47.357403 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.357386    2575 scope.go:117] "RemoveContainer" containerID="c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2"
Sep 11 04:17:47.357691 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:17:47.357671    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2\": container with ID starting with c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2 not found: ID does not exist" containerID="c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2"
Sep 11 04:17:47.357782 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.357704    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2"} err="failed to get container status \"c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2\": rpc error: code = NotFound desc = could not find container \"c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2\": container with ID starting with c5421fc9ccf4c82fb5bb291476a2fe1a1a92ab5449bac722c90f885c77b82db2 not found: ID does not exist"
Sep 11 04:17:47.357782 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.357729    2575 scope.go:117] "RemoveContainer" containerID="5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd"
Sep 11 04:17:47.358007 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:17:47.357990    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd\": container with ID starting with 5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd not found: ID does not exist" containerID="5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd"
Sep 11 04:17:47.358044 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.358014    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd"} err="failed to get container status \"5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd\": rpc error: code = NotFound desc = could not find container \"5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd\": container with ID starting with 5832eb64722613ed80ad06f2aafbbfef772ee7577a8da094a49a72c0567612bd not found: ID does not exist"
Sep 11 04:17:47.375012 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.374989    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"]
Sep 11 04:17:47.393580 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:47.393549    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz"]
Sep 11 04:17:48.631982 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:48.631947    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" path="/var/lib/kubelet/pods/7205d0d6-6947-49b9-b776-d8b01f1f3fbb/volumes"
Sep 11 04:17:52.495246 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.495210    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd"]
Sep 11 04:17:52.497321 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.497299    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c158b2-29818335-4zjpd"]
Sep 11 04:17:52.531446 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.531404    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"]
Sep 11 04:17:52.531762 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.531706    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8" podUID="5eace334-3231-4022-9b10-1ce66522dadc" containerName="payload-pre-processing" containerID="cri-o://8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39" gracePeriod=30
Sep 11 04:17:52.633493 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.633465    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6302e99-e61e-45fb-9da1-2a53d1d95ef7" path="/var/lib/kubelet/pods/c6302e99-e61e-45fb-9da1-2a53d1d95ef7/volumes"
Sep 11 04:17:52.708164 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.708134    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"]
Sep 11 04:17:52.712250 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.712223    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c158b2-pcs2r"]
Sep 11 04:17:52.788149 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.788127    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:17:52.856005 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.855977    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlw26\" (UniqueName: \"kubernetes.io/projected/5eace334-3231-4022-9b10-1ce66522dadc-kube-api-access-zlw26\") pod \"5eace334-3231-4022-9b10-1ce66522dadc\" (UID: \"5eace334-3231-4022-9b10-1ce66522dadc\") "
Sep 11 04:17:52.856159 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.856011    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5eace334-3231-4022-9b10-1ce66522dadc-plugins-config-volume\") pod \"5eace334-3231-4022-9b10-1ce66522dadc\" (UID: \"5eace334-3231-4022-9b10-1ce66522dadc\") "
Sep 11 04:17:52.856438 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.856413    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eace334-3231-4022-9b10-1ce66522dadc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5eace334-3231-4022-9b10-1ce66522dadc" (UID: "5eace334-3231-4022-9b10-1ce66522dadc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:17:52.858251 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.858227    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eace334-3231-4022-9b10-1ce66522dadc-kube-api-access-zlw26" (OuterVolumeSpecName: "kube-api-access-zlw26") pod "5eace334-3231-4022-9b10-1ce66522dadc" (UID: "5eace334-3231-4022-9b10-1ce66522dadc"). InnerVolumeSpecName "kube-api-access-zlw26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:17:52.957369 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.957338    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5eace334-3231-4022-9b10-1ce66522dadc-plugins-config-volume\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:52.957369 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:52.957364    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlw26\" (UniqueName: \"kubernetes.io/projected/5eace334-3231-4022-9b10-1ce66522dadc-kube-api-access-zlw26\") on node \"ip-10-0-140-70.ec2.internal\" DevicePath \"\""
Sep 11 04:17:53.375038 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:53.375004    2575 generic.go:356] "Generic (PLEG): container finished" podID="5eace334-3231-4022-9b10-1ce66522dadc" containerID="8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39" exitCode=0
Sep 11 04:17:53.375226 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:53.375053    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"
Sep 11 04:17:53.375226 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:53.375092    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8" event={"ID":"5eace334-3231-4022-9b10-1ce66522dadc","Type":"ContainerDied","Data":"8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39"}
Sep 11 04:17:53.375226 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:53.375150    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8" event={"ID":"5eace334-3231-4022-9b10-1ce66522dadc","Type":"ContainerDied","Data":"d6cf73022ddcf254ca97161f8dbfdb4a3b7daf23b5be72d9806638534e03b18c"}
Sep 11 04:17:53.375226 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:53.375173    2575 scope.go:117] "RemoveContainer" containerID="8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39"
Sep 11 04:17:53.384397 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:53.384380    2575 scope.go:117] "RemoveContainer" containerID="8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39"
Sep 11 04:17:53.384653 ip-10-0-140-70 kubenswrapper[2575]: E0911 04:17:53.384636    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39\": container with ID starting with 8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39 not found: ID does not exist" containerID="8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39"
Sep 11 04:17:53.384707 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:53.384661    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39"} err="failed to get container status \"8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39\": rpc error: code = NotFound desc = could not find container \"8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39\": container with ID starting with 8ecae0022e3206fb16c49f297ff17662c50fde9871e34c3b853549b1bfd07e39 not found: ID does not exist"
Sep 11 04:17:53.396938 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:53.396912    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"]
Sep 11 04:17:53.401425 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:53.401404    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8"]
Sep 11 04:17:54.633855 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:54.633824    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cfcd7ba-68bf-41a8-892e-85a87fe3b13c" path="/var/lib/kubelet/pods/0cfcd7ba-68bf-41a8-892e-85a87fe3b13c/volumes"
Sep 11 04:17:54.634192 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:17:54.634162    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eace334-3231-4022-9b10-1ce66522dadc" path="/var/lib/kubelet/pods/5eace334-3231-4022-9b10-1ce66522dadc/volumes"
Sep 11 04:18:55.075295 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:18:55.075262    2575 scope.go:117] "RemoveContainer" containerID="e574ed6822edbec8f9fee894310f90768ea1eb3c46cf15e55f493d17719d96e3"
Sep 11 04:18:55.083866 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:18:55.083844    2575 scope.go:117] "RemoveContainer" containerID="6e25cc8ee532482c99ee43c054e54289718002ff21d245b91fd8d9195a71195d"
Sep 11 04:19:54.756712 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:19:54.756684    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 04:19:54.759216 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:19:54.759187    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 04:19:55.106960 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:19:55.106866    2575 scope.go:117] "RemoveContainer" containerID="91c59c14c346e9dd614f38c98c2cd9367096481d09675f7feab68ea356ca6457"
Sep 11 04:19:55.115509 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:19:55.115488    2575 scope.go:117] "RemoveContainer" containerID="5eebd52474fd6ae8f27b95f4f96b8f3b77cc650cec8dfec740e51965f9d37d93"
Sep 11 04:21:55.148992 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:21:55.148958    2575 scope.go:117] "RemoveContainer" containerID="182860f12b0000b1d285fd12afca7281563fe716242c69f55d04f1b72c729173"
Sep 11 04:21:55.158383 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:21:55.158359    2575 scope.go:117] "RemoveContainer" containerID="eeac95ae1e09649c5e0c6bfbb437118bea474e9c703dd24456ffd0df0e9a6152"
Sep 11 04:21:55.166472 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:21:55.166450    2575 scope.go:117] "RemoveContainer" containerID="f80edaca87376460efa94e1d466d90238824b380851b6cfcfaaf3832587321e1"
Sep 11 04:21:55.174016 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:21:55.173998    2575 scope.go:117] "RemoveContainer" containerID="4f54f3700193d89c0881f3d136c52678bab12c57cd2382c769149820ea6c2e65"
Sep 11 04:22:55.208197 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:22:55.208163    2575 scope.go:117] "RemoveContainer" containerID="f2ef8b0c1f04f64165c08c4a0d8e14e5cbae0feb62b5f8226fb4281f4eef5cb5"
Sep 11 04:23:46.472171 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:46.472124    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zxsl5_c8726381-d9fe-40b3-b4ea-677fc71462c1/manager/0.log"
Sep 11 04:23:46.864176 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:46.864106    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf4878d-dflqm_d8172994-ce6a-44fc-aadc-075b1e9207d2/copy-manifests/0.log"
Sep 11 04:23:46.870395 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:46.870376    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf4878d-dflqm_d8172994-ce6a-44fc-aadc-075b1e9207d2/manager/0.log"
Sep 11 04:23:47.687233 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:47.687207    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-vbnvw_04757256-742a-4373-b6e9-620e64fa64bd/postgres/0.log"
Sep 11 04:23:49.648713 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:49.648684    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx_676347ce-3e97-44ad-9fd2-c3299b3ad6ff/istio-proxy/0.log"
Sep 11 04:23:49.775074 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:49.775046    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gwjck_3158cdd9-d64c-4ffc-8a87-6257c3f82e56/discovery/0.log"
Sep 11 04:23:50.254903 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:50.254874    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2z4lv_3834af05-e173-4891-9010-7f2f4f39b28f/payload-pre-processing/0.log"
Sep 11 04:23:50.490029 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:50.490004    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d99445d4-9hhp8_d2e9d136-2475-433a-b93b-76c4379a11a2/router/0.log"
Sep 11 04:23:50.883584 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:50.883561    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-85pqt_b12c7ed0-b0c2-46ca-8bdf-8e8f253a5598/main/0.log"
Sep 11 04:23:51.135776 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:51.135698    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-9lwk2_4834295e-fda2-4709-aebc-87ad9e7a38eb/main/0.log"
Sep 11 04:23:55.228002 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:55.227973    2575 scope.go:117] "RemoveContainer" containerID="45e8f9bfa547aa30df5f3c1fd6f113f775b7859043ca97d27983ec0bee15b470"
Sep 11 04:23:55.236428 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:55.236408    2575 scope.go:117] "RemoveContainer" containerID="7bcdd344b7534177cbbb8261fe459caca59f7b29c173f1d00c9f25c88f52e6b8"
Sep 11 04:23:55.244375 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:23:55.244356    2575 scope.go:117] "RemoveContainer" containerID="1c2d5aff0f732e215e6eb19c477c23a609fe3f1a19d419bc9326378c9a025f69"
Sep 11 04:24:00.703345 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:00.703313    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qbqz4_1aa676ca-bad6-45a7-8b9b-529c9bd74170/global-pull-secret-syncer/0.log"
Sep 11 04:24:00.800717 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:00.800689    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jhzkk_a5ffdd30-c9e0-43bb-9dcd-1ac93623c991/konnectivity-agent/0.log"
Sep 11 04:24:00.870681 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:00.870652    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-70.ec2.internal_45521813523a4f1b7be2eda5037f0f36/haproxy/0.log"
Sep 11 04:24:06.980868 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:06.980838    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-mp9dn_7c79e0fc-5e34-4381-bfcf-57fe8430c7c2/cluster-monitoring-operator/0.log"
Sep 11 04:24:07.495476 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:07.495441    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xms2w_42f7196c-cd2a-4b44-b989-ee02a79401bb/node-exporter/0.log"
Sep 11 04:24:07.547710 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:07.547688    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xms2w_42f7196c-cd2a-4b44-b989-ee02a79401bb/kube-rbac-proxy/0.log"
Sep 11 04:24:07.596266 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:07.596245    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xms2w_42f7196c-cd2a-4b44-b989-ee02a79401bb/init-textfile/0.log"
Sep 11 04:24:09.752402 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:09.752346    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-wv4lw_ec394572-d8bc-4f3c-b9a6-1c35eb67a263/networking-console-plugin/0.log"
Sep 11 04:24:10.213927 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.213839    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"]
Sep 11 04:24:10.214333 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.214316    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy"
Sep 11 04:24:10.214410 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.214336    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy"
Sep 11 04:24:10.214410 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.214346    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cfcd7ba-68bf-41a8-892e-85a87fe3b13c" containerName="revoke-keys"
Sep 11 04:24:10.214410 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.214351    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cfcd7ba-68bf-41a8-892e-85a87fe3b13c" containerName="revoke-keys"
Sep 11 04:24:10.214410 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.214362    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eace334-3231-4022-9b10-1ce66522dadc" containerName="payload-pre-processing"
Sep 11 04:24:10.214410 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.214368    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eace334-3231-4022-9b10-1ce66522dadc" containerName="payload-pre-processing"
Sep 11 04:24:10.214679 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.214473    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy"
Sep 11 04:24:10.214679 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.214481    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7205d0d6-6947-49b9-b776-d8b01f1f3fbb" containerName="istio-proxy"
Sep 11 04:24:10.214679 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.214487    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eace334-3231-4022-9b10-1ce66522dadc" containerName="payload-pre-processing"
Sep 11 04:24:10.214679 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.214493    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cfcd7ba-68bf-41a8-892e-85a87fe3b13c" containerName="revoke-keys"
Sep 11 04:24:10.217541 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.217522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.220226 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.220197    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vb5nd\"/\"kube-root-ca.crt\""
Sep 11 04:24:10.220334 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.220281    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vb5nd\"/\"openshift-service-ca.crt\""
Sep 11 04:24:10.221366 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.221347    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vb5nd\"/\"default-dockercfg-pfqxn\""
Sep 11 04:24:10.226471 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.226450    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"]
Sep 11 04:24:10.268579 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.268549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-sys\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.268754 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.268589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-podres\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.268754 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.268658    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-proc\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.268754 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.268696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sntlw\" (UniqueName: \"kubernetes.io/projected/9c32bb82-7967-4ff7-968d-9b2b9402a80f-kube-api-access-sntlw\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.268754 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.268714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-lib-modules\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.370074 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.370042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-proc\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.370226 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.370097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sntlw\" (UniqueName: \"kubernetes.io/projected/9c32bb82-7967-4ff7-968d-9b2b9402a80f-kube-api-access-sntlw\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.370226 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.370115    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-lib-modules\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.370226 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.370143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-sys\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.370226 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.370171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-podres\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.370226 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.370174    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-proc\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.370399 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.370237    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-sys\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.370399 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.370272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-podres\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.370399 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.370300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c32bb82-7967-4ff7-968d-9b2b9402a80f-lib-modules\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.378373 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.378352    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sntlw\" (UniqueName: \"kubernetes.io/projected/9c32bb82-7967-4ff7-968d-9b2b9402a80f-kube-api-access-sntlw\") pod \"perf-node-gather-daemonset-dtvl4\" (UID: \"9c32bb82-7967-4ff7-968d-9b2b9402a80f\") " pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.383808 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.383788    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/1.log"
Sep 11 04:24:10.390449 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.390430    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9t5rs_276aa6c9-6021-4eb8-a0f4-e2ecc82fc0af/console-operator/2.log"
Sep 11 04:24:10.528323 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.528282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:10.796684 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.796651    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"]
Sep 11 04:24:10.798326 ip-10-0-140-70 kubenswrapper[2575]: W0911 04:24:10.798304    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9c32bb82_7967_4ff7_968d_9b2b9402a80f.slice/crio-165b9ba669ead8b8a9ee47a139fceb40c2e3e3dd186896863e6baf2883c46a70 WatchSource:0}: Error finding container 165b9ba669ead8b8a9ee47a139fceb40c2e3e3dd186896863e6baf2883c46a70: Status 404 returned error can't find the container with id 165b9ba669ead8b8a9ee47a139fceb40c2e3e3dd186896863e6baf2883c46a70
Sep 11 04:24:10.957061 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:10.957035    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-9khwd_d9479be1-1923-4787-84e8-a9c95221e6c0/download-server/0.log"
Sep 11 04:24:11.455726 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:11.455687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4" event={"ID":"9c32bb82-7967-4ff7-968d-9b2b9402a80f","Type":"ContainerStarted","Data":"9ea072490171873db83b43b58aa9a73dc370ed5085e1a7edb53d19e38dff63ce"}
Sep 11 04:24:11.455942 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:11.455737    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4" event={"ID":"9c32bb82-7967-4ff7-968d-9b2b9402a80f","Type":"ContainerStarted","Data":"165b9ba669ead8b8a9ee47a139fceb40c2e3e3dd186896863e6baf2883c46a70"}
Sep 11 04:24:11.455942 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:11.455766    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:11.482942 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:11.482897    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4" podStartSLOduration=1.482883806 podStartE2EDuration="1.482883806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:24:11.480736292 +0000 UTC m=+2057.358928594" watchObservedRunningTime="2026-09-11 04:24:11.482883806 +0000 UTC m=+2057.361076108"
Sep 11 04:24:11.604977 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:11.604947    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-sw4fd_eefc1bba-4c1d-4611-8314-a7a8d2472d03/volume-data-source-validator/0.log"
Sep 11 04:24:12.720063 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:12.720035    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zbhfp_a4c172c0-bc0f-42e1-9183-2bfc7d021e3d/dns/0.log"
Sep 11 04:24:12.742032 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:12.742011    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zbhfp_a4c172c0-bc0f-42e1-9183-2bfc7d021e3d/kube-rbac-proxy/0.log"
Sep 11 04:24:12.810973 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:12.810947    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9wpms_80d22450-38cf-43aa-a876-056cb4fbb8ea/dns-node-resolver/0.log"
Sep 11 04:24:13.345389 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:13.345362    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-625dw_939a41d8-9275-4697-aed4-124c74dd8128/node-ca/0.log"
Sep 11 04:24:14.336283 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:14.336245    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx_676347ce-3e97-44ad-9fd2-c3299b3ad6ff/istio-proxy/0.log"
Sep 11 04:24:14.557825 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:14.557798    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gwjck_3158cdd9-d64c-4ffc-8a87-6257c3f82e56/discovery/0.log"
Sep 11 04:24:14.676170 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:14.676095    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2z4lv_3834af05-e173-4891-9010-7f2f4f39b28f/payload-pre-processing/0.log"
Sep 11 04:24:14.736777 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:14.736750    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d99445d4-9hhp8_d2e9d136-2475-433a-b93b-76c4379a11a2/router/0.log"
Sep 11 04:24:15.597625 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:15.597525    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4h7p_83a3356b-727e-4cf5-88ec-c12797a2ab56/serve-healthcheck-canary/0.log"
Sep 11 04:24:16.037055 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:16.037025    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-t4prc_2be2cc42-8aab-4493-82bf-3c2c1eb8d688/insights-operator/0.log"
Sep 11 04:24:16.059424 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:16.059397    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6zk87_7859e4ab-e97d-47de-b4a0-b97ad5c86465/kube-rbac-proxy/0.log"
Sep 11 04:24:16.082131 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:16.082107    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6zk87_7859e4ab-e97d-47de-b4a0-b97ad5c86465/exporter/0.log"
Sep 11 04:24:16.102771 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:16.102749    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6zk87_7859e4ab-e97d-47de-b4a0-b97ad5c86465/extractor/0.log"
Sep 11 04:24:17.471170 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:17.471143    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vb5nd/perf-node-gather-daemonset-dtvl4"
Sep 11 04:24:18.622486 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:18.622452    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zxsl5_c8726381-d9fe-40b3-b4ea-677fc71462c1/manager/0.log"
Sep 11 04:24:18.805506 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:18.805470    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf4878d-dflqm_d8172994-ce6a-44fc-aadc-075b1e9207d2/manager/0.log"
Sep 11 04:24:18.827059 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:18.827037    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf4878d-dflqm_d8172994-ce6a-44fc-aadc-075b1e9207d2/copy-manifests/0.log"
Sep 11 04:24:19.923619 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:19.923564    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx_676347ce-3e97-44ad-9fd2-c3299b3ad6ff/istio-proxy/0.log"
Sep 11 04:24:20.024873 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:20.024846    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67f66d78bd-lnvdn_eb53c7e2-d340-46bb-972e-97b164fa45d2/manager/0.log"
Sep 11 04:24:20.157412 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:20.157367    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gwjck_3158cdd9-d64c-4ffc-8a87-6257c3f82e56/discovery/0.log"
Sep 11 04:24:20.246527 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:20.246502    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2z4lv_3834af05-e173-4891-9010-7f2f4f39b28f/payload-pre-processing/0.log"
Sep 11 04:24:20.290584 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:20.290545    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d99445d4-9hhp8_d2e9d136-2475-433a-b93b-76c4379a11a2/router/0.log"
Sep 11 04:24:21.838892 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:21.838866    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx_676347ce-3e97-44ad-9fd2-c3299b3ad6ff/istio-proxy/0.log"
Sep 11 04:24:22.062622 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:22.062555    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gwjck_3158cdd9-d64c-4ffc-8a87-6257c3f82e56/discovery/0.log"
Sep 11 04:24:22.145752 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:22.145668    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2z4lv_3834af05-e173-4891-9010-7f2f4f39b28f/payload-pre-processing/0.log"
Sep 11 04:24:22.194290 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:22.194265    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d99445d4-9hhp8_d2e9d136-2475-433a-b93b-76c4379a11a2/router/0.log"
Sep 11 04:24:25.567891 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:25.567858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-kx2qq_7f3b15bd-4948-4c13-959a-e6fe1536e4ae/kube-storage-version-migrator-operator/1.log"
Sep 11 04:24:25.568752 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:25.568732    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-kx2qq_7f3b15bd-4948-4c13-959a-e6fe1536e4ae/kube-storage-version-migrator-operator/0.log"
Sep 11 04:24:26.816584 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:26.816555    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wfnc5_b064e152-072d-42f9-b9bb-e59f02f831fa/kube-multus-additional-cni-plugins/0.log"
Sep 11 04:24:26.838073 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:26.838047    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wfnc5_b064e152-072d-42f9-b9bb-e59f02f831fa/egress-router-binary-copy/0.log"
Sep 11 04:24:26.858191 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:26.858166    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wfnc5_b064e152-072d-42f9-b9bb-e59f02f831fa/cni-plugins/0.log"
Sep 11 04:24:26.882799 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:26.882778    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wfnc5_b064e152-072d-42f9-b9bb-e59f02f831fa/bond-cni-plugin/0.log"
Sep 11 04:24:26.907376 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:26.907350    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wfnc5_b064e152-072d-42f9-b9bb-e59f02f831fa/routeoverride-cni/0.log"
Sep 11 04:24:26.930201 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:26.930177    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wfnc5_b064e152-072d-42f9-b9bb-e59f02f831fa/whereabouts-cni-bincopy/0.log"
Sep 11 04:24:26.952417 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:26.952377    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wfnc5_b064e152-072d-42f9-b9bb-e59f02f831fa/whereabouts-cni/0.log"
Sep 11 04:24:27.086501 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:27.086434    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x8fvc_b2f6b587-86ba-4d00-b50f-97d1da6ae108/kube-multus/0.log"
Sep 11 04:24:27.203790 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:27.203759    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nm7zn_5dc15c92-4ed2-4ffd-8fa5-3081b380b439/network-metrics-daemon/0.log"
Sep 11 04:24:27.223892 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:27.223774    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nm7zn_5dc15c92-4ed2-4ffd-8fa5-3081b380b439/kube-rbac-proxy/0.log"
Sep 11 04:24:28.290312 ip-10-0-140-70 kubenswrapper[2575]: I0911 04:24:28.290275    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7rfx_c44dfb89-c6e2-4e01-a643-7203d29f827a/ovn-controller/0.log"