Sep 19 09:06:55.422329 ip-10-0-141-190 systemd[1]: Starting Kubernetes Kubelet...
Sep 19 09:06:58.696717 ip-10-0-141-190 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 09:06:58.696717 ip-10-0-141-190 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 19 09:06:58.696717 ip-10-0-141-190 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 09:06:58.696717 ip-10-0-141-190 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 19 09:06:58.696717 ip-10-0-141-190 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 09:06:58.697391 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.696787    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 19 09:06:58.700257 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700235    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 09:06:58.700257 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700257    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700262    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700265    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700268    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700272    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700275    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700278    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700281    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700283    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700286    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700288    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700291    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700293    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700296    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700298    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700302    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700305    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700307    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700311    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700314    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 09:06:58.700319 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700316    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700319    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700321    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700324    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700327    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700330    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700333    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700335    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700338    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700340    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700342    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700345    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700347    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700350    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700352    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700355    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700357    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700361    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700364    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700366    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 09:06:58.700778 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700368    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700371    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700373    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700376    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700378    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700380    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700383    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700386    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700388    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700391    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700393    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700395    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700398    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700400    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700403    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700406    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700409    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700411    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700414    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700416    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 09:06:58.701294 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700419    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700421    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700423    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700426    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700428    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700431    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700434    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700436    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700438    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700441    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700444    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700446    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700449    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700451    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700453    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700456    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700458    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700461    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700464    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 09:06:58.701755 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700467    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700471    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700475    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700477    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700480    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700484    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700487    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700491    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700495    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700498    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700501    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700504    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700507    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700509    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700512    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700514    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700517    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700519    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.700522    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 09:06:58.702254 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701190    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701196    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701199    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701204    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701208    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701212    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701215    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701218    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701221    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701223    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701226    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701229    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701232    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701235    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701237    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701240    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701242    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701245    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701247    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 09:06:58.702689 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701250    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701254    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701256    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701259    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701261    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701263    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701266    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701268    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701272    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701276    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701278    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701281    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701284    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701287    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701290    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701292    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701295    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701298    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701301    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701304    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 09:06:58.703189 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701307    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701310    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701313    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701315    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701318    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701321    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701323    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701325    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701328    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701331    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701333    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701335    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701338    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701341    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701344    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701346    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701349    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701351    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701353    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701356    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 09:06:58.703652 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701358    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701361    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701363    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701366    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701368    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701370    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701373    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701375    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701378    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701380    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701383    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701385    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701388    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701390    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701393    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701395    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701398    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701401    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701404    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701406    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 09:06:58.704135 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701409    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701411    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701414    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701417    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701419    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701422    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701424    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701427    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701429    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701432    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701435    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701438    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701441    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701443    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701446    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701448    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701450    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701453    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701455    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701457    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 09:06:58.704610 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701831    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701836    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701840    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701843    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701846    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701849    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701851    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701854    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701857    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701859    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701862    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701864    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701867    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701870    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701872    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701875    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701879    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701882    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701885    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701887    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 09:06:58.705109 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701890    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701892    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701895    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701897    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701900    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701902    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701904    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701907    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701909    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701912    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701914    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701916    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701919    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701921    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701924    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701927    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701929    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701933    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701935    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 09:06:58.705614 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701937    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701940    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701943    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701945    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701949    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701951    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701954    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701956    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701959    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701961    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701963    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701966    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701968    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701971    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701974    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701977    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701980    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701982    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701985    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701987    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 09:06:58.706101 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701990    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701992    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701995    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701997    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.701999    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702002    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702004    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702007    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702009    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702030    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702033    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702036    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702039    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702042    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702044    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702047    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702049    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702052    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702054    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702057    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 09:06:58.706564 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702059    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702062    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702065    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702067    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702070    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702072    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702077    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702080    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702082    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702085    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702087    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702090    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702092    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702095    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702097    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702100    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702102    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702105    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702107    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702111    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 09:06:58.707046 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702177    2579 flags.go:64] FLAG: --address="0.0.0.0"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702211    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702217    2579 flags.go:64] FLAG: --anonymous-auth="true"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702222    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702226    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702229    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702238    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702243    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702246    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702249    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702252    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702255    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702258    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702261    2579 flags.go:64] FLAG: --cgroup-root=""
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702264    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702267    2579 flags.go:64] FLAG: --client-ca-file=""
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702270    2579 flags.go:64] FLAG: --cloud-provider="external"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702273    2579 flags.go:64] FLAG: --cluster-dns="[]"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702278    2579 flags.go:64] FLAG: --cluster-domain=""
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702280    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702283    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702286    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702289    2579 flags.go:64] FLAG: --container-log-max-files="5"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702293    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 19 09:06:58.707503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702296    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702299    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702302    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702305    2579 flags.go:64] FLAG: --contention-profiling="false"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702308    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702311    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702313    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702316    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702320    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702322    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702325    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702328    2579 flags.go:64] FLAG: --enable-load-reader="false"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702330    2579 flags.go:64] FLAG: --enable-server="true"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702333    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702339    2579 flags.go:64] FLAG: --event-burst="100"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702342    2579 flags.go:64] FLAG: --event-qps="50"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702345    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702348    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702350    2579 flags.go:64] FLAG: --eviction-hard=""
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702354    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702356    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702359    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702362    2579 flags.go:64] FLAG: --eviction-soft=""
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702365    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702368    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 19 09:06:58.708104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702371    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702375    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702378    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702381    2579 flags.go:64] FLAG: --fail-swap-on="true"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702383    2579 flags.go:64] FLAG: --feature-gates=""
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702387    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702390    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702393    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702396    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702398    2579 flags.go:64] FLAG: --healthz-port="10248"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702401    2579 flags.go:64] FLAG: --help="false"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702404    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-141-190.ec2.internal"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702407    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702409    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702412    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702415    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702418    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702421    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702424    2579 flags.go:64] FLAG: --image-service-endpoint=""
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702426    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702429    2579 flags.go:64] FLAG: --kube-api-burst="100"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702433    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702436    2579 flags.go:64] FLAG: --kube-api-qps="50"
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702439    2579 flags.go:64] FLAG: --kube-reserved=""
Sep 19 09:06:58.708768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702442    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702444    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702447    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702450    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702452    2579 flags.go:64] FLAG: --lock-file=""
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702455    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702458    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702461    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702465    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702470    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702473    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702476    2579 flags.go:64] FLAG: --logging-format="text"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702478    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702481    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702484    2579 flags.go:64] FLAG: --manifest-url=""
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702487    2579 flags.go:64] FLAG: --manifest-url-header=""
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702491    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702494    2579 flags.go:64] FLAG: --max-open-files="1000000"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702497    2579 flags.go:64] FLAG: --max-pods="110"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702500    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702503    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702505    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702508    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702510    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702513    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 19 09:06:58.709367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702516    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702523    2579 flags.go:64] FLAG: --node-status-max-images="50"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702526    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702529    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702533    2579 flags.go:64] FLAG: --pod-cidr=""
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702536    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702541    2579 flags.go:64] FLAG: --pod-manifest-path=""
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702544    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702547    2579 flags.go:64] FLAG: --pods-per-core="0"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702549    2579 flags.go:64] FLAG: --port="10250"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702552    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702555    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09cc9b5f325920a2c"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702558    2579 flags.go:64] FLAG: --qos-reserved=""
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702561    2579 flags.go:64] FLAG: --read-only-port="10255"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702564    2579 flags.go:64] FLAG: --register-node="true"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702566    2579 flags.go:64] FLAG: --register-with-taints=""
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702571    2579 flags.go:64] FLAG: --registry-burst="10"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702573    2579 flags.go:64] FLAG: --registry-qps="5"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702576    2579 flags.go:64] FLAG: --reserved-cpus=""
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702579    2579 flags.go:64] FLAG: --reserved-memory=""
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702582    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702585    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702588    2579 flags.go:64] FLAG: --rotate-certificates="false"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702591    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702593    2579 flags.go:64] FLAG: --runonce="false"
Sep 19 09:06:58.709956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702596    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702599    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702602    2579 flags.go:64] FLAG: --seccomp-default="false"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702604    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702607    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702610    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702613    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702615    2579 flags.go:64] FLAG: --storage-driver-password="root"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702618    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702621    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702623    2579 flags.go:64] FLAG: --storage-driver-user="root"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702626    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702630    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702633    2579 flags.go:64] FLAG: --system-cgroups=""
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702636    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702641    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702643    2579 flags.go:64] FLAG: --tls-cert-file=""
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702646    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702650    2579 flags.go:64] FLAG: --tls-min-version=""
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702652    2579 flags.go:64] FLAG: --tls-private-key-file=""
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702655    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702658    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702660    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702665    2579 flags.go:64] FLAG: --v="2"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702669    2579 flags.go:64] FLAG: --version="false"
Sep 19 09:06:58.710558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702672    2579 flags.go:64] FLAG: --vmodule=""
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702676    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.702679    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702781    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702785    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702788    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702791    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702793    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702796    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702799    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702801    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702805    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702809    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702813    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702816    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702821    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702824    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702826    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702828    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702832    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 09:06:58.711171 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702834    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702837    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702840    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702843    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702845    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702848    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702850    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702852    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702855    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702857    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702860    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702863    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702866    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702868    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702870    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702873    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702875    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702877    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702880    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702883    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 09:06:58.711643 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702885    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702887    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702890    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702892    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702894    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702897    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702899    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702901    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702904    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702906    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702909    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702913    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702916    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702919    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702926    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702928    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702931    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702933    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702936    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 09:06:58.712145 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702938    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702940    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702943    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702945    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702948    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702951    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702953    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702955    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702958    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702960    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702963    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702965    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702968    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702970    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702972    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702975    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702977    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702980    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702984    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702987    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 09:06:58.712596 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702990    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702993    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702995    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.702997    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703000    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703002    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703005    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703007    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703030    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703033    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703035    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703038    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703040    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703042    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703045    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703047    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703050    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703052    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703055    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703057    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 09:06:58.713163 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703061    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703064    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.703067    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.703072    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.709755    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.709769    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.709787    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.709797    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709848    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709853    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709856    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709860    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709863    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709866    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709869    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 09:06:58.713638 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709872    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709876    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709880    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709883    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709885    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709889    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709892    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709895    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709897    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709900    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709902    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709905    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709908    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709910    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709913    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709915    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709918    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709920    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709923    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709925    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 09:06:58.713998 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709928    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709930    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709933    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709936    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709939    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709942    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709944    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709946    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709949    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709951    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709954    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709957    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709960    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709962    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709965    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709967    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709970    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709972    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709976    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709978    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 09:06:58.714466 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709981    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709983    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709986    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709988    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709990    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709993    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709996    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.709998    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710001    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710003    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710006    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710008    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710011    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710031    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710037    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710039    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710042    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710044    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710047    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710049    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 09:06:58.714947 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710052    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710055    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710059    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710061    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710065    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710068    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710071    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710073    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710076    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710078    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710081    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710084    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710087    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710090    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710092    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710095    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710098    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710100    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710102    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 09:06:58.715453 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710104    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710107    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710109    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710112    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710116    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710119    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710122    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710125    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710128    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710130    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710133    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710136    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710138    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.710143    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 09:06:58.715898 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710253    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710258    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710260    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710263    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710265    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710268    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710270    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710273    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710275    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710278    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710280    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710283    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710285    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710288    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710290    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710293    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710295    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710298    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710300    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710303    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 09:06:58.716286 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710305    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710307    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710310    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710312    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710314    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710317    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710320    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710322    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710325    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710327    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710329    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710332    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710334    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710337    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710339    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710341    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710344    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710346    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710348    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 09:06:58.716753 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710351    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710353    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710355    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710358    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710360    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710363    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710365    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710367    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710370    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710372    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710374    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710377    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710379    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710381    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710384    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710386    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710389    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710391    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710393    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710396    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710398    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 09:06:58.717216 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710401    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710403    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710405    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710408    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710410    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710412    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710415    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710417    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710420    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710422    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710424    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710427    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710429    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710431    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710434    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710436    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710439    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710441    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710443    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710446    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 09:06:58.718055 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710448    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710451    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710453    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710456    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710458    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710461    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710463    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710466    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710468    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710471    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710473    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710475    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710478    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710481    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710485    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710487    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710491    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710495    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 09:06:58.718674 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:58.710498    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 09:06:58.719225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.710502    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 09:06:58.719225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.710598    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 19 09:06:58.719225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.712572    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 19 09:06:58.719225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.713299    2579 server.go:1019] "Starting client certificate rotation"
Sep 19 09:06:58.719225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.713401    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 09:06:58.719225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.713427    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 09:06:58.719225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.715491    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 09:06:58.720922 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.718270    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 09:06:58.726361 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.726345    2579 log.go:25] "Validated CRI v1 runtime API"
Sep 19 09:06:58.727877 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.727862    2579 log.go:25] "Validated CRI v1 image API"
Sep 19 09:06:58.728657 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.728642    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 19 09:06:58.731294 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.731276    2579 fs.go:135] Filesystem UUIDs: map[24531e84-bf84-42f5-808b-cbb198d46baa:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ec3b1167-6309-4201-a7b2-aa83e78373f6:/dev/nvme0n1p3]
Sep 19 09:06:58.731337 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.731295    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 19 09:06:58.735219 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.735114    2579 manager.go:216] Machine: {Timestamp:2026-09-19 09:06:58.734659732 +0000 UTC m=+1.901854961 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3223261 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21fcf4bafd14cff4f1f3f8fbd09a7c SystemUUID:ec21fcf4-bafd-14cf-f4f1-f3f8fbd09a7c BootID:dc80bddb-ebd0-4228-a966-efaa3805aa8a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ce:50:ac:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ce:50:ac:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:16:7a:5a:f5:06 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 19 09:06:58.735219 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.735215    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 19 09:06:58.735321 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.735306    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 19 09:06:58.736654 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.736633    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 19 09:06:58.736819 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.736656    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-190.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 19 09:06:58.737770 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.737760    2579 topology_manager.go:138] "Creating topology manager with none policy"
Sep 19 09:06:58.737809 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.737773    2579 container_manager_linux.go:309] "Creating device plugin manager"
Sep 19 09:06:58.737809 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.737782    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 09:06:58.737809 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.737794    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 09:06:58.737888 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.737861    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 19 09:06:58.741682 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.741671    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 09:06:58.741791 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.741782    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 19 09:06:58.741833 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.741825    2579 kubelet.go:486] "Attempting to sync node with API server"
Sep 19 09:06:58.741866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.741841    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 19 09:06:58.741866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.741855    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 19 09:06:58.741866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.741864    2579 kubelet.go:398] "Adding apiserver pod source"
Sep 19 09:06:58.741947 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.741873    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 19 09:06:58.742295 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.742278    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 09:06:58.742404 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.742303    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 09:06:58.751835 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.751812    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 09:06:58.752717 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.744060    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 19 09:06:58.754981 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.754968    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 19 09:06:58.755048 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.754997    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 19 09:06:58.756132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756118    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 19 09:06:58.756132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756134    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756140    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756146    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756154    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756159    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756173    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756178    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756185    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756191    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756199    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756203    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756225    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 19 09:06:58.756225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.756230    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 19 09:06:58.759075 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.759056    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 19 09:06:58.759154 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.759068    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 19 09:06:58.759229 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.759216    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-190.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 19 09:06:58.759852 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.759840    2579 server.go:1268] "Started kubelet"
Sep 19 09:06:58.759955 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.759929    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 19 09:06:58.760040 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.759928    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 19 09:06:58.760095 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.760059    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 19 09:06:58.789375 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.789341    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 19 09:06:58.789469 ip-10-0-141-190 systemd[1]: Started Kubernetes Kubelet.
Sep 19 09:06:58.791239 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.791147    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 19 09:06:58.791720 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.791694    2579 server.go:310] "Adding debug handlers to kubelet server"
Sep 19 09:06:58.796314 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.796295    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 19 09:06:58.796395 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.796316    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 19 09:06:58.796395 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.796377    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:58.796794 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.796776    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 19 09:06:58.796861 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.796797    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 19 09:06:58.796893 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.796775    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 19 09:06:58.796921 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.796911    2579 reconstruct.go:97] "Volume reconstruction finished"
Sep 19 09:06:58.796921 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.796917    2579 reconciler.go:29] "Reconciler: start to sync state"
Sep 19 09:06:58.797250 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.797233    2579 factory.go:55] Registering systemd factory
Sep 19 09:06:58.797250 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.797251    2579 factory.go:223] Registration of the systemd container factory successfully
Sep 19 09:06:58.797428 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.797417    2579 factory.go:153] Registering CRI-O factory
Sep 19 09:06:58.797428 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.797428    2579 factory.go:223] Registration of the crio container factory successfully
Sep 19 09:06:58.797523 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.797476    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 19 09:06:58.797523 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.797495    2579 factory.go:103] Registering Raw factory
Sep 19 09:06:58.797523 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.797509    2579 manager.go:1196] Started watching for new ooms in manager
Sep 19 09:06:58.797954 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.797944    2579 manager.go:349] Starting recovery of all containers
Sep 19 09:06:58.808700 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.808129    2579 manager.go:354] Recovery completed
Sep 19 09:06:58.808700 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.808147    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 19 09:06:58.808700 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.808297    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 19 09:06:58.809124 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.808264    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-190.ec2.internal.18d6ada34a0a48f7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-190.ec2.internal,UID:ip-10-0-141-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-190.ec2.internal,},FirstTimestamp:2026-09-19 09:06:58.759813367 +0000 UTC m=+1.927008588,LastTimestamp:2026-09-19 09:06:58.759813367 +0000 UTC m=+1.927008588,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-190.ec2.internal,}"
Sep 19 09:06:58.809777 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.809748    2579 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 19 09:06:58.813070 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.813055    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 09:06:58.815166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.815144    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 09:06:58.815235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.815183    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 09:06:58.815235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.815196    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientPID"
Sep 19 09:06:58.815703 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.815692    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 19 09:06:58.815757 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.815704    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 19 09:06:58.815757 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.815721    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 09:06:58.815757 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.815725    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 09:06:58.816536 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.816519    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 09:06:58.816536 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.816547    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 09:06:58.816651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.816557    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientPID"
Sep 19 09:06:58.817961 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.817950    2579 policy_none.go:49] "None policy: Start"
Sep 19 09:06:58.818002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.817965    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 19 09:06:58.818002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.817974    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 19 09:06:58.820045 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.820006    2579 policy_none.go:47] "Start"
Sep 19 09:06:58.820668 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.820448    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-190.ec2.internal.18d6ada34d56e9f3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-190.ec2.internal,UID:ip-10-0-141-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-190.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-190.ec2.internal,},FirstTimestamp:2026-09-19 09:06:58.815166963 +0000 UTC m=+1.982362200,LastTimestamp:2026-09-19 09:06:58.815166963 +0000 UTC m=+1.982362200,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-190.ec2.internal,}"
Sep 19 09:06:58.831833 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.831761    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-190.ec2.internal.18d6ada34d5741db  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-190.ec2.internal,UID:ip-10-0-141-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-190.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-190.ec2.internal,},FirstTimestamp:2026-09-19 09:06:58.815189467 +0000 UTC m=+1.982384689,LastTimestamp:2026-09-19 09:06:58.815189467 +0000 UTC m=+1.982384689,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-190.ec2.internal,}"
Sep 19 09:06:58.843847 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.843481    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-190.ec2.internal.18d6ada34d57710d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-190.ec2.internal,UID:ip-10-0-141-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-190.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-190.ec2.internal,},FirstTimestamp:2026-09-19 09:06:58.815201549 +0000 UTC m=+1.982396772,LastTimestamp:2026-09-19 09:06:58.815201549 +0000 UTC m=+1.982396772,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-190.ec2.internal,}"
Sep 19 09:06:58.847693 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.847676    2579 manager.go:337] "Starting Device Plugin manager"
Sep 19 09:06:58.847818 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.847714    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 19 09:06:58.847818 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.847723    2579 server.go:87] "Starting device plugin registration server"
Sep 19 09:06:58.847991 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.847979    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 19 09:06:58.848096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.848003    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 19 09:06:58.848145 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.848121    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 19 09:06:58.848533 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.848205    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 19 09:06:58.848533 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.848216    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 19 09:06:58.848739 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.848723    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 19 09:06:58.848788 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.848769    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:58.855080 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.854983    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-190.ec2.internal.18d6ada34d56e9f3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-190.ec2.internal.18d6ada34d56e9f3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-190.ec2.internal,UID:ip-10-0-141-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-190.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-190.ec2.internal,},FirstTimestamp:2026-09-19 09:06:58.815166963 +0000 UTC m=+1.982362200,LastTimestamp:2026-09-19 09:06:58.816533449 +0000 UTC m=+1.983728670,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-190.ec2.internal,}"
Sep 19 09:06:58.872300 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.867504    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-190.ec2.internal.18d6ada34d5741db\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-190.ec2.internal.18d6ada34d5741db  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-190.ec2.internal,UID:ip-10-0-141-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-190.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-190.ec2.internal,},FirstTimestamp:2026-09-19 09:06:58.815189467 +0000 UTC m=+1.982384689,LastTimestamp:2026-09-19 09:06:58.816551568 +0000 UTC m=+1.983746788,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-190.ec2.internal,}"
Sep 19 09:06:58.876230 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.876170    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-190.ec2.internal.18d6ada34d57710d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-190.ec2.internal.18d6ada34d57710d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-190.ec2.internal,UID:ip-10-0-141-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-190.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-190.ec2.internal,},FirstTimestamp:2026-09-19 09:06:58.815201549 +0000 UTC m=+1.982396772,LastTimestamp:2026-09-19 09:06:58.816560608 +0000 UTC m=+1.983755828,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-190.ec2.internal,}"
Sep 19 09:06:58.884925 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.884861    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-190.ec2.internal.18d6ada34fec8e2e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-190.ec2.internal,UID:ip-10-0-141-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-141-190.ec2.internal,},FirstTimestamp:2026-09-19 09:06:58.858528302 +0000 UTC m=+2.025723516,LastTimestamp:2026-09-19 09:06:58.858528302 +0000 UTC m=+2.025723516,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-190.ec2.internal,}"
Sep 19 09:06:58.895231 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.895209    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 19 09:06:58.896485 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.896464    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 19 09:06:58.896552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.896517    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 19 09:06:58.896552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.896544    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 19 09:06:58.896639 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.896586    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 19 09:06:58.898660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.898643    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2hmvf"
Sep 19 09:06:58.906128 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.906104    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 19 09:06:58.913028 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.912997    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2hmvf"
Sep 19 09:06:58.949087 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.949039    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 09:06:58.949963 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.949945    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 09:06:58.950070 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.949971    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 09:06:58.950070 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.949981    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientPID"
Sep 19 09:06:58.950070 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.950004    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-190.ec2.internal"
Sep 19 09:06:58.994733 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.994709    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-190.ec2.internal"
Sep 19 09:06:58.994733 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:58.994734    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-190.ec2.internal\": node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:58.996882 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.996854    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-190.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal"]
Sep 19 09:06:58.996974 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.996917    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 09:06:58.997149 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.997135    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c80dc006f68abf1cd999156c6067d05e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-190.ec2.internal\" (UID: \"c80dc006f68abf1cd999156c6067d05e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:58.998676 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.998661    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 09:06:58.998750 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.998693    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 09:06:58.998750 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:58.998707    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientPID"
Sep 19 09:06:59.000976 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.000962    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 09:06:59.001124 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.001109    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.001175 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.001139    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 09:06:59.002871 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.002856    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 09:06:59.002954 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.002889    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 09:06:59.002954 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.002898    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientPID"
Sep 19 09:06:59.002954 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.002937    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 09:06:59.003117 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.002961    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 09:06:59.003117 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.002974    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientPID"
Sep 19 09:06:59.005235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.005217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.005306 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.005252    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 09:06:59.005963 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.005949    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 09:06:59.006034 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.005983    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 09:06:59.006034 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.005999    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientPID"
Sep 19 09:06:59.019605 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.019583    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-190.ec2.internal\" not found" node="ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.023423 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.023407    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-190.ec2.internal\" not found" node="ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.055268 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.055245    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:59.097321 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.097292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c80dc006f68abf1cd999156c6067d05e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-190.ec2.internal\" (UID: \"c80dc006f68abf1cd999156c6067d05e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.097463 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.097330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c80dc006f68abf1cd999156c6067d05e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-190.ec2.internal\" (UID: \"c80dc006f68abf1cd999156c6067d05e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.155533 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.155494    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:59.198427 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.198378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbcdd6679a6e77f8381bc386784a1377-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal\" (UID: \"dbcdd6679a6e77f8381bc386784a1377\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.198505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.198433    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbcdd6679a6e77f8381bc386784a1377-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal\" (UID: \"dbcdd6679a6e77f8381bc386784a1377\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.255928 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.255847    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:59.299221 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.299189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbcdd6679a6e77f8381bc386784a1377-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal\" (UID: \"dbcdd6679a6e77f8381bc386784a1377\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.299221 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.299228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbcdd6679a6e77f8381bc386784a1377-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal\" (UID: \"dbcdd6679a6e77f8381bc386784a1377\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.299376 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.299273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbcdd6679a6e77f8381bc386784a1377-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal\" (UID: \"dbcdd6679a6e77f8381bc386784a1377\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.299376 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.299316    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbcdd6679a6e77f8381bc386784a1377-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal\" (UID: \"dbcdd6679a6e77f8381bc386784a1377\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.323384 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.323354    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.326440 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.326422    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal"
Sep 19 09:06:59.356484 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.356454    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:59.457004 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.456967    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:59.557518 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.557488    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:59.658076 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.658045    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:59.713757 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.713731    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 19 09:06:59.758158 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.758129    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:59.859152 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.859082    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:06:59.897125 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:59.897084    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80dc006f68abf1cd999156c6067d05e.slice/crio-5e364440e4fc571820977baed4d8d4aedb0d97ee845512e9f263b9e8912d9f66 WatchSource:0}: Error finding container 5e364440e4fc571820977baed4d8d4aedb0d97ee845512e9f263b9e8912d9f66: Status 404 returned error can't find the container with id 5e364440e4fc571820977baed4d8d4aedb0d97ee845512e9f263b9e8912d9f66
Sep 19 09:06:59.897376 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:06:59.897349    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbcdd6679a6e77f8381bc386784a1377.slice/crio-f03c0c96098922a77c2b6c2042a9dcadea57b1a0223c66d004e18c2b50232e74 WatchSource:0}: Error finding container f03c0c96098922a77c2b6c2042a9dcadea57b1a0223c66d004e18c2b50232e74: Status 404 returned error can't find the container with id f03c0c96098922a77c2b6c2042a9dcadea57b1a0223c66d004e18c2b50232e74
Sep 19 09:06:59.901856 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.901842    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 09:06:59.918361 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.918324    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 09:01:58 +0000 UTC" deadline="2028-04-05 00:07:05.532833204 +0000 UTC"
Sep 19 09:06:59.918361 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.918352    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13527h0m5.614484642s"
Sep 19 09:06:59.940581 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.940563    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 09:06:59.941622 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.941606    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 09:06:59.941715 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.941642    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 09:06:59.941715 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:06:59.941656    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeHasSufficientPID"
Sep 19 09:06:59.959718 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:06:59.959689    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:07:00.020531 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.020501    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 09:07:00.060437 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.060390    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-190.ec2.internal\" not found"
Sep 19 09:07:00.136569 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.136500    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 09:07:00.196757 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.196722    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-190.ec2.internal"
Sep 19 09:07:00.217116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.217091    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 09:07:00.217967 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.217953    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal"
Sep 19 09:07:00.254456 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.254426    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 09:07:00.256968 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.256943    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 09:07:00.306465 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.306435    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 09:07:00.743825 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.743787    2579 apiserver.go:52] "Watching apiserver"
Sep 19 09:07:00.752352 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.752327    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 19 09:07:00.752745 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.752720    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-7xjhg","openshift-image-registry/node-ca-n85bz","openshift-multus/multus-additional-cni-plugins-zh4cx","openshift-network-diagnostics/network-check-target-cs9lj","openshift-network-operator/iptables-alerter-c66h9","openshift-ovn-kubernetes/ovnkube-node-zl6hn","kube-system/global-pull-secret-syncer-zsz2b","kube-system/konnectivity-agent-xqt5w","kube-system/kube-apiserver-proxy-ip-10-0-141-190.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr","openshift-cluster-node-tuning-operator/tuned-q9zmf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal","openshift-multus/multus-bg288","openshift-multus/network-metrics-daemon-rv72r"]
Sep 19 09:07:00.755306 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.755286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.758738 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.758471    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:00.758738 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.758542    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:00.759061 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.759004    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 19 09:07:00.759153 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.759057    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 19 09:07:00.759349 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.759331    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 19 09:07:00.759598 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.759580    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 19 09:07:00.760033 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.759650    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 19 09:07:00.760311 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.760161    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fs6mh\""
Sep 19 09:07:00.761109 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.761081    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:00.761183 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.761153    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:00.765665 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.765261    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n85bz"
Sep 19 09:07:00.767581 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.767561    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c66h9"
Sep 19 09:07:00.768125 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.768106    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 19 09:07:00.768225 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.768152    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 19 09:07:00.768550 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.768527    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nvxjc\""
Sep 19 09:07:00.768617 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.768537    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 19 09:07:00.770357 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.770331    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.772234 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.772218    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 19 09:07:00.772529 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.772502    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 19 09:07:00.772962 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.772853    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7xjhg"
Sep 19 09:07:00.775046 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.775008    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:00.775193 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.775175    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xcghg\""
Sep 19 09:07:00.775746 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.775597    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 19 09:07:00.775746 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.775639    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 19 09:07:00.775746 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.775699    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 19 09:07:00.775940 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.775806    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 19 09:07:00.775940 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.775913    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 19 09:07:00.776427 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.776407    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 19 09:07:00.776510 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.776459    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 19 09:07:00.776510 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.776476    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5sslj\""
Sep 19 09:07:00.776698 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.776676    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cl85h\""
Sep 19 09:07:00.776767 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.776739    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 19 09:07:00.776843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.776830    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 19 09:07:00.778421 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.777543    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.779889 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.779872    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.782249 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.782229    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.784597 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.784574    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:00.784696 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.784653    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:00.788187 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.788165    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 19 09:07:00.788344 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.788328    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mkfsk\""
Sep 19 09:07:00.788477 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.788457    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 19 09:07:00.788529 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.788477    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 19 09:07:00.788659 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.788644    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 19 09:07:00.788698 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.788675    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 19 09:07:00.788744 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.788732    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 19 09:07:00.788871 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.788854    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-st6b2\""
Sep 19 09:07:00.788934 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.788914    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 19 09:07:00.789107 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.789092    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 19 09:07:00.789174 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.789154    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cmxbx\""
Sep 19 09:07:00.789332 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.789318    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tqk6r\""
Sep 19 09:07:00.796813 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.796788    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 19 09:07:00.797784 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.797723    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 19 09:07:00.805635 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805612    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-sysctl-d\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.805739 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e78dedf-d775-4f5e-aa81-eb8ad545778f-system-cni-dir\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.805739 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805676    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-device-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.805739 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-run-openvswitch\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.805739 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03d6d2c6-8bc4-4757-aef3-99004ca362df-ovn-node-metrics-cert\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.805739 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03d6d2c6-8bc4-4757-aef3-99004ca362df-ovnkube-script-lib\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.805977 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3aaf3b2-8876-4116-a29c-0d048f54cb72-cni-binary-copy\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.805977 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-etc-kubernetes\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.805977 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805789    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-kubernetes\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.805977 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-systemd\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.805977 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-run\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.805977 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-sys\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.805977 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-cni-dir\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.805977 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.805965    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-var-lib-cni-bin\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806005    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg6gw\" (UniqueName: \"kubernetes.io/projected/9e78dedf-d775-4f5e-aa81-eb8ad545778f-kube-api-access-qg6gw\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5mdp\" (UniqueName: \"kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp\") pod \"network-check-target-cs9lj\" (UID: \"05540c93-6c4e-4ffb-a203-5901e567d0c8\") " pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fbfab23c-1ebd-4346-b591-b41f41f2b702-iptables-alerter-script\") pod \"iptables-alerter-c66h9\" (UID: \"fbfab23c-1ebd-4346-b591-b41f41f2b702\") " pod="openshift-network-operator/iptables-alerter-c66h9"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smq77\" (UniqueName: \"kubernetes.io/projected/41747fa9-438f-414d-8b1b-8a56fb5dc6d7-kube-api-access-smq77\") pod \"node-resolver-7xjhg\" (UID: \"41747fa9-438f-414d-8b1b-8a56fb5dc6d7\") " pod="openshift-dns/node-resolver-7xjhg"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5799141e-22e4-471c-bba1-73f8782d6c46-konnectivity-ca\") pod \"konnectivity-agent-xqt5w\" (UID: \"5799141e-22e4-471c-bba1-73f8782d6c46\") " pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-socket-dir-parent\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/680d6b24-fc31-40bd-942a-e1f3d3647be2-kubelet-config\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z62zx\" (UniqueName: \"kubernetes.io/projected/03d6d2c6-8bc4-4757-aef3-99004ca362df-kube-api-access-z62zx\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-modprobe-d\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806293    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sshsm\" (UniqueName: \"kubernetes.io/projected/c3aaf3b2-8876-4116-a29c-0d048f54cb72-kube-api-access-sshsm\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806318    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-sysctl-conf\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-var-lib-kubelet\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-etc-selinux\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.806402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-cni-bin\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03d6d2c6-8bc4-4757-aef3-99004ca362df-env-overrides\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-host\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-tuned\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e78dedf-d775-4f5e-aa81-eb8ad545778f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9ms5\" (UniqueName: \"kubernetes.io/projected/fbfab23c-1ebd-4346-b591-b41f41f2b702-kube-api-access-x9ms5\") pod \"iptables-alerter-c66h9\" (UID: \"fbfab23c-1ebd-4346-b591-b41f41f2b702\") " pod="openshift-network-operator/iptables-alerter-c66h9"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-socket-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-slash\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-run-netns\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-run-systemd\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806644    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-run-netns\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806672    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-conf-dir\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e78dedf-d775-4f5e-aa81-eb8ad545778f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/680d6b24-fc31-40bd-942a-e1f3d3647be2-dbus\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806734    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-systemd-units\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-run-k8s-cni-cncf-io\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.807029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-daemon-config\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806790    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chklw\" (UniqueName: \"kubernetes.io/projected/33065bce-502e-4912-9d83-7cb832c0b265-kube-api-access-chklw\") pod \"node-ca-n85bz\" (UID: \"33065bce-502e-4912-9d83-7cb832c0b265\") " pod="openshift-image-registry/node-ca-n85bz"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806818    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41747fa9-438f-414d-8b1b-8a56fb5dc6d7-hosts-file\") pod \"node-resolver-7xjhg\" (UID: \"41747fa9-438f-414d-8b1b-8a56fb5dc6d7\") " pod="openshift-dns/node-resolver-7xjhg"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62bz6\" (UniqueName: \"kubernetes.io/projected/729a5514-7d0f-4e0d-9442-387783dd6e82-kube-api-access-62bz6\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-cni-netd\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806889    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2vfz\" (UniqueName: \"kubernetes.io/projected/7957c300-67ee-4732-a5c4-75ffc15fd793-kube-api-access-z2vfz\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e78dedf-d775-4f5e-aa81-eb8ad545778f-cni-binary-copy\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-run-multus-certs\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-var-lib-openvswitch\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806962    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-etc-openvswitch\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.806989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-log-socket\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33065bce-502e-4912-9d83-7cb832c0b265-host\") pod \"node-ca-n85bz\" (UID: \"33065bce-502e-4912-9d83-7cb832c0b265\") " pod="openshift-image-registry/node-ca-n85bz"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807100    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-var-lib-kubelet\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-sysconfig\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfd7w\" (UniqueName: \"kubernetes.io/projected/bb178fa3-0d0b-4339-a64a-948a9c5de385-kube-api-access-sfd7w\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.807734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-system-cni-dir\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-cnibin\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-registration-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-kubelet\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-run-ovn\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-run-ovn-kubernetes\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03d6d2c6-8bc4-4757-aef3-99004ca362df-ovnkube-config\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807420    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-lib-modules\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-var-lib-cni-multus\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e78dedf-d775-4f5e-aa81-eb8ad545778f-cnibin\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33065bce-502e-4912-9d83-7cb832c0b265-serviceca\") pod \"node-ca-n85bz\" (UID: \"33065bce-502e-4912-9d83-7cb832c0b265\") " pod="openshift-image-registry/node-ca-n85bz"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41747fa9-438f-414d-8b1b-8a56fb5dc6d7-tmp-dir\") pod \"node-resolver-7xjhg\" (UID: \"41747fa9-438f-414d-8b1b-8a56fb5dc6d7\") " pod="openshift-dns/node-resolver-7xjhg"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e78dedf-d775-4f5e-aa81-eb8ad545778f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5799141e-22e4-471c-bba1-73f8782d6c46-agent-certs\") pod \"konnectivity-agent-xqt5w\" (UID: \"5799141e-22e4-471c-bba1-73f8782d6c46\") " pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:00.808392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807547    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:00.809047 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-hostroot\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.809047 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb178fa3-0d0b-4339-a64a-948a9c5de385-tmp\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.809047 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbfab23c-1ebd-4346-b591-b41f41f2b702-host-slash\") pod \"iptables-alerter-c66h9\" (UID: \"fbfab23c-1ebd-4346-b591-b41f41f2b702\") " pod="openshift-network-operator/iptables-alerter-c66h9"
Sep 19 09:07:00.809047 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-sys-fs\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.809047 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.807637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-node-log\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.818249 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.818230    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 09:07:00.849978 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.849953    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7cpzw"
Sep 19 09:07:00.859700 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.859674    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7cpzw"
Sep 19 09:07:00.901469 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.901427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal" event={"ID":"dbcdd6679a6e77f8381bc386784a1377","Type":"ContainerStarted","Data":"f03c0c96098922a77c2b6c2042a9dcadea57b1a0223c66d004e18c2b50232e74"}
Sep 19 09:07:00.902565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.902538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-190.ec2.internal" event={"ID":"c80dc006f68abf1cd999156c6067d05e","Type":"ContainerStarted","Data":"5e364440e4fc571820977baed4d8d4aedb0d97ee845512e9f263b9e8912d9f66"}
Sep 19 09:07:00.907844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.907813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03d6d2c6-8bc4-4757-aef3-99004ca362df-env-overrides\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.907948 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.907842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-host\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.907948 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.907865    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-tuned\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.907948 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.907895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e78dedf-d775-4f5e-aa81-eb8ad545778f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.907948 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.907922    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9ms5\" (UniqueName: \"kubernetes.io/projected/fbfab23c-1ebd-4346-b591-b41f41f2b702-kube-api-access-x9ms5\") pod \"iptables-alerter-c66h9\" (UID: \"fbfab23c-1ebd-4346-b591-b41f41f2b702\") " pod="openshift-network-operator/iptables-alerter-c66h9"
Sep 19 09:07:00.908157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.907946    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-host\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.908157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.907948    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-socket-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.908157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908004    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-slash\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.908157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-run-netns\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.908157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-run-systemd\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.908157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908086    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-socket-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.908157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-slash\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.908157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908135    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-run-netns\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.908157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908148    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e78dedf-d775-4f5e-aa81-eb8ad545778f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908089    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-run-netns\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-run-systemd\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-conf-dir\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e78dedf-d775-4f5e-aa81-eb8ad545778f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908224    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908232    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/680d6b24-fc31-40bd-942a-e1f3d3647be2-dbus\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908263    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-systemd-units\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908277    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-conf-dir\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-run-k8s-cni-cncf-io\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-daemon-config\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chklw\" (UniqueName: \"kubernetes.io/projected/33065bce-502e-4912-9d83-7cb832c0b265-kube-api-access-chklw\") pod \"node-ca-n85bz\" (UID: \"33065bce-502e-4912-9d83-7cb832c0b265\") " pod="openshift-image-registry/node-ca-n85bz"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41747fa9-438f-414d-8b1b-8a56fb5dc6d7-hosts-file\") pod \"node-resolver-7xjhg\" (UID: \"41747fa9-438f-414d-8b1b-8a56fb5dc6d7\") " pod="openshift-dns/node-resolver-7xjhg"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62bz6\" (UniqueName: \"kubernetes.io/projected/729a5514-7d0f-4e0d-9442-387783dd6e82-kube-api-access-62bz6\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908385    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/680d6b24-fc31-40bd-942a-e1f3d3647be2-dbus\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908307    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03d6d2c6-8bc4-4757-aef3-99004ca362df-env-overrides\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-run-k8s-cni-cncf-io\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41747fa9-438f-414d-8b1b-8a56fb5dc6d7-hosts-file\") pod \"node-resolver-7xjhg\" (UID: \"41747fa9-438f-414d-8b1b-8a56fb5dc6d7\") " pod="openshift-dns/node-resolver-7xjhg"
Sep 19 09:07:00.908583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908518    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-systemd-units\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908552    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-run-netns\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908641    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e78dedf-d775-4f5e-aa81-eb8ad545778f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-cni-netd\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2vfz\" (UniqueName: \"kubernetes.io/projected/7957c300-67ee-4732-a5c4-75ffc15fd793-kube-api-access-z2vfz\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-cni-netd\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908756    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e78dedf-d775-4f5e-aa81-eb8ad545778f-cni-binary-copy\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-run-multus-certs\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-var-lib-openvswitch\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908835    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-etc-openvswitch\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-log-socket\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908877    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-daemon-config\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33065bce-502e-4912-9d83-7cb832c0b265-host\") pod \"node-ca-n85bz\" (UID: \"33065bce-502e-4912-9d83-7cb832c0b265\") " pod="openshift-image-registry/node-ca-n85bz"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908889    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-var-lib-openvswitch\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908928    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-var-lib-kubelet\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908934    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-log-socket\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.909552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-sysconfig\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-etc-openvswitch\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.908967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-run-multus-certs\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33065bce-502e-4912-9d83-7cb832c0b265-host\") pod \"node-ca-n85bz\" (UID: \"33065bce-502e-4912-9d83-7cb832c0b265\") " pod="openshift-image-registry/node-ca-n85bz"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfd7w\" (UniqueName: \"kubernetes.io/projected/bb178fa3-0d0b-4339-a64a-948a9c5de385-kube-api-access-sfd7w\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909044    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-sysconfig\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-system-cni-dir\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-cnibin\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909117    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e78dedf-d775-4f5e-aa81-eb8ad545778f-cni-binary-copy\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-var-lib-kubelet\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-cnibin\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.909245    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-registration-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-system-cni-dir\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.909340    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs podName:7957c300-67ee-4732-a5c4-75ffc15fd793 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:01.409309429 +0000 UTC m=+4.576504655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs") pod "network-metrics-daemon-rv72r" (UID: "7957c300-67ee-4732-a5c4-75ffc15fd793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:00.910313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-registration-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-kubelet\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-run-ovn\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909421    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-kubelet\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-run-ovn-kubernetes\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909469    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-run-ovn\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03d6d2c6-8bc4-4757-aef3-99004ca362df-ovnkube-config\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909552    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-run-ovn-kubernetes\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-lib-modules\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909577    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-var-lib-cni-multus\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e78dedf-d775-4f5e-aa81-eb8ad545778f-cnibin\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-var-lib-cni-multus\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33065bce-502e-4912-9d83-7cb832c0b265-serviceca\") pod \"node-ca-n85bz\" (UID: \"33065bce-502e-4912-9d83-7cb832c0b265\") " pod="openshift-image-registry/node-ca-n85bz"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41747fa9-438f-414d-8b1b-8a56fb5dc6d7-tmp-dir\") pod \"node-resolver-7xjhg\" (UID: \"41747fa9-438f-414d-8b1b-8a56fb5dc6d7\") " pod="openshift-dns/node-resolver-7xjhg"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909748    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-lib-modules\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.911066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909783    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e78dedf-d775-4f5e-aa81-eb8ad545778f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5799141e-22e4-471c-bba1-73f8782d6c46-agent-certs\") pod \"konnectivity-agent-xqt5w\" (UID: \"5799141e-22e4-471c-bba1-73f8782d6c46\") " pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-hostroot\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb178fa3-0d0b-4339-a64a-948a9c5de385-tmp\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbfab23c-1ebd-4346-b591-b41f41f2b702-host-slash\") pod \"iptables-alerter-c66h9\" (UID: \"fbfab23c-1ebd-4346-b591-b41f41f2b702\") " pod="openshift-network-operator/iptables-alerter-c66h9"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909975    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-sys-fs\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-node-log\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41747fa9-438f-414d-8b1b-8a56fb5dc6d7-tmp-dir\") pod \"node-resolver-7xjhg\" (UID: \"41747fa9-438f-414d-8b1b-8a56fb5dc6d7\") " pod="openshift-dns/node-resolver-7xjhg"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-sysctl-d\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e78dedf-d775-4f5e-aa81-eb8ad545778f-system-cni-dir\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-sysctl-d\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910175    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e78dedf-d775-4f5e-aa81-eb8ad545778f-system-cni-dir\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-device-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-hostroot\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-device-dir\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.910261    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910281    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-node-log\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.911660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910291    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e78dedf-d775-4f5e-aa81-eb8ad545778f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-run-openvswitch\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.910323    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret podName:680d6b24-fc31-40bd-942a-e1f3d3647be2 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:01.410307592 +0000 UTC m=+4.577502808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret") pod "global-pull-secret-syncer-zsz2b" (UID: "680d6b24-fc31-40bd-942a-e1f3d3647be2") : object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.909931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03d6d2c6-8bc4-4757-aef3-99004ca362df-ovnkube-config\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e78dedf-d775-4f5e-aa81-eb8ad545778f-cnibin\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-run-openvswitch\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910437    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-sys-fs\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910447    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbfab23c-1ebd-4346-b591-b41f41f2b702-host-slash\") pod \"iptables-alerter-c66h9\" (UID: \"fbfab23c-1ebd-4346-b591-b41f41f2b702\") " pod="openshift-network-operator/iptables-alerter-c66h9"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03d6d2c6-8bc4-4757-aef3-99004ca362df-ovn-node-metrics-cert\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03d6d2c6-8bc4-4757-aef3-99004ca362df-ovnkube-script-lib\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910530    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3aaf3b2-8876-4116-a29c-0d048f54cb72-cni-binary-copy\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-etc-kubernetes\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910609    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33065bce-502e-4912-9d83-7cb832c0b265-serviceca\") pod \"node-ca-n85bz\" (UID: \"33065bce-502e-4912-9d83-7cb832c0b265\") " pod="openshift-image-registry/node-ca-n85bz"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-kubernetes\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-systemd\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-run\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910852    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-systemd\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.912380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-sys\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-cni-dir\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910922    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-var-lib-cni-bin\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.910982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-cni-dir\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911037    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6gw\" (UniqueName: \"kubernetes.io/projected/9e78dedf-d775-4f5e-aa81-eb8ad545778f-kube-api-access-qg6gw\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mdp\" (UniqueName: \"kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp\") pod \"network-check-target-cs9lj\" (UID: \"05540c93-6c4e-4ffb-a203-5901e567d0c8\") " pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fbfab23c-1ebd-4346-b591-b41f41f2b702-iptables-alerter-script\") pod \"iptables-alerter-c66h9\" (UID: \"fbfab23c-1ebd-4346-b591-b41f41f2b702\") " pod="openshift-network-operator/iptables-alerter-c66h9"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smq77\" (UniqueName: \"kubernetes.io/projected/41747fa9-438f-414d-8b1b-8a56fb5dc6d7-kube-api-access-smq77\") pod \"node-resolver-7xjhg\" (UID: \"41747fa9-438f-414d-8b1b-8a56fb5dc6d7\") " pod="openshift-dns/node-resolver-7xjhg"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5799141e-22e4-471c-bba1-73f8782d6c46-konnectivity-ca\") pod \"konnectivity-agent-xqt5w\" (UID: \"5799141e-22e4-471c-bba1-73f8782d6c46\") " pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911217    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-etc-kubernetes\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03d6d2c6-8bc4-4757-aef3-99004ca362df-ovnkube-script-lib\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911268    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-kubernetes\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-socket-dir-parent\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-sys\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/680d6b24-fc31-40bd-942a-e1f3d3647be2-kubelet-config\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z62zx\" (UniqueName: \"kubernetes.io/projected/03d6d2c6-8bc4-4757-aef3-99004ca362df-kube-api-access-z62zx\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-modprobe-d\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.913222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911418    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-run\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911882    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5799141e-22e4-471c-bba1-73f8782d6c46-konnectivity-ca\") pod \"konnectivity-agent-xqt5w\" (UID: \"5799141e-22e4-471c-bba1-73f8782d6c46\") " pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911927    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-host-var-lib-cni-bin\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911944    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fbfab23c-1ebd-4346-b591-b41f41f2b702-iptables-alerter-script\") pod \"iptables-alerter-c66h9\" (UID: \"fbfab23c-1ebd-4346-b591-b41f41f2b702\") " pod="openshift-network-operator/iptables-alerter-c66h9"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.911951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3aaf3b2-8876-4116-a29c-0d048f54cb72-cni-binary-copy\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912049    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3aaf3b2-8876-4116-a29c-0d048f54cb72-multus-socket-dir-parent\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sshsm\" (UniqueName: \"kubernetes.io/projected/c3aaf3b2-8876-4116-a29c-0d048f54cb72-kube-api-access-sshsm\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912095    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/680d6b24-fc31-40bd-942a-e1f3d3647be2-kubelet-config\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-sysctl-conf\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-modprobe-d\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912174    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-var-lib-kubelet\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-etc-selinux\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-cni-bin\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912280    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-sysctl-conf\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912323    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/729a5514-7d0f-4e0d-9442-387783dd6e82-etc-selinux\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912367    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d6d2c6-8bc4-4757-aef3-99004ca362df-host-cni-bin\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb178fa3-0d0b-4339-a64a-948a9c5de385-var-lib-kubelet\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.912901    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb178fa3-0d0b-4339-a64a-948a9c5de385-etc-tuned\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.913705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.913124    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5799141e-22e4-471c-bba1-73f8782d6c46-agent-certs\") pod \"konnectivity-agent-xqt5w\" (UID: \"5799141e-22e4-471c-bba1-73f8782d6c46\") " pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:00.914313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.913542    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03d6d2c6-8bc4-4757-aef3-99004ca362df-ovn-node-metrics-cert\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:00.914702 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.914684    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb178fa3-0d0b-4339-a64a-948a9c5de385-tmp\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.920102 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.920003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9ms5\" (UniqueName: \"kubernetes.io/projected/fbfab23c-1ebd-4346-b591-b41f41f2b702-kube-api-access-x9ms5\") pod \"iptables-alerter-c66h9\" (UID: \"fbfab23c-1ebd-4346-b591-b41f41f2b702\") " pod="openshift-network-operator/iptables-alerter-c66h9"
Sep 19 09:07:00.937441 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.937416    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62bz6\" (UniqueName: \"kubernetes.io/projected/729a5514-7d0f-4e0d-9442-387783dd6e82-kube-api-access-62bz6\") pod \"aws-ebs-csi-driver-node-qcbgr\" (UID: \"729a5514-7d0f-4e0d-9442-387783dd6e82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:00.937441 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.937427    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2vfz\" (UniqueName: \"kubernetes.io/projected/7957c300-67ee-4732-a5c4-75ffc15fd793-kube-api-access-z2vfz\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:00.939215 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.939191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfd7w\" (UniqueName: \"kubernetes.io/projected/bb178fa3-0d0b-4339-a64a-948a9c5de385-kube-api-access-sfd7w\") pod \"tuned-q9zmf\" (UID: \"bb178fa3-0d0b-4339-a64a-948a9c5de385\") " pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:00.939396 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.939366    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 09:07:00.939396 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.939387    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 09:07:00.939497 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.939401    2579 projected.go:196] Error preparing data for projected volume kube-api-access-v5mdp for pod openshift-network-diagnostics/network-check-target-cs9lj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:00.939497 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:00.939480    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp podName:05540c93-6c4e-4ffb-a203-5901e567d0c8 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:01.4394635 +0000 UTC m=+4.606658717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v5mdp" (UniqueName: "kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp") pod "network-check-target-cs9lj" (UID: "05540c93-6c4e-4ffb-a203-5901e567d0c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:00.939675 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.939652    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg6gw\" (UniqueName: \"kubernetes.io/projected/9e78dedf-d775-4f5e-aa81-eb8ad545778f-kube-api-access-qg6gw\") pod \"multus-additional-cni-plugins-zh4cx\" (UID: \"9e78dedf-d775-4f5e-aa81-eb8ad545778f\") " pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:00.940172 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.940151    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chklw\" (UniqueName: \"kubernetes.io/projected/33065bce-502e-4912-9d83-7cb832c0b265-kube-api-access-chklw\") pod \"node-ca-n85bz\" (UID: \"33065bce-502e-4912-9d83-7cb832c0b265\") " pod="openshift-image-registry/node-ca-n85bz"
Sep 19 09:07:00.940500 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.940479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sshsm\" (UniqueName: \"kubernetes.io/projected/c3aaf3b2-8876-4116-a29c-0d048f54cb72-kube-api-access-sshsm\") pod \"multus-bg288\" (UID: \"c3aaf3b2-8876-4116-a29c-0d048f54cb72\") " pod="openshift-multus/multus-bg288"
Sep 19 09:07:00.940932 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.940910    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smq77\" (UniqueName: \"kubernetes.io/projected/41747fa9-438f-414d-8b1b-8a56fb5dc6d7-kube-api-access-smq77\") pod \"node-resolver-7xjhg\" (UID: \"41747fa9-438f-414d-8b1b-8a56fb5dc6d7\") " pod="openshift-dns/node-resolver-7xjhg"
Sep 19 09:07:00.941455 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:00.941439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z62zx\" (UniqueName: \"kubernetes.io/projected/03d6d2c6-8bc4-4757-aef3-99004ca362df-kube-api-access-z62zx\") pod \"ovnkube-node-zl6hn\" (UID: \"03d6d2c6-8bc4-4757-aef3-99004ca362df\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:01.066920 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.066884    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zh4cx"
Sep 19 09:07:01.076438 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.076412    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n85bz"
Sep 19 09:07:01.088132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.088112    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c66h9"
Sep 19 09:07:01.093771 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.093754    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:01.101396 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.101374    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7xjhg"
Sep 19 09:07:01.108103 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.108084    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:01.113895 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.113876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr"
Sep 19 09:07:01.120561 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.120544    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9zmf"
Sep 19 09:07:01.126083 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.126067    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bg288"
Sep 19 09:07:01.415468 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.415382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:01.415468 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.415459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:01.415645 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:01.415524    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:01.415645 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:01.415594    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs podName:7957c300-67ee-4732-a5c4-75ffc15fd793 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:02.415578728 +0000 UTC m=+5.582773936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs") pod "network-metrics-daemon-rv72r" (UID: "7957c300-67ee-4732-a5c4-75ffc15fd793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:01.415645 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:01.415597    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:01.415746 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:01.415659    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret podName:680d6b24-fc31-40bd-942a-e1f3d3647be2 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:02.415642768 +0000 UTC m=+5.582837991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret") pod "global-pull-secret-syncer-zsz2b" (UID: "680d6b24-fc31-40bd-942a-e1f3d3647be2") : object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:01.516096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.516057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mdp\" (UniqueName: \"kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp\") pod \"network-check-target-cs9lj\" (UID: \"05540c93-6c4e-4ffb-a203-5901e567d0c8\") " pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:01.516264 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:01.516222    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 09:07:01.516264 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:01.516240    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 09:07:01.516264 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:01.516259    2579 projected.go:196] Error preparing data for projected volume kube-api-access-v5mdp for pod openshift-network-diagnostics/network-check-target-cs9lj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:01.516380 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:01.516321    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp podName:05540c93-6c4e-4ffb-a203-5901e567d0c8 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:02.516303756 +0000 UTC m=+5.683498967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5mdp" (UniqueName: "kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp") pod "network-check-target-cs9lj" (UID: "05540c93-6c4e-4ffb-a203-5901e567d0c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:01.770081 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:07:01.769883    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41747fa9_438f_414d_8b1b_8a56fb5dc6d7.slice/crio-db15e2129f2f9af2d9c6d2ab259d00a50621ec964a8c9288d1e1d449e8aae006 WatchSource:0}: Error finding container db15e2129f2f9af2d9c6d2ab259d00a50621ec964a8c9288d1e1d449e8aae006: Status 404 returned error can't find the container with id db15e2129f2f9af2d9c6d2ab259d00a50621ec964a8c9288d1e1d449e8aae006
Sep 19 09:07:01.772445 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:07:01.772426    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e78dedf_d775_4f5e_aa81_eb8ad545778f.slice/crio-1f659684700736ec661ef1d8918ee28d0c73e4a828084174c85a18f1d556f58d WatchSource:0}: Error finding container 1f659684700736ec661ef1d8918ee28d0c73e4a828084174c85a18f1d556f58d: Status 404 returned error can't find the container with id 1f659684700736ec661ef1d8918ee28d0c73e4a828084174c85a18f1d556f58d
Sep 19 09:07:01.783829 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:07:01.783802    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfab23c_1ebd_4346_b591_b41f41f2b702.slice/crio-71694a3fc21a2650f99d0733a7226116024f343c119288a4996e7cbb7b042d15 WatchSource:0}: Error finding container 71694a3fc21a2650f99d0733a7226116024f343c119288a4996e7cbb7b042d15: Status 404 returned error can't find the container with id 71694a3fc21a2650f99d0733a7226116024f343c119288a4996e7cbb7b042d15
Sep 19 09:07:01.784203 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:07:01.784180    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3aaf3b2_8876_4116_a29c_0d048f54cb72.slice/crio-a3160ad26b536e9307a4b63895eb6fa43ca87d208267695da8e4eef5f7095a78 WatchSource:0}: Error finding container a3160ad26b536e9307a4b63895eb6fa43ca87d208267695da8e4eef5f7095a78: Status 404 returned error can't find the container with id a3160ad26b536e9307a4b63895eb6fa43ca87d208267695da8e4eef5f7095a78
Sep 19 09:07:01.864116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.864086    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 09:02:00 +0000 UTC" deadline="2028-02-23 12:37:35.947039014 +0000 UTC"
Sep 19 09:07:01.864116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.864114    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12531h30m34.082928344s"
Sep 19 09:07:01.906790 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.906629    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-190.ec2.internal" event={"ID":"c80dc006f68abf1cd999156c6067d05e","Type":"ContainerStarted","Data":"59b8ab31078e634956669c19452344693f2683e960b7f22f534cdeee8e3c62c2"}
Sep 19 09:07:01.909118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.909088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n85bz" event={"ID":"33065bce-502e-4912-9d83-7cb832c0b265","Type":"ContainerStarted","Data":"d3d409bc219810df7d175fc77551a74b57dfdb597b25f10fa3094e0d32b1de03"}
Sep 19 09:07:01.911295 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.911270    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9zmf" event={"ID":"bb178fa3-0d0b-4339-a64a-948a9c5de385","Type":"ContainerStarted","Data":"859c33c8148dd8cfb3c11c0b000c02935320d354bc74b49fcc9ea7e95e00135c"}
Sep 19 09:07:01.912675 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.912652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn" event={"ID":"03d6d2c6-8bc4-4757-aef3-99004ca362df","Type":"ContainerStarted","Data":"0a96c960f146ad5e4206e0c563d54900bba41b032ad36af8acc2b5fbb40ebc11"}
Sep 19 09:07:01.913768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.913742    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr" event={"ID":"729a5514-7d0f-4e0d-9442-387783dd6e82","Type":"ContainerStarted","Data":"90aaa0553578ea9d9f698f62c76340aef193d49a49c21e2c776edcd3832ae115"}
Sep 19 09:07:01.914925 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.914836    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7xjhg" event={"ID":"41747fa9-438f-414d-8b1b-8a56fb5dc6d7","Type":"ContainerStarted","Data":"db15e2129f2f9af2d9c6d2ab259d00a50621ec964a8c9288d1e1d449e8aae006"}
Sep 19 09:07:01.916001 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.915979    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bg288" event={"ID":"c3aaf3b2-8876-4116-a29c-0d048f54cb72","Type":"ContainerStarted","Data":"a3160ad26b536e9307a4b63895eb6fa43ca87d208267695da8e4eef5f7095a78"}
Sep 19 09:07:01.917064 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.917043    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c66h9" event={"ID":"fbfab23c-1ebd-4346-b591-b41f41f2b702","Type":"ContainerStarted","Data":"71694a3fc21a2650f99d0733a7226116024f343c119288a4996e7cbb7b042d15"}
Sep 19 09:07:01.918118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.918090    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xqt5w" event={"ID":"5799141e-22e4-471c-bba1-73f8782d6c46","Type":"ContainerStarted","Data":"9599f764658d49588a45bdbb31a97c45dc1f12f525adbc41b3593240c9a8fe14"}
Sep 19 09:07:01.919148 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.919128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh4cx" event={"ID":"9e78dedf-d775-4f5e-aa81-eb8ad545778f","Type":"ContainerStarted","Data":"1f659684700736ec661ef1d8918ee28d0c73e4a828084174c85a18f1d556f58d"}
Sep 19 09:07:01.930199 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:01.930158    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-190.ec2.internal" podStartSLOduration=1.930146794 podStartE2EDuration="1.930146794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:07:01.930123145 +0000 UTC m=+5.097318381" watchObservedRunningTime="2026-09-19 09:07:01.930146794 +0000 UTC m=+5.097342023"
Sep 19 09:07:02.425955 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:02.425222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:02.425955 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:02.425277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:02.425955 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:02.425398    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:02.425955 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:02.425455    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret podName:680d6b24-fc31-40bd-942a-e1f3d3647be2 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:04.425437674 +0000 UTC m=+7.592632901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret") pod "global-pull-secret-syncer-zsz2b" (UID: "680d6b24-fc31-40bd-942a-e1f3d3647be2") : object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:02.425955 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:02.425868    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:02.425955 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:02.425915    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs podName:7957c300-67ee-4732-a5c4-75ffc15fd793 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:04.425901523 +0000 UTC m=+7.593096735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs") pod "network-metrics-daemon-rv72r" (UID: "7957c300-67ee-4732-a5c4-75ffc15fd793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:02.526738 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:02.526103    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mdp\" (UniqueName: \"kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp\") pod \"network-check-target-cs9lj\" (UID: \"05540c93-6c4e-4ffb-a203-5901e567d0c8\") " pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:02.526738 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:02.526307    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 09:07:02.526738 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:02.526328    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 09:07:02.526738 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:02.526340    2579 projected.go:196] Error preparing data for projected volume kube-api-access-v5mdp for pod openshift-network-diagnostics/network-check-target-cs9lj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:02.526738 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:02.526398    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp podName:05540c93-6c4e-4ffb-a203-5901e567d0c8 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:04.526378656 +0000 UTC m=+7.693573869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5mdp" (UniqueName: "kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp") pod "network-check-target-cs9lj" (UID: "05540c93-6c4e-4ffb-a203-5901e567d0c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:02.864422 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:02.864357    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 09:02:00 +0000 UTC" deadline="2028-05-01 16:59:32.658311232 +0000 UTC"
Sep 19 09:07:02.864422 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:02.864419    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14167h52m29.793896626s"
Sep 19 09:07:02.898189 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:02.898134    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:02.898189 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:02.898151    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:02.898413 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:02.898308    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:02.898729 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:02.898479    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:02.898729 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:02.898583    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:02.898729 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:02.898693    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:02.937808 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:02.936532    2579 generic.go:356] "Generic (PLEG): container finished" podID="dbcdd6679a6e77f8381bc386784a1377" containerID="8cf71e33d7245207193d95a7d89aa46885b251b4c3cbaa5603ff2cc65381e064" exitCode=0
Sep 19 09:07:02.937808 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:02.937566    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal" event={"ID":"dbcdd6679a6e77f8381bc386784a1377","Type":"ContainerDied","Data":"8cf71e33d7245207193d95a7d89aa46885b251b4c3cbaa5603ff2cc65381e064"}
Sep 19 09:07:03.953552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:03.952807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal" event={"ID":"dbcdd6679a6e77f8381bc386784a1377","Type":"ContainerStarted","Data":"bad3f0e3610eb04e455ad2d2e5924c70e07df9324de87701d45f338fd61c12b1"}
Sep 19 09:07:04.443832 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:04.443753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:04.443832 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:04.443806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:04.444131 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:04.443919    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:04.444131 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:04.443939    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:04.444131 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:04.443983    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs podName:7957c300-67ee-4732-a5c4-75ffc15fd793 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:08.443963446 +0000 UTC m=+11.611158659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs") pod "network-metrics-daemon-rv72r" (UID: "7957c300-67ee-4732-a5c4-75ffc15fd793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:04.444131 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:04.444004    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret podName:680d6b24-fc31-40bd-942a-e1f3d3647be2 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:08.443993722 +0000 UTC m=+11.611188932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret") pod "global-pull-secret-syncer-zsz2b" (UID: "680d6b24-fc31-40bd-942a-e1f3d3647be2") : object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:04.545096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:04.545058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mdp\" (UniqueName: \"kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp\") pod \"network-check-target-cs9lj\" (UID: \"05540c93-6c4e-4ffb-a203-5901e567d0c8\") " pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:04.545260 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:04.545227    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 09:07:04.545260 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:04.545249    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 09:07:04.545372 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:04.545261    2579 projected.go:196] Error preparing data for projected volume kube-api-access-v5mdp for pod openshift-network-diagnostics/network-check-target-cs9lj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:04.545372 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:04.545316    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp podName:05540c93-6c4e-4ffb-a203-5901e567d0c8 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:08.545297284 +0000 UTC m=+11.712492514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5mdp" (UniqueName: "kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp") pod "network-check-target-cs9lj" (UID: "05540c93-6c4e-4ffb-a203-5901e567d0c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:04.897147 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:04.897111    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:04.897306 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:04.897231    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:04.897620 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:04.897602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:04.897715 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:04.897695    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:04.897840 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:04.897825    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:04.897934 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:04.897916    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:06.898031 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:06.897973    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:06.898485 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:06.898136    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:06.898485 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:06.898217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:06.898485 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:06.898303    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:06.898629 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:06.898510    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:06.898629 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:06.898595    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:08.478785 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:08.478750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:08.479273 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:08.478796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:08.479273 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:08.478914    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:08.479273 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:08.478960    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret podName:680d6b24-fc31-40bd-942a-e1f3d3647be2 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:16.47894774 +0000 UTC m=+19.646142949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret") pod "global-pull-secret-syncer-zsz2b" (UID: "680d6b24-fc31-40bd-942a-e1f3d3647be2") : object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:08.479446 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:08.479295    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:08.479446 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:08.479332    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs podName:7957c300-67ee-4732-a5c4-75ffc15fd793 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:16.479321029 +0000 UTC m=+19.646516238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs") pod "network-metrics-daemon-rv72r" (UID: "7957c300-67ee-4732-a5c4-75ffc15fd793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:08.579385 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:08.579337    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mdp\" (UniqueName: \"kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp\") pod \"network-check-target-cs9lj\" (UID: \"05540c93-6c4e-4ffb-a203-5901e567d0c8\") " pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:08.579573 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:08.579527    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 09:07:08.579573 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:08.579556    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 09:07:08.579573 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:08.579567    2579 projected.go:196] Error preparing data for projected volume kube-api-access-v5mdp for pod openshift-network-diagnostics/network-check-target-cs9lj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:08.579707 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:08.579624    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp podName:05540c93-6c4e-4ffb-a203-5901e567d0c8 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:16.57960473 +0000 UTC m=+19.746799955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5mdp" (UniqueName: "kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp") pod "network-check-target-cs9lj" (UID: "05540c93-6c4e-4ffb-a203-5901e567d0c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:08.898498 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:08.898465    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:08.898679 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:08.898569    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:08.898897 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:08.898881    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:08.898994 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:08.898966    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:08.899127 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:08.899030    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:08.899127 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:08.899116    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:10.896915 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:10.896881    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:10.896915 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:10.896899    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:10.897496 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:10.897006    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:10.897496 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:10.897049    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:10.897496 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:10.897126    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:10.897496 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:10.897210    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:12.897687 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:12.897648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:12.898096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:12.897648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:12.898096 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:12.897764    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:12.898096 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:12.897885    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:12.898096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:12.897648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:12.898096 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:12.898003    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:14.896802 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:14.896776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:14.896802 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:14.896806    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:14.897316 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:14.896877    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:14.897316 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:14.896928    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:14.897316 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:14.896960    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:14.897316 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:14.897105    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:16.535106 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:16.535055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:16.535106 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:16.535113    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:16.535539 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:16.535220    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:16.535539 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:16.535230    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:16.535539 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:16.535299    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs podName:7957c300-67ee-4732-a5c4-75ffc15fd793 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:32.535276975 +0000 UTC m=+35.702472188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs") pod "network-metrics-daemon-rv72r" (UID: "7957c300-67ee-4732-a5c4-75ffc15fd793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:16.535539 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:16.535316    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret podName:680d6b24-fc31-40bd-942a-e1f3d3647be2 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:32.535308634 +0000 UTC m=+35.702503846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret") pod "global-pull-secret-syncer-zsz2b" (UID: "680d6b24-fc31-40bd-942a-e1f3d3647be2") : object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:16.636258 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:16.636215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mdp\" (UniqueName: \"kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp\") pod \"network-check-target-cs9lj\" (UID: \"05540c93-6c4e-4ffb-a203-5901e567d0c8\") " pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:16.636413 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:16.636396    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 09:07:16.636413 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:16.636414    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 09:07:16.636509 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:16.636424    2579 projected.go:196] Error preparing data for projected volume kube-api-access-v5mdp for pod openshift-network-diagnostics/network-check-target-cs9lj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:16.636509 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:16.636474    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp podName:05540c93-6c4e-4ffb-a203-5901e567d0c8 nodeName:}" failed. No retries permitted until 2026-09-19 09:07:32.636459934 +0000 UTC m=+35.803655156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5mdp" (UniqueName: "kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp") pod "network-check-target-cs9lj" (UID: "05540c93-6c4e-4ffb-a203-5901e567d0c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:16.897682 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:16.897581    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:16.897682 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:16.897601    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:16.897951 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:16.897711    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:16.897951 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:16.897607    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:16.897951 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:16.897868    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:16.897951 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:16.897940    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:18.897892 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:18.897867    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:18.898241 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:18.897944    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:18.898241 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:18.897949    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:18.898241 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:18.897965    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:18.898241 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:18.898041    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:18.898241 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:18.898130    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:19.985564 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.985523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bg288" event={"ID":"c3aaf3b2-8876-4116-a29c-0d048f54cb72","Type":"ContainerStarted","Data":"23abae58312ff99c7f48f10ac8c10af88e3ab246733df49aa0d8a0b48af4c6e0"}
Sep 19 09:07:19.987143 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.987103    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xqt5w" event={"ID":"5799141e-22e4-471c-bba1-73f8782d6c46","Type":"ContainerStarted","Data":"c48319e5e624c2cff4af93c645ea73d5f8f7abcb61854ecec5f9ea09e235ce74"}
Sep 19 09:07:19.988973 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.988948    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e78dedf-d775-4f5e-aa81-eb8ad545778f" containerID="9687cc2e68870d701f67e10b19cfb6817849ad18f1f25d1a067680c57f20886a" exitCode=0
Sep 19 09:07:19.989078 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.989041    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh4cx" event={"ID":"9e78dedf-d775-4f5e-aa81-eb8ad545778f","Type":"ContainerDied","Data":"9687cc2e68870d701f67e10b19cfb6817849ad18f1f25d1a067680c57f20886a"}
Sep 19 09:07:19.990795 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.990768    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n85bz" event={"ID":"33065bce-502e-4912-9d83-7cb832c0b265","Type":"ContainerStarted","Data":"faea076d39b1405ba4a4a3fd148a812b6675124e25778c1b22d9e059452d3c7a"}
Sep 19 09:07:19.992990 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.992966    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9zmf" event={"ID":"bb178fa3-0d0b-4339-a64a-948a9c5de385","Type":"ContainerStarted","Data":"be1fd8e2e5504013c8b961be5cf6a2c47228bef84e8ae0717cc79b41b05b4453"}
Sep 19 09:07:19.996825 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.996808    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:07:19.997197 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.997173    2579 generic.go:356] "Generic (PLEG): container finished" podID="03d6d2c6-8bc4-4757-aef3-99004ca362df" containerID="aaf25e098a17fbe07e288ddff6371fc6808bc72f9bf0940cbc975ef915209a44" exitCode=1
Sep 19 09:07:19.997303 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.997217    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn" event={"ID":"03d6d2c6-8bc4-4757-aef3-99004ca362df","Type":"ContainerStarted","Data":"6beb1adbebbf621cd6f9fd0474d13d216ddb221ae8ddf2a4f51f29cf9f76a0cf"}
Sep 19 09:07:19.997303 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.997295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn" event={"ID":"03d6d2c6-8bc4-4757-aef3-99004ca362df","Type":"ContainerStarted","Data":"dafbad5744eadb68b015c809153edcfc2bf5b209ec9b0cc72d3de99e35ad5a5c"}
Sep 19 09:07:19.997407 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.997343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn" event={"ID":"03d6d2c6-8bc4-4757-aef3-99004ca362df","Type":"ContainerStarted","Data":"4c03231a569173d4aa091ff5703a8e51340abd5dc0de9132778677575db257c3"}
Sep 19 09:07:19.997407 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.997391    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn" event={"ID":"03d6d2c6-8bc4-4757-aef3-99004ca362df","Type":"ContainerStarted","Data":"29cc5f832191551b38515b67c82f21959478e47fb8d59fa068fbc7018c836fa4"}
Sep 19 09:07:19.997506 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.997438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn" event={"ID":"03d6d2c6-8bc4-4757-aef3-99004ca362df","Type":"ContainerDied","Data":"aaf25e098a17fbe07e288ddff6371fc6808bc72f9bf0940cbc975ef915209a44"}
Sep 19 09:07:19.997506 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.997487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn" event={"ID":"03d6d2c6-8bc4-4757-aef3-99004ca362df","Type":"ContainerStarted","Data":"775be267fb9efa7e14a57548f6c57fd6d98868feac9a9f7dec4391b23351263b"}
Sep 19 09:07:19.998905 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:19.998882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr" event={"ID":"729a5514-7d0f-4e0d-9442-387783dd6e82","Type":"ContainerStarted","Data":"10f41d62bdca0e1a9cb511ee5122f395103bdb71eb1d019ad9ae32c68a476e58"}
Sep 19 09:07:20.000299 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.000277    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7xjhg" event={"ID":"41747fa9-438f-414d-8b1b-8a56fb5dc6d7","Type":"ContainerStarted","Data":"8227a9ec6114d5746772cb401605b8e3c563d1b38b0e5268c9ceecbd719108a6"}
Sep 19 09:07:20.084697 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.084650    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-190.ec2.internal" podStartSLOduration=20.084621671 podStartE2EDuration="20.084621671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:07:03.978388066 +0000 UTC m=+7.145583311" watchObservedRunningTime="2026-09-19 09:07:20.084621671 +0000 UTC m=+23.251816883"
Sep 19 09:07:20.141775 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.141728    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bg288" podStartSLOduration=3.778917903 podStartE2EDuration="21.14171439s" totalImagesPullingTime="17.362796487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:07:20.08897822 +0000 UTC m=+23.256173462" watchObservedRunningTime="2026-09-19 09:07:20.14171439 +0000 UTC m=+23.308909634"
Sep 19 09:07:20.179814 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.179766    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xqt5w" podStartSLOduration=8.061001738 podStartE2EDuration="21.179752482s" totalImagesPullingTime="13.118750744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:07:20.179370443 +0000 UTC m=+23.346565684" watchObservedRunningTime="2026-09-19 09:07:20.179752482 +0000 UTC m=+23.346947712"
Sep 19 09:07:20.262871 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.262784    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n85bz" podStartSLOduration=3.94031157 podStartE2EDuration="21.262768994s" totalImagesPullingTime="17.322457424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:07:20.213730366 +0000 UTC m=+23.380925596" watchObservedRunningTime="2026-09-19 09:07:20.262768994 +0000 UTC m=+23.429964267"
Sep 19 09:07:20.335087 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.335035    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7xjhg" podStartSLOduration=4.00070985 podStartE2EDuration="21.334997465s" totalImagesPullingTime="17.334287615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:07:20.262877393 +0000 UTC m=+23.430072622" watchObservedRunningTime="2026-09-19 09:07:20.334997465 +0000 UTC m=+23.502192702"
Sep 19 09:07:20.691743 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.691717    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 19 09:07:20.857897 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.857799    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T09:07:20.691736386Z","UUID":"fde9924b-c98d-4294-80b0-4ffda6bac6f2","Handler":null,"Name":"","Endpoint":""}
Sep 19 09:07:20.860944 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.860914    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 19 09:07:20.860944 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.860948    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 19 09:07:20.897270 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.897242    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:20.897401 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.897245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:20.897401 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:20.897362    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:20.897401 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:20.897371    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:20.897537 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:20.897456    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:20.897574 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:20.897537    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:21.004077 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:21.004039    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr" event={"ID":"729a5514-7d0f-4e0d-9442-387783dd6e82","Type":"ContainerStarted","Data":"2531976a532fe9e57ea1522be96b9e1dbab3dcde67d47da0680a0a1340da223f"}
Sep 19 09:07:21.005517 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:21.005491    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c66h9" event={"ID":"fbfab23c-1ebd-4346-b591-b41f41f2b702","Type":"ContainerStarted","Data":"c1237ddd0ab33b3dc4d50c73d960b278d0b70b4a6a77a51012edccbe668661be"}
Sep 19 09:07:21.041776 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:21.041723    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q9zmf" podStartSLOduration=4.714434082 podStartE2EDuration="22.041706625s" totalImagesPullingTime="17.327272543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:07:20.335112337 +0000 UTC m=+23.502307567" watchObservedRunningTime="2026-09-19 09:07:21.041706625 +0000 UTC m=+24.208901856"
Sep 19 09:07:21.042201 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:21.042165    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c66h9" podStartSLOduration=4.722358328 podStartE2EDuration="22.042157242s" totalImagesPullingTime="17.319798914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:07:21.040997424 +0000 UTC m=+24.208192670" watchObservedRunningTime="2026-09-19 09:07:21.042157242 +0000 UTC m=+24.209352478"
Sep 19 09:07:21.632067 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:21.632010    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:22.009547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:22.009521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr" event={"ID":"729a5514-7d0f-4e0d-9442-387783dd6e82","Type":"ContainerStarted","Data":"55da66d0eccaa2d1289c24342042baa8998f2b09eae210485a94616619790cb2"}
Sep 19 09:07:22.897273 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:22.897237    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:22.897453 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:22.897237    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:22.897453 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:22.897350    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:22.897453 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:22.897373    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:22.897664 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:22.897492    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:22.897664 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:22.897576    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:23.014866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:23.014837    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:07:23.015322 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:23.015295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn" event={"ID":"03d6d2c6-8bc4-4757-aef3-99004ca362df","Type":"ContainerStarted","Data":"d1da455dceb4c7aa8b7f9182e7ebc106de5d572c4a3a82b67ba93c6477504aeb"}
Sep 19 09:07:24.226936 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:24.226733    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:24.227382 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:24.227350    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:24.254770 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:24.254728    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qcbgr" podStartSLOduration=5.741088818 podStartE2EDuration="25.254713168s" totalImagesPullingTime="19.51362435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:06:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:07:22.054888937 +0000 UTC m=+25.222084166" watchObservedRunningTime="2026-09-19 09:07:24.254713168 +0000 UTC m=+27.421908395"
Sep 19 09:07:24.896872 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:24.896839    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:24.897117 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:24.896845    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:24.897117 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:24.896963    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:24.897117 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:24.896852    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:24.897117 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:24.897048    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:24.897265 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:24.897114    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:25.020921 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:25.020842    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e78dedf-d775-4f5e-aa81-eb8ad545778f" containerID="4723b0ee8fe2a9d79bdfde3e977fd35e3e587580a22ee511d326f651e5683627" exitCode=0
Sep 19 09:07:25.020921 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:25.020897    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh4cx" event={"ID":"9e78dedf-d775-4f5e-aa81-eb8ad545778f","Type":"ContainerDied","Data":"4723b0ee8fe2a9d79bdfde3e977fd35e3e587580a22ee511d326f651e5683627"}
Sep 19 09:07:25.024524 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:25.024509    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:07:25.024890 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:25.024868    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn" event={"ID":"03d6d2c6-8bc4-4757-aef3-99004ca362df","Type":"ContainerStarted","Data":"301aef37ef63480fb4a6ad1032ba6d8433e51d8c3142cc89c1a25f5632f6e7a9"}
Sep 19 09:07:25.025368 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:25.025351    2579 scope.go:117] "RemoveContainer" containerID="aaf25e098a17fbe07e288ddff6371fc6808bc72f9bf0940cbc975ef915209a44"
Sep 19 09:07:25.025549 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:25.025535    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xqt5w"
Sep 19 09:07:25.299812 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:25.299637    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7xjhg_41747fa9-438f-414d-8b1b-8a56fb5dc6d7/dns-node-resolver/0.log"
Sep 19 09:07:26.031441 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.031415    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:07:26.031771 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.031732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn" event={"ID":"03d6d2c6-8bc4-4757-aef3-99004ca362df","Type":"ContainerStarted","Data":"8ac056508224314d058c875dc8648e134c1fac1d00a89c0a40e85e46f6a94356"}
Sep 19 09:07:26.031968 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.031947    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:26.032077 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.032033    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:26.032149 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.032079    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:26.047667 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.047635    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:26.047787 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.047730    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:26.129744 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.129677    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn" podStartSLOduration=9.776195783 podStartE2EDuration="27.129661425s" totalImagesPullingTime="17.353465642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:07:26.080850849 +0000 UTC m=+29.248046077" watchObservedRunningTime="2026-09-19 09:07:26.129661425 +0000 UTC m=+29.296856654"
Sep 19 09:07:26.397738 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.397712    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n85bz_33065bce-502e-4912-9d83-7cb832c0b265/node-ca/0.log"
Sep 19 09:07:26.646455 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.646427    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zsz2b"]
Sep 19 09:07:26.646614 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.646551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:26.646647 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:26.646627    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:26.665844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.665819    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cs9lj"]
Sep 19 09:07:26.665988 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.665918    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:26.666061 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:26.665987    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:26.666395 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.666373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rv72r"]
Sep 19 09:07:26.666489 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:26.666477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:26.666588 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:26.666572    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:27.035984 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:27.035900    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e78dedf-d775-4f5e-aa81-eb8ad545778f" containerID="9c0b5d7a15538c4c81cf1bf32ec242f473b93963d5eee787d2aab6249525f127" exitCode=0
Sep 19 09:07:27.036152 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:27.035985    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh4cx" event={"ID":"9e78dedf-d775-4f5e-aa81-eb8ad545778f","Type":"ContainerDied","Data":"9c0b5d7a15538c4c81cf1bf32ec242f473b93963d5eee787d2aab6249525f127"}
Sep 19 09:07:27.896865 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:27.896835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:27.897288 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:27.896936    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:27.897288 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:27.896989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:27.897288 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:27.897087    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:28.898132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:28.898100    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:28.898462 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:28.898194    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:29.043180 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:29.043137    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e78dedf-d775-4f5e-aa81-eb8ad545778f" containerID="ae3c0c4f36d00b0dd6f0f26f9259dc2aa1f129bbd8fcfb5e706d4bbac462444a" exitCode=0
Sep 19 09:07:29.043309 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:29.043190    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh4cx" event={"ID":"9e78dedf-d775-4f5e-aa81-eb8ad545778f","Type":"ContainerDied","Data":"ae3c0c4f36d00b0dd6f0f26f9259dc2aa1f129bbd8fcfb5e706d4bbac462444a"}
Sep 19 09:07:29.897401 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:29.897209    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:29.897642 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:29.897242    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:29.897642 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:29.897505    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:29.897642 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:29.897587    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:30.897032 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:30.896991    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:30.897497 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:30.897153    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:31.897299 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:31.897260    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:31.897724 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:31.897260    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:31.897724 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:31.897363    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:31.897724 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:31.897477    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:32.553853 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:32.553825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:32.554047 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:32.553871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:32.554047 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:32.553970    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:32.554047 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:32.553975    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:32.554210 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:32.554054    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs podName:7957c300-67ee-4732-a5c4-75ffc15fd793 nodeName:}" failed. No retries permitted until 2026-09-19 09:08:04.554032845 +0000 UTC m=+67.721228066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs") pod "network-metrics-daemon-rv72r" (UID: "7957c300-67ee-4732-a5c4-75ffc15fd793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:07:32.554210 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:32.554072    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret podName:680d6b24-fc31-40bd-942a-e1f3d3647be2 nodeName:}" failed. No retries permitted until 2026-09-19 09:08:04.554063756 +0000 UTC m=+67.721258969 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret") pod "global-pull-secret-syncer-zsz2b" (UID: "680d6b24-fc31-40bd-942a-e1f3d3647be2") : object "kube-system"/"original-pull-secret" not registered
Sep 19 09:07:32.654192 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:32.654161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mdp\" (UniqueName: \"kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp\") pod \"network-check-target-cs9lj\" (UID: \"05540c93-6c4e-4ffb-a203-5901e567d0c8\") " pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:32.654360 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:32.654321    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 09:07:32.654360 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:32.654337    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 09:07:32.654360 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:32.654349    2579 projected.go:196] Error preparing data for projected volume kube-api-access-v5mdp for pod openshift-network-diagnostics/network-check-target-cs9lj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:32.654481 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:32.654410    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp podName:05540c93-6c4e-4ffb-a203-5901e567d0c8 nodeName:}" failed. No retries permitted until 2026-09-19 09:08:04.654392831 +0000 UTC m=+67.821588063 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5mdp" (UniqueName: "kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp") pod "network-check-target-cs9lj" (UID: "05540c93-6c4e-4ffb-a203-5901e567d0c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:07:32.897143 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:32.897064    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:32.897297 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:32.897211    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:33.897068 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:33.897033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:33.897068 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:33.897068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:33.897442 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:33.897133    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:33.897442 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:33.897233    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:34.897662 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:34.897633    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:34.898039 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:34.897735    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:35.059990 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:35.059960    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e78dedf-d775-4f5e-aa81-eb8ad545778f" containerID="cc7b7d084b4e7f9ca0b3386c94b0294d54634d6d89e5f03d27899583f795ac3c" exitCode=0
Sep 19 09:07:35.060197 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:35.060003    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh4cx" event={"ID":"9e78dedf-d775-4f5e-aa81-eb8ad545778f","Type":"ContainerDied","Data":"cc7b7d084b4e7f9ca0b3386c94b0294d54634d6d89e5f03d27899583f795ac3c"}
Sep 19 09:07:35.897595 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:35.897559    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:35.897595 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:35.897600    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:35.898188 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:35.897684    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:35.898188 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:35.897787    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:36.065494 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:36.065458    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e78dedf-d775-4f5e-aa81-eb8ad545778f" containerID="7164abeb8cef899ecd390e5482008d51a697a4fde57dbae958231da35c048dd5" exitCode=0
Sep 19 09:07:36.065636 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:36.065518    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh4cx" event={"ID":"9e78dedf-d775-4f5e-aa81-eb8ad545778f","Type":"ContainerDied","Data":"7164abeb8cef899ecd390e5482008d51a697a4fde57dbae958231da35c048dd5"}
Sep 19 09:07:36.897658 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:36.897622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:36.897848 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:36.897755    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:37.071222 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:37.071185    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh4cx" event={"ID":"9e78dedf-d775-4f5e-aa81-eb8ad545778f","Type":"ContainerStarted","Data":"9eff3b3cad7c8c1bf3887656ea6212d53748cc8aa517a2542a0015ade3dcf91b"}
Sep 19 09:07:37.117365 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:37.117313    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zh4cx" podStartSLOduration=9.889212849 podStartE2EDuration="39.117298372s" totalImagesPullingTime="29.228085523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:06:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:07:37.116889103 +0000 UTC m=+40.284084333" watchObservedRunningTime="2026-09-19 09:07:37.117298372 +0000 UTC m=+40.284493600"
Sep 19 09:07:37.897458 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:37.897430    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:37.897655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:37.897430    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:37.897655 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:37.897523    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:37.897655 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:37.897605    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:38.898006 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:38.897975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:38.898373 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:38.898113    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:39.897371 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:39.897334    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:39.897542 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:39.897341    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:39.897542 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:39.897440    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:39.897542 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:39.897508    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:40.897328 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:40.897296    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:40.897763 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:40.897424    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:41.897474 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:41.897440    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:41.897474 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:41.897463    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:41.897961 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:41.897551    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:41.897961 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:41.897651    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:42.896804 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:42.896773    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:42.896995 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:42.896900    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:43.897201 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:43.897162    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:43.897603 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:43.897163    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:43.897603 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:43.897274    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:43.897603 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:43.897358    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:44.897365 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:44.897329    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:44.897805 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:44.897469    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:45.897338 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:45.897303    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:45.897509 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:45.897303    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:45.897509 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:45.897441    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:45.897509 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:45.897483    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:46.897326 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:46.897292    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:46.897495 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:46.897394    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:47.897293 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:47.897260    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:47.897994 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:47.897268    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:47.897994 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:47.897359    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:47.897994 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:47.897453    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:48.897750 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:48.897723    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:48.898166 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:48.897802    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:49.896993 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:49.896955    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:49.896993 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:49.896977    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:49.897215 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:49.897079    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:49.897215 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:49.897142    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:50.897149 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:50.897110    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:50.897589 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:50.897247    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:51.896842 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:51.896805    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:51.897035 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:51.896962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:51.897035 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:51.896968    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:51.897116 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:51.897068    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:52.897206 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:52.897171    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:52.897560 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:52.897281    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:53.897541 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:53.897513    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:53.897898 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:53.897517    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:53.897898 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:53.897604    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:53.897898 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:53.897679    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:54.897597 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:54.897568    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:54.897952 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:54.897668    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:55.897309 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:55.897268    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:55.897493 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:55.897282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:55.897493 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:55.897385    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:55.897597 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:55.897487    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:56.896960 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:56.896925    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:56.897442 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:56.897082    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:57.897361 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:57.897332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:57.897728 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:57.897344    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:57.897728 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:57.897427    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:57.897728 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:57.897507    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:07:58.048311 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:58.048277    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl6hn"
Sep 19 09:07:58.899284 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:58.899255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:07:58.899601 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:58.899344    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:07:59.897380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:59.897346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:07:59.897543 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:59.897448    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:07:59.897543 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:07:59.897500    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:07:59.897616 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:07:59.897586    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:08:00.897435 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:00.897400    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:08:00.897807 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:00.897510    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:08:01.897719 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:01.897693    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:08:01.897719 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:01.897722    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:08:01.898151 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:01.897791    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:08:01.898151 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:01.897836    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:08:02.897512 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:02.897476    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:08:02.897691 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:02.897590    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:08:03.897612 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:03.897575    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:08:03.897612 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:03.897612    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:08:03.898155 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:03.897706    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsz2b" podUID="680d6b24-fc31-40bd-942a-e1f3d3647be2"
Sep 19 09:08:03.898155 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:03.897828    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cs9lj" podUID="05540c93-6c4e-4ffb-a203-5901e567d0c8"
Sep 19 09:08:04.578682 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:04.578643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:08:04.578682 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:04.578688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:08:04.578889 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:04.578800    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 09:08:04.578889 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:04.578861    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret podName:680d6b24-fc31-40bd-942a-e1f3d3647be2 nodeName:}" failed. No retries permitted until 2026-09-19 09:09:08.578848707 +0000 UTC m=+131.746043916 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret") pod "global-pull-secret-syncer-zsz2b" (UID: "680d6b24-fc31-40bd-942a-e1f3d3647be2") : object "kube-system"/"original-pull-secret" not registered
Sep 19 09:08:04.578958 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:04.578800    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:08:04.578958 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:04.578935    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs podName:7957c300-67ee-4732-a5c4-75ffc15fd793 nodeName:}" failed. No retries permitted until 2026-09-19 09:09:08.578922838 +0000 UTC m=+131.746118058 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs") pod "network-metrics-daemon-rv72r" (UID: "7957c300-67ee-4732-a5c4-75ffc15fd793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 09:08:04.679311 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:04.679277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mdp\" (UniqueName: \"kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp\") pod \"network-check-target-cs9lj\" (UID: \"05540c93-6c4e-4ffb-a203-5901e567d0c8\") " pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:08:04.679463 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:04.679429    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 09:08:04.679463 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:04.679449    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 09:08:04.679463 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:04.679459    2579 projected.go:196] Error preparing data for projected volume kube-api-access-v5mdp for pod openshift-network-diagnostics/network-check-target-cs9lj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:08:04.679555 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:04.679506    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp podName:05540c93-6c4e-4ffb-a203-5901e567d0c8 nodeName:}" failed. No retries permitted until 2026-09-19 09:09:08.679493902 +0000 UTC m=+131.846689123 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v5mdp" (UniqueName: "kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp") pod "network-check-target-cs9lj" (UID: "05540c93-6c4e-4ffb-a203-5901e567d0c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 09:08:04.897121 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:04.897094    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:08:04.897328 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:04.897208    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rv72r" podUID="7957c300-67ee-4732-a5c4-75ffc15fd793"
Sep 19 09:08:05.334428 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.334404    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-190.ec2.internal" event="NodeReady"
Sep 19 09:08:05.334800 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.334515    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 19 09:08:05.546633 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.546597    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jzksq"]
Sep 19 09:08:05.548926 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.548912    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mg5xq"]
Sep 19 09:08:05.549058 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.549041    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.551415 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.551394    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.566648 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.566625    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 19 09:08:05.567043 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.566783    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 19 09:08:05.567043 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.566863    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 19 09:08:05.567043 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.566674    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 19 09:08:05.581104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.581081    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 19 09:08:05.581104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.581096    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w276g\""
Sep 19 09:08:05.584686 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.584643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/277826a9-fb6b-4298-aa2e-0159598b5518-metrics-tls\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.584753 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.584683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.584753 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.584703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/277826a9-fb6b-4298-aa2e-0159598b5518-tmp-dir\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.584753 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.584721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbz48\" (UniqueName: \"kubernetes.io/projected/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-kube-api-access-hbz48\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.584904 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.584775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkpz6\" (UniqueName: \"kubernetes.io/projected/277826a9-fb6b-4298-aa2e-0159598b5518-kube-api-access-kkpz6\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.584904 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.584810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-crio-socket\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.584904 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.584844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.584904 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.584891    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/277826a9-fb6b-4298-aa2e-0159598b5518-config-volume\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.585072 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.584914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-data-volume\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.628580 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.628553    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xchdv\""
Sep 19 09:08:05.628702 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.628604    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 19 09:08:05.654525 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.654494    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jzksq"]
Sep 19 09:08:05.655002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.654982    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mg5xq"]
Sep 19 09:08:05.684951 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.684923    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r6lgq"]
Sep 19 09:08:05.685438 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.685419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbz48\" (UniqueName: \"kubernetes.io/projected/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-kube-api-access-hbz48\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.685496 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.685449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkpz6\" (UniqueName: \"kubernetes.io/projected/277826a9-fb6b-4298-aa2e-0159598b5518-kube-api-access-kkpz6\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.685496 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.685467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-crio-socket\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.685496 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.685484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.685598 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.685546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/277826a9-fb6b-4298-aa2e-0159598b5518-config-volume\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.685645 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.685592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-data-volume\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.685696 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.685650    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-crio-socket\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.685696 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.685643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/277826a9-fb6b-4298-aa2e-0159598b5518-metrics-tls\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.685806 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.685732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.685806 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.685769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/277826a9-fb6b-4298-aa2e-0159598b5518-tmp-dir\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.685962 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.685903    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-data-volume\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.686099 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.686081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/277826a9-fb6b-4298-aa2e-0159598b5518-tmp-dir\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.686165 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.686147    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.686274 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.686254    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/277826a9-fb6b-4298-aa2e-0159598b5518-config-volume\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.688304 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.688288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r6lgq"
Sep 19 09:08:05.689391 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.689374    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/277826a9-fb6b-4298-aa2e-0159598b5518-metrics-tls\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.689479 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.689415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.705808 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.705790    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 19 09:08:05.706852 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.706836    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5nz4g\""
Sep 19 09:08:05.706899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.706861    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 19 09:08:05.723461 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.723439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbz48\" (UniqueName: \"kubernetes.io/projected/2f981b90-3fce-4b7d-977d-6b7b701aaeb7-kube-api-access-hbz48\") pod \"insights-runtime-extractor-jzksq\" (UID: \"2f981b90-3fce-4b7d-977d-6b7b701aaeb7\") " pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.726165 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.726147    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkpz6\" (UniqueName: \"kubernetes.io/projected/277826a9-fb6b-4298-aa2e-0159598b5518-kube-api-access-kkpz6\") pod \"dns-default-mg5xq\" (UID: \"277826a9-fb6b-4298-aa2e-0159598b5518\") " pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.731772 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.731751    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 19 09:08:05.750435 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.750405    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r6lgq"]
Sep 19 09:08:05.786639 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.786607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e-cert\") pod \"ingress-canary-r6lgq\" (UID: \"7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e\") " pod="openshift-ingress-canary/ingress-canary-r6lgq"
Sep 19 09:08:05.786639 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.786636    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgvmw\" (UniqueName: \"kubernetes.io/projected/7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e-kube-api-access-cgvmw\") pod \"ingress-canary-r6lgq\" (UID: \"7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e\") " pod="openshift-ingress-canary/ingress-canary-r6lgq"
Sep 19 09:08:05.857858 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.857784    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jzksq"
Sep 19 09:08:05.862396 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.862380    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:05.887652 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.887566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e-cert\") pod \"ingress-canary-r6lgq\" (UID: \"7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e\") " pod="openshift-ingress-canary/ingress-canary-r6lgq"
Sep 19 09:08:05.887652 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.887607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgvmw\" (UniqueName: \"kubernetes.io/projected/7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e-kube-api-access-cgvmw\") pod \"ingress-canary-r6lgq\" (UID: \"7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e\") " pod="openshift-ingress-canary/ingress-canary-r6lgq"
Sep 19 09:08:05.890509 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.890480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e-cert\") pod \"ingress-canary-r6lgq\" (UID: \"7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e\") " pod="openshift-ingress-canary/ingress-canary-r6lgq"
Sep 19 09:08:05.897491 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.897450    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:08:05.897747 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.897458    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:08:05.910631 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.910611    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 09:08:05.910754 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.910695    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2r86\""
Sep 19 09:08:05.911614 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.911514    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 09:08:05.923386 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.922917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgvmw\" (UniqueName: \"kubernetes.io/projected/7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e-kube-api-access-cgvmw\") pod \"ingress-canary-r6lgq\" (UID: \"7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e\") " pod="openshift-ingress-canary/ingress-canary-r6lgq"
Sep 19 09:08:05.927408 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:05.927387    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 09:08:06.000200 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:06.000171    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r6lgq"
Sep 19 09:08:06.189919 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:06.189888    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f981b90_3fce_4b7d_977d_6b7b701aaeb7.slice/crio-27bd6325fbaecd6b404c77026c524d21ddeb075a9fe82306f18de2d464428a1a WatchSource:0}: Error finding container 27bd6325fbaecd6b404c77026c524d21ddeb075a9fe82306f18de2d464428a1a: Status 404 returned error can't find the container with id 27bd6325fbaecd6b404c77026c524d21ddeb075a9fe82306f18de2d464428a1a
Sep 19 09:08:06.190521 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:06.190502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jzksq"]
Sep 19 09:08:06.220545 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:06.220513    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mg5xq"]
Sep 19 09:08:06.223939 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:06.223917    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277826a9_fb6b_4298_aa2e_0159598b5518.slice/crio-81ea343fe1a27895c4af77dc1037d11188606bb5fa12b9ffda9b5b9d3dee24cd WatchSource:0}: Error finding container 81ea343fe1a27895c4af77dc1037d11188606bb5fa12b9ffda9b5b9d3dee24cd: Status 404 returned error can't find the container with id 81ea343fe1a27895c4af77dc1037d11188606bb5fa12b9ffda9b5b9d3dee24cd
Sep 19 09:08:06.331563 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:06.331530    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r6lgq"]
Sep 19 09:08:06.334915 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:06.334894    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfc3b78_9bd0_4e7a_808e_498bc2e16e2e.slice/crio-c8b541cca8f39de89c6aef890e2f095607870f4ce1020f176412d9d5451db95f WatchSource:0}: Error finding container c8b541cca8f39de89c6aef890e2f095607870f4ce1020f176412d9d5451db95f: Status 404 returned error can't find the container with id c8b541cca8f39de89c6aef890e2f095607870f4ce1020f176412d9d5451db95f
Sep 19 09:08:06.901240 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:06.901215    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:08:06.905668 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:06.905646    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 09:08:06.905900 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:06.905885    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fszt9\""
Sep 19 09:08:07.135415 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:07.135335    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r6lgq" event={"ID":"7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e","Type":"ContainerStarted","Data":"c8b541cca8f39de89c6aef890e2f095607870f4ce1020f176412d9d5451db95f"}
Sep 19 09:08:07.137735 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:07.137703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jzksq" event={"ID":"2f981b90-3fce-4b7d-977d-6b7b701aaeb7","Type":"ContainerStarted","Data":"0ae70e169d9e05fb606cb8dcac36bc2fa54eb87a13fee6d480131f81b62f4a4e"}
Sep 19 09:08:07.137845 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:07.137762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jzksq" event={"ID":"2f981b90-3fce-4b7d-977d-6b7b701aaeb7","Type":"ContainerStarted","Data":"3587bd42d9ab4383232f0b157870b9e514d3e6daf019ad5ff154aca558a83e0b"}
Sep 19 09:08:07.137845 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:07.137786    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jzksq" event={"ID":"2f981b90-3fce-4b7d-977d-6b7b701aaeb7","Type":"ContainerStarted","Data":"27bd6325fbaecd6b404c77026c524d21ddeb075a9fe82306f18de2d464428a1a"}
Sep 19 09:08:07.143975 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:07.143943    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mg5xq" event={"ID":"277826a9-fb6b-4298-aa2e-0159598b5518","Type":"ContainerStarted","Data":"81ea343fe1a27895c4af77dc1037d11188606bb5fa12b9ffda9b5b9d3dee24cd"}
Sep 19 09:08:10.158293 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:10.158173    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r6lgq" event={"ID":"7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e","Type":"ContainerStarted","Data":"ada585287ef8d87f083876b60717ed2a802e5cf79834e7368ce5b793dcbdf060"}
Sep 19 09:08:10.160374 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:10.160352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jzksq" event={"ID":"2f981b90-3fce-4b7d-977d-6b7b701aaeb7","Type":"ContainerStarted","Data":"ae4bd71ddc49bd5df117054bd2edd3e93a0d59b9b9fe58b69cdf1d75eff32a5e"}
Sep 19 09:08:10.161950 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:10.161933    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mg5xq" event={"ID":"277826a9-fb6b-4298-aa2e-0159598b5518","Type":"ContainerStarted","Data":"188a885d5790bc89af865255e99bab9b9fab651aa17e2531492d39746990927c"}
Sep 19 09:08:10.162042 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:10.161964    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mg5xq" event={"ID":"277826a9-fb6b-4298-aa2e-0159598b5518","Type":"ContainerStarted","Data":"40527b09e2dfcc8ad714216f4cd705033c0f3c46e711887a6366fd073207cd37"}
Sep 19 09:08:10.162083 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:10.162052    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:10.210098 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:10.210047    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r6lgq" podStartSLOduration=2.359268474 podStartE2EDuration="5.210006642s" totalImagesPullingTime="2.850738168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:10.209762351 +0000 UTC m=+73.376957593" watchObservedRunningTime="2026-09-19 09:08:10.210006642 +0000 UTC m=+73.377201871"
Sep 19 09:08:10.422833 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:10.422709    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mg5xq" podStartSLOduration=2.470169672 podStartE2EDuration="5.422690193s" totalImagesPullingTime="2.952520521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:10.342976371 +0000 UTC m=+73.510171606" watchObservedRunningTime="2026-09-19 09:08:10.422690193 +0000 UTC m=+73.589885425"
Sep 19 09:08:10.423505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:10.423467    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jzksq" podStartSLOduration=2.5996125020000003 podStartE2EDuration="5.423452581s" totalImagesPullingTime="2.823840079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:08:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:10.422511066 +0000 UTC m=+73.589706298" watchObservedRunningTime="2026-09-19 09:08:10.423452581 +0000 UTC m=+73.590647815"
Sep 19 09:08:16.096267 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.096224    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"]
Sep 19 09:08:16.100031 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.099985    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.107612 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.107504    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 19 09:08:16.107832 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.107810    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tc26v\""
Sep 19 09:08:16.108644 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.108628    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 19 09:08:16.112114 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.112097    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 19 09:08:16.119293 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.119275    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 19 09:08:16.120290 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.120276    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 19 09:08:16.142076 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.142047    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"]
Sep 19 09:08:16.158578 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.158554    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c432b742-a0fe-452a-918c-de06cfd479c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.158655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.158582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7n9n\" (UniqueName: \"kubernetes.io/projected/c432b742-a0fe-452a-918c-de06cfd479c2-kube-api-access-h7n9n\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.158655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.158604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c432b742-a0fe-452a-918c-de06cfd479c2-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.158655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.158623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c432b742-a0fe-452a-918c-de06cfd479c2-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.259673 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.259630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c432b742-a0fe-452a-918c-de06cfd479c2-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.259673 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.259676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c432b742-a0fe-452a-918c-de06cfd479c2-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.259866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.259732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c432b742-a0fe-452a-918c-de06cfd479c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.259866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.259749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7n9n\" (UniqueName: \"kubernetes.io/projected/c432b742-a0fe-452a-918c-de06cfd479c2-kube-api-access-h7n9n\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.259866 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:16.259776    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 19 09:08:16.259866 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:16.259864    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c432b742-a0fe-452a-918c-de06cfd479c2-prometheus-operator-tls podName:c432b742-a0fe-452a-918c-de06cfd479c2 nodeName:}" failed. No retries permitted until 2026-09-19 09:08:16.759844194 +0000 UTC m=+79.927039406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c432b742-a0fe-452a-918c-de06cfd479c2-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-r2w55" (UID: "c432b742-a0fe-452a-918c-de06cfd479c2") : secret "prometheus-operator-tls" not found
Sep 19 09:08:16.260395 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.260368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c432b742-a0fe-452a-918c-de06cfd479c2-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.262143 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.262126    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c432b742-a0fe-452a-918c-de06cfd479c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.286352 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.286330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7n9n\" (UniqueName: \"kubernetes.io/projected/c432b742-a0fe-452a-918c-de06cfd479c2-kube-api-access-h7n9n\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.763826 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.763778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c432b742-a0fe-452a-918c-de06cfd479c2-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:16.766204 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:16.766182    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c432b742-a0fe-452a-918c-de06cfd479c2-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-r2w55\" (UID: \"c432b742-a0fe-452a-918c-de06cfd479c2\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:17.007951 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:17.007917    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"
Sep 19 09:08:17.279939 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:17.279864    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55"]
Sep 19 09:08:17.283211 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:17.283185    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc432b742_a0fe_452a_918c_de06cfd479c2.slice/crio-25a834e471883cc1b180c7266b82d79f7d725ec175401b8bda8aa158a49cfbdf WatchSource:0}: Error finding container 25a834e471883cc1b180c7266b82d79f7d725ec175401b8bda8aa158a49cfbdf: Status 404 returned error can't find the container with id 25a834e471883cc1b180c7266b82d79f7d725ec175401b8bda8aa158a49cfbdf
Sep 19 09:08:18.187849 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:18.187808    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55" event={"ID":"c432b742-a0fe-452a-918c-de06cfd479c2","Type":"ContainerStarted","Data":"25a834e471883cc1b180c7266b82d79f7d725ec175401b8bda8aa158a49cfbdf"}
Sep 19 09:08:19.195749 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:19.195707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55" event={"ID":"c432b742-a0fe-452a-918c-de06cfd479c2","Type":"ContainerStarted","Data":"18771d4a0bd3409e7ed420ba503533f32f56cbdb2d49cf7025c3b7b4ef05cee2"}
Sep 19 09:08:19.196155 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:19.195802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55" event={"ID":"c432b742-a0fe-452a-918c-de06cfd479c2","Type":"ContainerStarted","Data":"90d7afc33dc12c4e61692011f674ad5a974a3aba11bcb7a1da252c6e27143c56"}
Sep 19 09:08:19.232724 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:19.232672    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-r2w55" podStartSLOduration=1.947958358 podStartE2EDuration="3.232654838s" totalImagesPullingTime="1.28469648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:08:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:19.231617403 +0000 UTC m=+82.398812632" watchObservedRunningTime="2026-09-19 09:08:19.232654838 +0000 UTC m=+82.399850068"
Sep 19 09:08:20.168282 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:20.168247    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mg5xq"
Sep 19 09:08:22.002419 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.002390    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"]
Sep 19 09:08:22.006163 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.006147    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.014386 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.014366    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 19 09:08:22.014496 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.014417    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dvxc4\""
Sep 19 09:08:22.014496 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.014376    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 19 09:08:22.049641 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.049607    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"]
Sep 19 09:08:22.100780 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.100741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e47a1032-3ed2-4947-ab44-fa2738b3c65f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.100780 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.100782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e47a1032-3ed2-4947-ab44-fa2738b3c65f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.100994 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.100861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e47a1032-3ed2-4947-ab44-fa2738b3c65f-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.100994 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.100906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx42j\" (UniqueName: \"kubernetes.io/projected/e47a1032-3ed2-4947-ab44-fa2738b3c65f-kube-api-access-mx42j\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.127440 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.127408    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4qvmj"]
Sep 19 09:08:22.130609 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.130591    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.133126 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:22.133101    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"node-exporter-4qvmj\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" podUID="466b0243-1f61-4300-8b43-2f19fbc3f8be" pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.134070 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:22.134042    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap"
Sep 19 09:08:22.134968 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:22.134947    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret"
Sep 19 09:08:22.136537 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:22.136479    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-vz84s\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vz84s\"" type="*v1.Secret"
Sep 19 09:08:22.136600 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:22.136577    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret"
Sep 19 09:08:22.189667 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.189634    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"]
Sep 19 09:08:22.192669 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.192654    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.202146 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e47a1032-3ed2-4947-ab44-fa2738b3c65f-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.202274 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/466b0243-1f61-4300-8b43-2f19fbc3f8be-metrics-client-ca\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.202274 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202253    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/466b0243-1f61-4300-8b43-2f19fbc3f8be-root\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.202362 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx42j\" (UniqueName: \"kubernetes.io/projected/e47a1032-3ed2-4947-ab44-fa2738b3c65f-kube-api-access-mx42j\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.202362 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202327    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.202362 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202348    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-textfile\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.202476 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-wtmp\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.202476 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.202549 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202470    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k722m\" (UniqueName: \"kubernetes.io/projected/466b0243-1f61-4300-8b43-2f19fbc3f8be-kube-api-access-k722m\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.202589 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e47a1032-3ed2-4947-ab44-fa2738b3c65f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.202589 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466b0243-1f61-4300-8b43-2f19fbc3f8be-sys\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.202684 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e47a1032-3ed2-4947-ab44-fa2738b3c65f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.202684 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-tls\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.202766 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:22.202731    2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 19 09:08:22.202818 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:22.202805    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e47a1032-3ed2-4947-ab44-fa2738b3c65f-openshift-state-metrics-tls podName:e47a1032-3ed2-4947-ab44-fa2738b3c65f nodeName:}" failed. No retries permitted until 2026-09-19 09:08:22.702788665 +0000 UTC m=+85.869984051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e47a1032-3ed2-4947-ab44-fa2738b3c65f-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-c96z6" (UID: "e47a1032-3ed2-4947-ab44-fa2738b3c65f") : secret "openshift-state-metrics-tls" not found
Sep 19 09:08:22.202818 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.202802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e47a1032-3ed2-4947-ab44-fa2738b3c65f-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.203295 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.203271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 19 09:08:22.205156 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.205139    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e47a1032-3ed2-4947-ab44-fa2738b3c65f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.207662 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.207644    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-w44pl\""
Sep 19 09:08:22.207774 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.207701    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 19 09:08:22.208376 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.208362    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 19 09:08:22.256512 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.256424    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"]
Sep 19 09:08:22.262633 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.262607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx42j\" (UniqueName: \"kubernetes.io/projected/e47a1032-3ed2-4947-ab44-fa2738b3c65f-kube-api-access-mx42j\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.303162 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.303338 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-wtmp\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303338 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303338 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.303338 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303284    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466b0243-1f61-4300-8b43-2f19fbc3f8be-sys\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303338 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-tls\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-wtmp\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466b0243-1f61-4300-8b43-2f19fbc3f8be-sys\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/466b0243-1f61-4300-8b43-2f19fbc3f8be-metrics-client-ca\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/466b0243-1f61-4300-8b43-2f19fbc3f8be-root\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-textfile\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/466b0243-1f61-4300-8b43-2f19fbc3f8be-root\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.303547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.303547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k722m\" (UniqueName: \"kubernetes.io/projected/466b0243-1f61-4300-8b43-2f19fbc3f8be-kube-api-access-k722m\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.303992 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.303992 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303672    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8b4k\" (UniqueName: \"kubernetes.io/projected/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-api-access-k8b4k\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.303992 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.303737    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-textfile\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.304153 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.304056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/466b0243-1f61-4300-8b43-2f19fbc3f8be-metrics-client-ca\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.354987 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.354955    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k722m\" (UniqueName: \"kubernetes.io/projected/466b0243-1f61-4300-8b43-2f19fbc3f8be-kube-api-access-k722m\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:22.404547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.404510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.404547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.404550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.404774 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.404589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.404774 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.404614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8b4k\" (UniqueName: \"kubernetes.io/projected/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-api-access-k8b4k\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.404774 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.404655    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.404774 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.404685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.405175 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.405152    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.405402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.405351    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.405525 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.405439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.407216 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.407197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.407306 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.407252    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.442307 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.442274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8b4k\" (UniqueName: \"kubernetes.io/projected/3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3-kube-api-access-k8b4k\") pod \"kube-state-metrics-84c885658c-tvl2b\" (UID: \"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.500310 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.500267    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"
Sep 19 09:08:22.707439 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.707358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e47a1032-3ed2-4947-ab44-fa2738b3c65f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.709979 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.709956    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e47a1032-3ed2-4947-ab44-fa2738b3c65f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-c96z6\" (UID: \"e47a1032-3ed2-4947-ab44-fa2738b3c65f\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:22.807371 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.807343    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tvl2b"]
Sep 19 09:08:22.810007 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:22.809987    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0d9ee5_ae0c_4f21_a8cc_7acb844f32b3.slice/crio-e8c20736a9103da5b0a0a7c4926f00b1478580985c54f3bcd2a502756645948c WatchSource:0}: Error finding container e8c20736a9103da5b0a0a7c4926f00b1478580985c54f3bcd2a502756645948c: Status 404 returned error can't find the container with id e8c20736a9103da5b0a0a7c4926f00b1478580985c54f3bcd2a502756645948c
Sep 19 09:08:22.913800 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:22.913758    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"
Sep 19 09:08:23.208793 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.208719    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b" event={"ID":"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3","Type":"ContainerStarted","Data":"e8c20736a9103da5b0a0a7c4926f00b1478580985c54f3bcd2a502756645948c"}
Sep 19 09:08:23.233931 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:23.233904    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode47a1032_3ed2_4947_ab44_fa2738b3c65f.slice/crio-9ca9baebe808e7c662aaf75a7358d8e322dff332f277816147831909a5b5b60e WatchSource:0}: Error finding container 9ca9baebe808e7c662aaf75a7358d8e322dff332f277816147831909a5b5b60e: Status 404 returned error can't find the container with id 9ca9baebe808e7c662aaf75a7358d8e322dff332f277816147831909a5b5b60e
Sep 19 09:08:23.276315 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.276276    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 09:08:23.280866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.280848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.283417 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.283393    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6"]
Sep 19 09:08:23.304400 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.304370    2579 configmap.go:193] Couldn't get configMap openshift-monitoring/node-exporter-accelerators-collector-config: failed to sync configmap cache: timed out waiting for the condition
Sep 19 09:08:23.304400 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.304381    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: failed to sync secret cache: timed out waiting for the condition
Sep 19 09:08:23.304603 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.304370    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition
Sep 19 09:08:23.304603 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.304467    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-accelerators-collector-config podName:466b0243-1f61-4300-8b43-2f19fbc3f8be nodeName:}" failed. No retries permitted until 2026-09-19 09:08:23.804448152 +0000 UTC m=+86.971643361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-accelerators-collector-config" (UniqueName: "kubernetes.io/configmap/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-accelerators-collector-config") pod "node-exporter-4qvmj" (UID: "466b0243-1f61-4300-8b43-2f19fbc3f8be") : failed to sync configmap cache: timed out waiting for the condition
Sep 19 09:08:23.304603 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.304488    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-kube-rbac-proxy-config podName:466b0243-1f61-4300-8b43-2f19fbc3f8be nodeName:}" failed. No retries permitted until 2026-09-19 09:08:23.804478106 +0000 UTC m=+86.971673320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-kube-rbac-proxy-config") pod "node-exporter-4qvmj" (UID: "466b0243-1f61-4300-8b43-2f19fbc3f8be") : failed to sync secret cache: timed out waiting for the condition
Sep 19 09:08:23.304603 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.304501    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-tls podName:466b0243-1f61-4300-8b43-2f19fbc3f8be nodeName:}" failed. No retries permitted until 2026-09-19 09:08:23.804494394 +0000 UTC m=+86.971689602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-tls") pod "node-exporter-4qvmj" (UID: "466b0243-1f61-4300-8b43-2f19fbc3f8be") : failed to sync secret cache: timed out waiting for the condition
Sep 19 09:08:23.322173 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.322134    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-generated\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" type="*v1.Secret"
Sep 19 09:08:23.322834 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.322605    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-tls\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" type="*v1.Secret"
Sep 19 09:08:23.322834 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.322699    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-kube-rbac-proxy-web\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" type="*v1.Secret"
Sep 19 09:08:23.322834 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.322724    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" type="*v1.Secret"
Sep 19 09:08:23.322834 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.322724    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-web-config\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" type="*v1.Secret"
Sep 19 09:08:23.322834 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.322824    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-kube-rbac-proxy-metric\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" type="*v1.Secret"
Sep 19 09:08:23.323333 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.322866    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-tls-assets-0\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" type="*v1.Secret"
Sep 19 09:08:23.323333 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.322883    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-cluster-tls-config\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" type="*v1.Secret"
Sep 19 09:08:23.323442 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.323344    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-dockercfg-h6dch\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h6dch\"" type="*v1.Secret"
Sep 19 09:08:23.323442 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:23.323415    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"alertmanager-main-0\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.337836 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.337809    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 19 09:08:23.413600 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.413559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.413600 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.413592    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.413844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.413610    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.413844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.413684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.413844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.413743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.413844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.413770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-out\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.413844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.413795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.413844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.413822    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.414122 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.413876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.414122 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.413915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.414122 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.414044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79lzc\" (UniqueName: \"kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-kube-api-access-79lzc\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.414122 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.414080    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.414122 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.414110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-web-config\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.456098 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.456068    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 09:08:23.471001 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.470915    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 19 09:08:23.515129 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79lzc\" (UniqueName: \"kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-kube-api-access-79lzc\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515317 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515317 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-web-config\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515436 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515436 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515436 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515436 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515611 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515611 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515475    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-out\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515611 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515497    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515611 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515611 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515611 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.515999 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.515976    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.516333 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.516313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.516614 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.516587    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.518058 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.518038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-out\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.526531 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.526507    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vz84s\""
Sep 19 09:08:23.544035 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.543982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79lzc\" (UniqueName: \"kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-kube-api-access-79lzc\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:23.560228 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.560200    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 19 09:08:23.602031 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.601979    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 19 09:08:23.817836 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.817799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:23.818054 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.817903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:23.818054 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.817968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-tls\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:23.818506 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.818463    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:23.820500 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.820472    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:23.820666 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.820647    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/466b0243-1f61-4300-8b43-2f19fbc3f8be-node-exporter-tls\") pod \"node-exporter-4qvmj\" (UID: \"466b0243-1f61-4300-8b43-2f19fbc3f8be\") " pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:23.939584 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:23.939552    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qvmj"
Sep 19 09:08:23.951945 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:23.951916    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466b0243_1f61_4300_8b43_2f19fbc3f8be.slice/crio-192cb08a08fbd06439384e90602312db2b9d1699ac73d06ee896d0f427ac8df2 WatchSource:0}: Error finding container 192cb08a08fbd06439384e90602312db2b9d1699ac73d06ee896d0f427ac8df2: Status 404 returned error can't find the container with id 192cb08a08fbd06439384e90602312db2b9d1699ac73d06ee896d0f427ac8df2
Sep 19 09:08:24.138375 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.138220    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 19 09:08:24.149098 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.149035    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:24.154050 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.154002    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 19 09:08:24.159317 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.159290    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:24.204122 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.204040    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 19 09:08:24.209638 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.209606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:24.217303 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.217223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qvmj" event={"ID":"466b0243-1f61-4300-8b43-2f19fbc3f8be","Type":"ContainerStarted","Data":"192cb08a08fbd06439384e90602312db2b9d1699ac73d06ee896d0f427ac8df2"}
Sep 19 09:08:24.220960 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.220899    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b" event={"ID":"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3","Type":"ContainerStarted","Data":"88bdc974b824dccaf6b063be4ee19a3e5d9537e265d897f2d7204d6ea7e8f315"}
Sep 19 09:08:24.220960 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.220961    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b" event={"ID":"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3","Type":"ContainerStarted","Data":"5efad2c3870b0a5a5e669b03d3168df6e9000c20dae0d62ef661dfc2b37dc1b2"}
Sep 19 09:08:24.221173 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.220988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b" event={"ID":"3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3","Type":"ContainerStarted","Data":"b8a90244f3a242fcbd4af20a09a0e0f91860b57951c8a647ec8f5b0f814654a9"}
Sep 19 09:08:24.223838 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.223773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6" event={"ID":"e47a1032-3ed2-4947-ab44-fa2738b3c65f","Type":"ContainerStarted","Data":"a6a860e43048c0a4bce4d64ebabcb3429a9e3e4d0c3b313a907a4ea4f69a56dc"}
Sep 19 09:08:24.223838 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.223829    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6" event={"ID":"e47a1032-3ed2-4947-ab44-fa2738b3c65f","Type":"ContainerStarted","Data":"2b526914aae073bb91a522d5ac79616bc30056dfce12602e891569efe694662d"}
Sep 19 09:08:24.223971 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.223859    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6" event={"ID":"e47a1032-3ed2-4947-ab44-fa2738b3c65f","Type":"ContainerStarted","Data":"9ca9baebe808e7c662aaf75a7358d8e322dff332f277816147831909a5b5b60e"}
Sep 19 09:08:24.238895 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.238866    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 19 09:08:24.248414 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.248385    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:24.311726 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.311667    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-tvl2b" podStartSLOduration=1.132061158 podStartE2EDuration="2.311650851s" totalImagesPullingTime="1.179589693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:08:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:24.31114888 +0000 UTC m=+87.478344115" watchObservedRunningTime="2026-09-19 09:08:24.311650851 +0000 UTC m=+87.478846103"
Sep 19 09:08:24.508438 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.508353    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 19 09:08:24.516548 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:24.516382    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-web-config: failed to sync secret cache: timed out waiting for the condition
Sep 19 09:08:24.516548 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:24.516418    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: failed to sync secret cache: timed out waiting for the condition
Sep 19 09:08:24.516548 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:24.516467    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-web-config podName:4974b9e0-8dc0-4dba-8270-2b0aff40a8f9 nodeName:}" failed. No retries permitted until 2026-09-19 09:08:25.016448003 +0000 UTC m=+88.183643215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "web-config" (UniqueName: "kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-web-config") pod "alertmanager-main-0" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9") : failed to sync secret cache: timed out waiting for the condition
Sep 19 09:08:24.516548 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:24.516390    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-kube-rbac-proxy: failed to sync secret cache: timed out waiting for the condition
Sep 19 09:08:24.516548 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:24.516488    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-main-tls podName:4974b9e0-8dc0-4dba-8270-2b0aff40a8f9 nodeName:}" failed. No retries permitted until 2026-09-19 09:08:25.016478319 +0000 UTC m=+88.183673527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9") : failed to sync secret cache: timed out waiting for the condition
Sep 19 09:08:24.516548 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:24.516514    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy podName:4974b9e0-8dc0-4dba-8270-2b0aff40a8f9 nodeName:}" failed. No retries permitted until 2026-09-19 09:08:25.016496016 +0000 UTC m=+88.183691240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-kube-rbac-proxy" (UniqueName: "kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy") pod "alertmanager-main-0" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9") : failed to sync secret cache: timed out waiting for the condition
Sep 19 09:08:24.519792 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.519768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:24.587690 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.587651    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h6dch\""
Sep 19 09:08:24.693841 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.693803    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 19 09:08:24.756657 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.756629    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 19 09:08:24.812539 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:24.812506    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 19 09:08:25.030493 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.030461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-web-config\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:25.030679 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.030516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:25.030679 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.030554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:25.032955 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.032931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:25.033085 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.032961    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:25.033085 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.033042    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-web-config\") pod \"alertmanager-main-0\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:25.090624 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.090546    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:08:25.228798 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.228766    2579 generic.go:356] "Generic (PLEG): container finished" podID="466b0243-1f61-4300-8b43-2f19fbc3f8be" containerID="ef6f438e6c9bf6e66594ddc2a9e8f5a449c37b26079b7670ee0484c11901b4f8" exitCode=0
Sep 19 09:08:25.229243 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.228853    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qvmj" event={"ID":"466b0243-1f61-4300-8b43-2f19fbc3f8be","Type":"ContainerDied","Data":"ef6f438e6c9bf6e66594ddc2a9e8f5a449c37b26079b7670ee0484c11901b4f8"}
Sep 19 09:08:25.231217 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.231189    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6" event={"ID":"e47a1032-3ed2-4947-ab44-fa2738b3c65f","Type":"ContainerStarted","Data":"531f372e4430b02c9cf137a67f406b9ec03839b1b1c0da6bcaa7aeea08e5c0ad"}
Sep 19 09:08:25.330607 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.330559    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-c96z6" podStartSLOduration=2.7993598090000003 podStartE2EDuration="4.330543616s" totalImagesPullingTime="1.531183807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:25.324407852 +0000 UTC m=+88.491603082" watchObservedRunningTime="2026-09-19 09:08:25.330543616 +0000 UTC m=+88.497738845"
Sep 19 09:08:25.450952 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:25.450921    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 09:08:25.453923 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:25.453891    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4974b9e0_8dc0_4dba_8270_2b0aff40a8f9.slice/crio-145ed63cb8bac5b83a23b09f61e99fa71455052fe7b2dce28f58b2ed9018a6c0 WatchSource:0}: Error finding container 145ed63cb8bac5b83a23b09f61e99fa71455052fe7b2dce28f58b2ed9018a6c0: Status 404 returned error can't find the container with id 145ed63cb8bac5b83a23b09f61e99fa71455052fe7b2dce28f58b2ed9018a6c0
Sep 19 09:08:26.237777 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.237730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qvmj" event={"ID":"466b0243-1f61-4300-8b43-2f19fbc3f8be","Type":"ContainerStarted","Data":"24a22fb94d1016271a73543a9b8ef4c98fa0ec07f15a0f3d731a28da821522be"}
Sep 19 09:08:26.238211 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.237795    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qvmj" event={"ID":"466b0243-1f61-4300-8b43-2f19fbc3f8be","Type":"ContainerStarted","Data":"acf3e6598532aa9c1836c6e2b61d4c03e5ceed9ea0f682d39ec7135434c60420"}
Sep 19 09:08:26.239476 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.239453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerStarted","Data":"145ed63cb8bac5b83a23b09f61e99fa71455052fe7b2dce28f58b2ed9018a6c0"}
Sep 19 09:08:26.297342 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.297307    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5475698868-8bl2n"]
Sep 19 09:08:26.301109 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.301089    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.307313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.307290    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 19 09:08:26.307547 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.307534    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 19 09:08:26.308029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.307995    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 19 09:08:26.308345 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.308325    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zl527\""
Sep 19 09:08:26.308444 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.308345    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-569std1cmqe01\""
Sep 19 09:08:26.308444 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.308361    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 19 09:08:26.308444 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.308371    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 19 09:08:26.320322 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.320276    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4qvmj" podStartSLOduration=3.305983638 podStartE2EDuration="4.320261925s" totalImagesPullingTime="943.455951ms" totalInitContainerRuntime="70.822336ms" isStatefulPod=true podCreationTimestamp="2026-09-19 09:08:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:26.319945431 +0000 UTC m=+89.487140662" watchObservedRunningTime="2026-09-19 09:08:26.320261925 +0000 UTC m=+89.487457154"
Sep 19 09:08:26.358833 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.357501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5475698868-8bl2n"]
Sep 19 09:08:26.444140 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.444097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-tls\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.444317 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.444154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5516fa8-265c-4145-bf0e-72deb03cf7ac-metrics-client-ca\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.444317 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.444280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-grpc-tls\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.444411 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.444335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.444411 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.444368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.444482 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.444426    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmgnl\" (UniqueName: \"kubernetes.io/projected/c5516fa8-265c-4145-bf0e-72deb03cf7ac-kube-api-access-hmgnl\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.444482 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.444473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.444552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.444525    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.456776 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.456745    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f867489bc-8wz2w"]
Sep 19 09:08:26.459896 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.459873    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.467730 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.467707    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 19 09:08:26.470281 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.470242    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 19 09:08:26.470733 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.470714    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 19 09:08:26.470809 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.470748    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ljgnv\""
Sep 19 09:08:26.470809 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.470769    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 19 09:08:26.471110 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.471092    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 19 09:08:26.471233 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.471217    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 19 09:08:26.474906 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.474890    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 19 09:08:26.475179 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.475162    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 19 09:08:26.497275 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.497205    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f867489bc-8wz2w"]
Sep 19 09:08:26.545431 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-oauth-serving-cert\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.545651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-grpc-tls\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.545651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.545651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.545651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmgnl\" (UniqueName: \"kubernetes.io/projected/c5516fa8-265c-4145-bf0e-72deb03cf7ac-kube-api-access-hmgnl\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.545890 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545680    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.545890 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-service-ca\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.545890 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.545890 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h94fm\" (UniqueName: \"kubernetes.io/projected/f758745c-8f3d-4f82-a783-622808054661-kube-api-access-h94fm\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.545890 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-console-config\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.545890 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545823    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-trusted-ca-bundle\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.545890 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-tls\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.545890 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5516fa8-265c-4145-bf0e-72deb03cf7ac-metrics-client-ca\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.546287 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545936    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-serving-cert\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.546287 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.545960    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-oauth-config\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.547052 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.546983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5516fa8-265c-4145-bf0e-72deb03cf7ac-metrics-client-ca\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.548666 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.548575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.548884 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.548861    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.549147 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.548998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.549147 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.549118    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-tls\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.549459 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.549438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-grpc-tls\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.549498 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.549465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c5516fa8-265c-4145-bf0e-72deb03cf7ac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.591628 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.591604    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"]
Sep 19 09:08:26.593403 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.593385    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmgnl\" (UniqueName: \"kubernetes.io/projected/c5516fa8-265c-4145-bf0e-72deb03cf7ac-kube-api-access-hmgnl\") pod \"thanos-querier-5475698868-8bl2n\" (UID: \"c5516fa8-265c-4145-bf0e-72deb03cf7ac\") " pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.595905 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.595891    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:26.599330 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.599301    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 19 09:08:26.599413 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.599394    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hjmw7\""
Sep 19 09:08:26.612094 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.612061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:26.625119 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.625081    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"]
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.649452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-serving-cert\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.649499    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0557957e-bee0-4a70-a2ba-a46c48493080-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-v49lk\" (UID: \"0557957e-bee0-4a70-a2ba-a46c48493080\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.649529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-oauth-config\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.649584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-oauth-serving-cert\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.649624    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vl4w\" (UniqueName: \"kubernetes.io/projected/0557957e-bee0-4a70-a2ba-a46c48493080-kube-api-access-8vl4w\") pod \"monitoring-plugin-5984459ff8-v49lk\" (UID: \"0557957e-bee0-4a70-a2ba-a46c48493080\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.649683    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-service-ca\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.649730    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h94fm\" (UniqueName: \"kubernetes.io/projected/f758745c-8f3d-4f82-a783-622808054661-kube-api-access-h94fm\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.649758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-console-config\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.649783    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-trusted-ca-bundle\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.650918    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-trusted-ca-bundle\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.652466    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-service-ca\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.653254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.653041    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-oauth-serving-cert\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.653865 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.653546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-console-config\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.654561 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.654529    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-oauth-config\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.654955 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.654933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-serving-cert\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.677458 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.677429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h94fm\" (UniqueName: \"kubernetes.io/projected/f758745c-8f3d-4f82-a783-622808054661-kube-api-access-h94fm\") pod \"console-f867489bc-8wz2w\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") " pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.751104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.751007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0557957e-bee0-4a70-a2ba-a46c48493080-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-v49lk\" (UID: \"0557957e-bee0-4a70-a2ba-a46c48493080\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:26.751104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.751087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vl4w\" (UniqueName: \"kubernetes.io/projected/0557957e-bee0-4a70-a2ba-a46c48493080-kube-api-access-8vl4w\") pod \"monitoring-plugin-5984459ff8-v49lk\" (UID: \"0557957e-bee0-4a70-a2ba-a46c48493080\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:26.751314 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:26.751139    2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 19 09:08:26.751314 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:26.751223    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0557957e-bee0-4a70-a2ba-a46c48493080-monitoring-plugin-cert podName:0557957e-bee0-4a70-a2ba-a46c48493080 nodeName:}" failed. No retries permitted until 2026-09-19 09:08:27.25120329 +0000 UTC m=+90.418398502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0557957e-bee0-4a70-a2ba-a46c48493080-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-v49lk" (UID: "0557957e-bee0-4a70-a2ba-a46c48493080") : secret "monitoring-plugin-cert" not found
Sep 19 09:08:26.772954 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.772926    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:26.778592 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.778566    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vl4w\" (UniqueName: \"kubernetes.io/projected/0557957e-bee0-4a70-a2ba-a46c48493080-kube-api-access-8vl4w\") pod \"monitoring-plugin-5984459ff8-v49lk\" (UID: \"0557957e-bee0-4a70-a2ba-a46c48493080\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:26.911460 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.911432    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5c46bd4f-qr72n"]
Sep 19 09:08:26.915604 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.915587    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:26.924967 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.924948    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 19 09:08:26.925188 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.925171    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-27aqjhsqaadin\""
Sep 19 09:08:26.925313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.925297    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 19 09:08:26.925426 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.925408    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 19 09:08:26.926374 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.926361    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 19 09:08:26.931103 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.931084    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-h6vfj\""
Sep 19 09:08:26.932226 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:26.932208    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c46bd4f-qr72n"]
Sep 19 09:08:27.005404 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.005290    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5475698868-8bl2n"]
Sep 19 09:08:27.009498 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:27.009479    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5516fa8_265c_4145_bf0e_72deb03cf7ac.slice/crio-b4dd0e8f509ee925925d53a391dfe68b3ff6ea74813d28016a255b752dcd238b WatchSource:0}: Error finding container b4dd0e8f509ee925925d53a391dfe68b3ff6ea74813d28016a255b752dcd238b: Status 404 returned error can't find the container with id b4dd0e8f509ee925925d53a391dfe68b3ff6ea74813d28016a255b752dcd238b
Sep 19 09:08:27.052940 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.052916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7169c963-e65c-442f-8a6b-6b8828d784ea-audit-log\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.053096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.052972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7169c963-e65c-442f-8a6b-6b8828d784ea-secret-metrics-server-tls\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.053096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.052988    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7169c963-e65c-442f-8a6b-6b8828d784ea-client-ca-bundle\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.053096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.053007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtq5d\" (UniqueName: \"kubernetes.io/projected/7169c963-e65c-442f-8a6b-6b8828d784ea-kube-api-access-dtq5d\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.053096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.053074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7169c963-e65c-442f-8a6b-6b8828d784ea-metrics-server-audit-profiles\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.053248 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.053152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7169c963-e65c-442f-8a6b-6b8828d784ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.053248 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.053183    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7169c963-e65c-442f-8a6b-6b8828d784ea-secret-metrics-server-client-certs\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.113609 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:27.113578    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf758745c_8f3d_4f82_a783_622808054661.slice/crio-e0d69fed0a0eb0d565b15515c47c30fcc9190776fd10ba7d95f642f276b188b3 WatchSource:0}: Error finding container e0d69fed0a0eb0d565b15515c47c30fcc9190776fd10ba7d95f642f276b188b3: Status 404 returned error can't find the container with id e0d69fed0a0eb0d565b15515c47c30fcc9190776fd10ba7d95f642f276b188b3
Sep 19 09:08:27.116314 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.116227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f867489bc-8wz2w"]
Sep 19 09:08:27.154393 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.154362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7169c963-e65c-442f-8a6b-6b8828d784ea-audit-log\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.154566 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.154436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7169c963-e65c-442f-8a6b-6b8828d784ea-secret-metrics-server-tls\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.154566 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.154462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7169c963-e65c-442f-8a6b-6b8828d784ea-client-ca-bundle\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.154566 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.154486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtq5d\" (UniqueName: \"kubernetes.io/projected/7169c963-e65c-442f-8a6b-6b8828d784ea-kube-api-access-dtq5d\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.154566 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.154512    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7169c963-e65c-442f-8a6b-6b8828d784ea-metrics-server-audit-profiles\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.154761 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.154569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7169c963-e65c-442f-8a6b-6b8828d784ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.154761 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.154615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7169c963-e65c-442f-8a6b-6b8828d784ea-secret-metrics-server-client-certs\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.154848 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.154809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7169c963-e65c-442f-8a6b-6b8828d784ea-audit-log\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.155394 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.155316    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7169c963-e65c-442f-8a6b-6b8828d784ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.155864 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.155834    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7169c963-e65c-442f-8a6b-6b8828d784ea-metrics-server-audit-profiles\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.157128 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.157109    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7169c963-e65c-442f-8a6b-6b8828d784ea-secret-metrics-server-tls\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.157209 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.157195    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7169c963-e65c-442f-8a6b-6b8828d784ea-secret-metrics-server-client-certs\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.157286 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.157245    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7169c963-e65c-442f-8a6b-6b8828d784ea-client-ca-bundle\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.179388 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.179364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtq5d\" (UniqueName: \"kubernetes.io/projected/7169c963-e65c-442f-8a6b-6b8828d784ea-kube-api-access-dtq5d\") pod \"metrics-server-5c46bd4f-qr72n\" (UID: \"7169c963-e65c-442f-8a6b-6b8828d784ea\") " pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.223801 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.223762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:27.248415 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.248374    2579 generic.go:356] "Generic (PLEG): container finished" podID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerID="d242cba47ad9595af4c9e65d769ee2891813c2870a7694e23ab70397b006470b" exitCode=0
Sep 19 09:08:27.248834 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.248488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerDied","Data":"d242cba47ad9595af4c9e65d769ee2891813c2870a7694e23ab70397b006470b"}
Sep 19 09:08:27.252191 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.252159    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f867489bc-8wz2w" event={"ID":"f758745c-8f3d-4f82-a783-622808054661","Type":"ContainerStarted","Data":"e0d69fed0a0eb0d565b15515c47c30fcc9190776fd10ba7d95f642f276b188b3"}
Sep 19 09:08:27.253311 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.253285    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n" event={"ID":"c5516fa8-265c-4145-bf0e-72deb03cf7ac","Type":"ContainerStarted","Data":"b4dd0e8f509ee925925d53a391dfe68b3ff6ea74813d28016a255b752dcd238b"}
Sep 19 09:08:27.255992 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.255939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0557957e-bee0-4a70-a2ba-a46c48493080-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-v49lk\" (UID: \"0557957e-bee0-4a70-a2ba-a46c48493080\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:27.256129 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:27.256109    2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 19 09:08:27.256193 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:08:27.256182    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0557957e-bee0-4a70-a2ba-a46c48493080-monitoring-plugin-cert podName:0557957e-bee0-4a70-a2ba-a46c48493080 nodeName:}" failed. No retries permitted until 2026-09-19 09:08:28.256162522 +0000 UTC m=+91.423357730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0557957e-bee0-4a70-a2ba-a46c48493080-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-v49lk" (UID: "0557957e-bee0-4a70-a2ba-a46c48493080") : secret "monitoring-plugin-cert" not found
Sep 19 09:08:27.581346 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:27.581266    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c46bd4f-qr72n"]
Sep 19 09:08:27.584438 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:27.584400    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7169c963_e65c_442f_8a6b_6b8828d784ea.slice/crio-43f2852bba7fbd10f3792a3c425817df319b0bfe33a4f5c1498edddcc19fab56 WatchSource:0}: Error finding container 43f2852bba7fbd10f3792a3c425817df319b0bfe33a4f5c1498edddcc19fab56: Status 404 returned error can't find the container with id 43f2852bba7fbd10f3792a3c425817df319b0bfe33a4f5c1498edddcc19fab56
Sep 19 09:08:28.267263 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:28.267222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n" event={"ID":"7169c963-e65c-442f-8a6b-6b8828d784ea","Type":"ContainerStarted","Data":"43f2852bba7fbd10f3792a3c425817df319b0bfe33a4f5c1498edddcc19fab56"}
Sep 19 09:08:28.267722 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:28.267658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0557957e-bee0-4a70-a2ba-a46c48493080-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-v49lk\" (UID: \"0557957e-bee0-4a70-a2ba-a46c48493080\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:28.273264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:28.273213    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0557957e-bee0-4a70-a2ba-a46c48493080-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-v49lk\" (UID: \"0557957e-bee0-4a70-a2ba-a46c48493080\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:28.416174 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:28.415893    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:28.744010 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:28.743916    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"]
Sep 19 09:08:30.297209 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:08:30.297182    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0557957e_bee0_4a70_a2ba_a46c48493080.slice/crio-bdb2ca8e95b03b20ba18ee0933b78856971d214061ca2ffa8cb40a0acf4c5504 WatchSource:0}: Error finding container bdb2ca8e95b03b20ba18ee0933b78856971d214061ca2ffa8cb40a0acf4c5504: Status 404 returned error can't find the container with id bdb2ca8e95b03b20ba18ee0933b78856971d214061ca2ffa8cb40a0acf4c5504
Sep 19 09:08:31.281910 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:31.281867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk" event={"ID":"0557957e-bee0-4a70-a2ba-a46c48493080","Type":"ContainerStarted","Data":"bdb2ca8e95b03b20ba18ee0933b78856971d214061ca2ffa8cb40a0acf4c5504"}
Sep 19 09:08:33.291368 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.291316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n" event={"ID":"7169c963-e65c-442f-8a6b-6b8828d784ea","Type":"ContainerStarted","Data":"9b53965422b3a5ad3c37c7b1a94f50319675c6fe2a6816e3d7666bdbe87c3bf1"}
Sep 19 09:08:33.296346 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.296320    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerStarted","Data":"3ab37b155a8fe55b433732f26f556c4dbad9daf3c634df5542e15c3e1b782b05"}
Sep 19 09:08:33.296463 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.296390    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerStarted","Data":"f7a0feb13bcf19e35f939d9d5b34b4cd6851e2ed41a4de2bfd66f60696f6a940"}
Sep 19 09:08:33.296463 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.296415    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerStarted","Data":"417448ad1bdfa6ae1a12a845f4581c88ee7680a2294e62d61ee88caddb1d6d3a"}
Sep 19 09:08:33.296463 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.296439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerStarted","Data":"acfe9c685f7c30a6a1855476289efb640d70d899c23d089483fb0738e447633d"}
Sep 19 09:08:33.296463 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.296460    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerStarted","Data":"dd06cd86236efca2b689374258307a1d4ac0a30d6fe86cf4a892ae71b5f2abf9"}
Sep 19 09:08:33.298113 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.298091    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f867489bc-8wz2w" event={"ID":"f758745c-8f3d-4f82-a783-622808054661","Type":"ContainerStarted","Data":"6f729f10c16d453a006b7e60810935eaa150b71ab638187cf7a0d38432ed0f00"}
Sep 19 09:08:33.300634 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.300612    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n" event={"ID":"c5516fa8-265c-4145-bf0e-72deb03cf7ac","Type":"ContainerStarted","Data":"6705bb05d647753e00a0b236c8c65bdc4461b1f04041088cb1f8b2001fde466a"}
Sep 19 09:08:33.300720 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.300677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n" event={"ID":"c5516fa8-265c-4145-bf0e-72deb03cf7ac","Type":"ContainerStarted","Data":"de65b6d0f7e02786b45e21d06a9a8499917dc7d04dd016a4072a4579ada5568a"}
Sep 19 09:08:33.300772 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.300720    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n" event={"ID":"c5516fa8-265c-4145-bf0e-72deb03cf7ac","Type":"ContainerStarted","Data":"b1fcadf47361b828a4d8fcf9f248a59d7391e8219ead0683ec8a5984c363167e"}
Sep 19 09:08:33.301942 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.301921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk" event={"ID":"0557957e-bee0-4a70-a2ba-a46c48493080","Type":"ContainerStarted","Data":"1ce0483044210e9a659e7aa800c79395728e429d8c05c1cf75ee17d51ecf4896"}
Sep 19 09:08:33.302162 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.302145    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:33.307242 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.307225    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk"
Sep 19 09:08:33.348941 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.348881    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n" podStartSLOduration=2.364464837 podStartE2EDuration="7.348866529s" totalImagesPullingTime="4.984401692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:33.348722276 +0000 UTC m=+96.515917508" watchObservedRunningTime="2026-09-19 09:08:33.348866529 +0000 UTC m=+96.516061801"
Sep 19 09:08:33.482615 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.482516    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-v49lk" podStartSLOduration=4.770726913 podStartE2EDuration="7.482499096s" totalImagesPullingTime="2.711772183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:33.402865927 +0000 UTC m=+96.570061162" watchObservedRunningTime="2026-09-19 09:08:33.482499096 +0000 UTC m=+96.649694325"
Sep 19 09:08:33.482861 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:33.482834    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f867489bc-8wz2w" podStartSLOduration=1.637481213 podStartE2EDuration="7.482826704s" totalImagesPullingTime="5.845345491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:33.482087864 +0000 UTC m=+96.649283097" watchObservedRunningTime="2026-09-19 09:08:33.482826704 +0000 UTC m=+96.650021932"
Sep 19 09:08:34.308655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:34.308616    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerStarted","Data":"92ebd5c30edd4274bbf0065da8a192eac579fd74c824fd20596fa5c1c2f4f2e8"}
Sep 19 09:08:34.311452 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:34.311426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n" event={"ID":"c5516fa8-265c-4145-bf0e-72deb03cf7ac","Type":"ContainerStarted","Data":"b32e991fe38106cfa3b37ba89fbe1c7f6728320e730c4e1377177870c3baca54"}
Sep 19 09:08:34.311537 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:34.311492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n" event={"ID":"c5516fa8-265c-4145-bf0e-72deb03cf7ac","Type":"ContainerStarted","Data":"a7d814e07dc8162a59df852b29e36aad8112d01aa50706879149b35c258d8868"}
Sep 19 09:08:34.311537 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:34.311520    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n" event={"ID":"c5516fa8-265c-4145-bf0e-72deb03cf7ac","Type":"ContainerStarted","Data":"b310871655d4e043b32fb5314238816ad247bc5d27d84c528b31d55f9a8855db"}
Sep 19 09:08:34.447369 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:34.447312    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.420130207 podStartE2EDuration="11.447293706s" totalImagesPullingTime="6.988710947s" totalInitContainerRuntime="38.452552ms" isStatefulPod=false podCreationTimestamp="2026-09-19 09:08:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:34.368647552 +0000 UTC m=+97.535842798" watchObservedRunningTime="2026-09-19 09:08:34.447293706 +0000 UTC m=+97.614488936"
Sep 19 09:08:35.315748 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:35.315717    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:36.774152 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:36.774121    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:36.774564 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:36.774182    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:36.778737 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:36.778717    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:36.836848 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:36.836787    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n" podStartSLOduration=4.523786454 podStartE2EDuration="10.836772714s" totalImagesPullingTime="6.31298626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:08:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:08:34.448334505 +0000 UTC m=+97.615529734" watchObservedRunningTime="2026-09-19 09:08:36.836772714 +0000 UTC m=+100.003967943"
Sep 19 09:08:37.326127 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:37.326098    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:08:39.089741 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:39.089702    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r6lgq_7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e/serve-healthcheck-canary/0.log"
Sep 19 09:08:41.327954 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:41.327928    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5475698868-8bl2n"
Sep 19 09:08:47.225372 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:47.225337    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:08:47.225835 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:08:47.225396    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:09:07.231402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:07.231371    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:09:07.234864 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:07.234842    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5c46bd4f-qr72n"
Sep 19 09:09:08.613563 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.613527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:09:08.614011 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.613621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:09:08.616720 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.616698    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 09:09:08.616830 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.616813    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 09:09:08.626652 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.626630    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957c300-67ee-4732-a5c4-75ffc15fd793-metrics-certs\") pod \"network-metrics-daemon-rv72r\" (UID: \"7957c300-67ee-4732-a5c4-75ffc15fd793\") " pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:09:08.626742 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.626680    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/680d6b24-fc31-40bd-942a-e1f3d3647be2-original-pull-secret\") pod \"global-pull-secret-syncer-zsz2b\" (UID: \"680d6b24-fc31-40bd-942a-e1f3d3647be2\") " pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:09:08.714411 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.714369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mdp\" (UniqueName: \"kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp\") pod \"network-check-target-cs9lj\" (UID: \"05540c93-6c4e-4ffb-a203-5901e567d0c8\") " pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:09:08.718801 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.718778    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 09:09:08.718932 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.718916    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fszt9\""
Sep 19 09:09:08.723625 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.723614    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rv72r"
Sep 19 09:09:08.727635 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.727614    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 09:09:08.738095 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.738072    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5mdp\" (UniqueName: \"kubernetes.io/projected/05540c93-6c4e-4ffb-a203-5901e567d0c8-kube-api-access-v5mdp\") pod \"network-check-target-cs9lj\" (UID: \"05540c93-6c4e-4ffb-a203-5901e567d0c8\") " pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:09:08.909116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.909045    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsz2b"
Sep 19 09:09:08.925835 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.925815    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2r86\""
Sep 19 09:09:08.935036 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:08.934975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:09:09.014540 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:09.014512    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rv72r"]
Sep 19 09:09:09.015381 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:09:09.015355    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7957c300_67ee_4732_a5c4_75ffc15fd793.slice/crio-7c78672fc21003147280fe188e93ef34067ef9f42a1e119110030dbd98914fb4 WatchSource:0}: Error finding container 7c78672fc21003147280fe188e93ef34067ef9f42a1e119110030dbd98914fb4: Status 404 returned error can't find the container with id 7c78672fc21003147280fe188e93ef34067ef9f42a1e119110030dbd98914fb4
Sep 19 09:09:09.207626 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:09.207603    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zsz2b"]
Sep 19 09:09:09.210064 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:09:09.210036    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod680d6b24_fc31_40bd_942a_e1f3d3647be2.slice/crio-f7c4d2168fd599d236d8d864040370e029a529eabc9ccc3da761a37a7bcdf461 WatchSource:0}: Error finding container f7c4d2168fd599d236d8d864040370e029a529eabc9ccc3da761a37a7bcdf461: Status 404 returned error can't find the container with id f7c4d2168fd599d236d8d864040370e029a529eabc9ccc3da761a37a7bcdf461
Sep 19 09:09:09.228429 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:09.228403    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cs9lj"]
Sep 19 09:09:09.231148 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:09:09.231127    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05540c93_6c4e_4ffb_a203_5901e567d0c8.slice/crio-d16908704a8c0a8f9b2fca0bddb6a68d317ccb9e2049d61964667c468e3fed48 WatchSource:0}: Error finding container d16908704a8c0a8f9b2fca0bddb6a68d317ccb9e2049d61964667c468e3fed48: Status 404 returned error can't find the container with id d16908704a8c0a8f9b2fca0bddb6a68d317ccb9e2049d61964667c468e3fed48
Sep 19 09:09:09.440135 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:09.440101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cs9lj" event={"ID":"05540c93-6c4e-4ffb-a203-5901e567d0c8","Type":"ContainerStarted","Data":"d16908704a8c0a8f9b2fca0bddb6a68d317ccb9e2049d61964667c468e3fed48"}
Sep 19 09:09:09.441157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:09.441137    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zsz2b" event={"ID":"680d6b24-fc31-40bd-942a-e1f3d3647be2","Type":"ContainerStarted","Data":"f7c4d2168fd599d236d8d864040370e029a529eabc9ccc3da761a37a7bcdf461"}
Sep 19 09:09:09.442216 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:09.442192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rv72r" event={"ID":"7957c300-67ee-4732-a5c4-75ffc15fd793","Type":"ContainerStarted","Data":"7c78672fc21003147280fe188e93ef34067ef9f42a1e119110030dbd98914fb4"}
Sep 19 09:09:11.459706 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:11.459669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rv72r" event={"ID":"7957c300-67ee-4732-a5c4-75ffc15fd793","Type":"ContainerStarted","Data":"6290aac5d192391cad9ea9d1595a0c79f1280fb34b1e4eb2ffb57fee73ade07d"}
Sep 19 09:09:11.460305 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:11.459763    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rv72r" event={"ID":"7957c300-67ee-4732-a5c4-75ffc15fd793","Type":"ContainerStarted","Data":"b3f4cd5cc67da60e38230b1ad6e50c5754f5fca36eea25640abdcfabf2fd9553"}
Sep 19 09:09:11.487948 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:11.487895    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rv72r" podStartSLOduration=131.108360566 podStartE2EDuration="2m12.487878867s" totalImagesPullingTime="1.379518301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:09:11.487678245 +0000 UTC m=+134.654873475" watchObservedRunningTime="2026-09-19 09:09:11.487878867 +0000 UTC m=+134.655074096"
Sep 19 09:09:14.473533 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:14.473488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zsz2b" event={"ID":"680d6b24-fc31-40bd-942a-e1f3d3647be2","Type":"ContainerStarted","Data":"85a2058901175494844c76ac6d8c7423867992616458d373d4d282362c990c17"}
Sep 19 09:09:14.474961 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:14.474939    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cs9lj" event={"ID":"05540c93-6c4e-4ffb-a203-5901e567d0c8","Type":"ContainerStarted","Data":"896645e4b880c6802aa74835aa8b8055fdfde980d73f92db1b63df29ec70b1a8"}
Sep 19 09:09:14.475078 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:14.475064    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:09:14.529442 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:14.529389    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zsz2b" podStartSLOduration=130.792512457 podStartE2EDuration="2m15.529373401s" totalImagesPullingTime="4.736860944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:09:14.503415736 +0000 UTC m=+137.670610965" watchObservedRunningTime="2026-09-19 09:09:14.529373401 +0000 UTC m=+137.696568639"
Sep 19 09:09:45.483080 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:45.482995    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cs9lj"
Sep 19 09:09:45.519363 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:09:45.519304    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cs9lj" podStartSLOduration=162.807303758 podStartE2EDuration="2m47.519289611s" totalImagesPullingTime="4.711985853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:09:14.54076188 +0000 UTC m=+137.707957109" watchObservedRunningTime="2026-09-19 09:09:45.519289611 +0000 UTC m=+168.686484841"
Sep 19 09:11:58.810532 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:11:58.810506    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:11:58.819983 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:11:58.819953    2579 kubelet.go:1648] "Image garbage collection succeeded"
Sep 19 09:11:58.822768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:11:58.822745    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:13:28.266549 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.266517    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 09:13:28.267134 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.266815    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="alertmanager" containerID="cri-o://dd06cd86236efca2b689374258307a1d4ac0a30d6fe86cf4a892ae71b5f2abf9" gracePeriod=120
Sep 19 09:13:28.267134 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.266886    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy-metric" containerID="cri-o://3ab37b155a8fe55b433732f26f556c4dbad9daf3c634df5542e15c3e1b782b05" gracePeriod=120
Sep 19 09:13:28.267134 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.266922    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy" containerID="cri-o://f7a0feb13bcf19e35f939d9d5b34b4cd6851e2ed41a4de2bfd66f60696f6a940" gracePeriod=120
Sep 19 09:13:28.267134 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.266922    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy-web" containerID="cri-o://417448ad1bdfa6ae1a12a845f4581c88ee7680a2294e62d61ee88caddb1d6d3a" gracePeriod=120
Sep 19 09:13:28.267134 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.266943    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="config-reloader" containerID="cri-o://acfe9c685f7c30a6a1855476289efb640d70d899c23d089483fb0738e447633d" gracePeriod=120
Sep 19 09:13:28.267134 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.267052    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="prom-label-proxy" containerID="cri-o://92ebd5c30edd4274bbf0065da8a192eac579fd74c824fd20596fa5c1c2f4f2e8" gracePeriod=120
Sep 19 09:13:28.416336 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416303    2579 generic.go:356] "Generic (PLEG): container finished" podID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerID="92ebd5c30edd4274bbf0065da8a192eac579fd74c824fd20596fa5c1c2f4f2e8" exitCode=0
Sep 19 09:13:28.416336 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416331    2579 generic.go:356] "Generic (PLEG): container finished" podID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerID="3ab37b155a8fe55b433732f26f556c4dbad9daf3c634df5542e15c3e1b782b05" exitCode=0
Sep 19 09:13:28.416336 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416339    2579 generic.go:356] "Generic (PLEG): container finished" podID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerID="f7a0feb13bcf19e35f939d9d5b34b4cd6851e2ed41a4de2bfd66f60696f6a940" exitCode=0
Sep 19 09:13:28.416336 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416345    2579 generic.go:356] "Generic (PLEG): container finished" podID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerID="417448ad1bdfa6ae1a12a845f4581c88ee7680a2294e62d61ee88caddb1d6d3a" exitCode=0
Sep 19 09:13:28.416586 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416353    2579 generic.go:356] "Generic (PLEG): container finished" podID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerID="acfe9c685f7c30a6a1855476289efb640d70d899c23d089483fb0738e447633d" exitCode=0
Sep 19 09:13:28.416586 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416360    2579 generic.go:356] "Generic (PLEG): container finished" podID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerID="dd06cd86236efca2b689374258307a1d4ac0a30d6fe86cf4a892ae71b5f2abf9" exitCode=0
Sep 19 09:13:28.416586 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerDied","Data":"92ebd5c30edd4274bbf0065da8a192eac579fd74c824fd20596fa5c1c2f4f2e8"}
Sep 19 09:13:28.416586 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerDied","Data":"3ab37b155a8fe55b433732f26f556c4dbad9daf3c634df5542e15c3e1b782b05"}
Sep 19 09:13:28.416586 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerDied","Data":"f7a0feb13bcf19e35f939d9d5b34b4cd6851e2ed41a4de2bfd66f60696f6a940"}
Sep 19 09:13:28.416586 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416491    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerDied","Data":"417448ad1bdfa6ae1a12a845f4581c88ee7680a2294e62d61ee88caddb1d6d3a"}
Sep 19 09:13:28.416586 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerDied","Data":"acfe9c685f7c30a6a1855476289efb640d70d899c23d089483fb0738e447633d"}
Sep 19 09:13:28.416586 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.416538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerDied","Data":"dd06cd86236efca2b689374258307a1d4ac0a30d6fe86cf4a892ae71b5f2abf9"}
Sep 19 09:13:28.504131 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.502376    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:28.565703 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565670    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.565703 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565709    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-main-db\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.565938 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565730    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-main-tls\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.565938 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-volume\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.565938 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565778    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-metrics-client-ca\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.565938 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565792    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-out\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.565938 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565816    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-tls-assets\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.565938 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565835    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.565938 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565862    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-trusted-ca-bundle\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.565938 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565916    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-web-config\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.565938 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565940    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-cluster-tls-config\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.566388 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.565975    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.566388 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.566049    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79lzc\" (UniqueName: \"kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-kube-api-access-79lzc\") pod \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\" (UID: \"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9\") "
Sep 19 09:13:28.566388 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.566157    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:13:28.566388 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.566227    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:13:28.566388 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.566355    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-main-db\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.566388 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.566373    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-metrics-client-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.566963 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.566932    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:13:28.569799 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.569773    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 09:13:28.569940 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.569912    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-kube-api-access-79lzc" (OuterVolumeSpecName: "kube-api-access-79lzc") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "kube-api-access-79lzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:13:28.571156 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.571119    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 09:13:28.571156 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.571144    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-out" (OuterVolumeSpecName: "config-out") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:13:28.571300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.571210    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:13:28.571300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.571260    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-volume" (OuterVolumeSpecName: "config-volume") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 09:13:28.571610 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.571590    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 09:13:28.571711 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.571689    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 09:13:28.578227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.578199    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 09:13:28.584591 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.584562    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-web-config" (OuterVolumeSpecName: "web-config") pod "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" (UID: "4974b9e0-8dc0-4dba-8270-2b0aff40a8f9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 09:13:28.666960 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.666920    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.666960 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.666952    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-main-tls\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.666960 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.666964    2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.666960 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.666972    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-config-out\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.667227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.666979    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-tls-assets\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.667227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.666987    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.667227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.666995    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.667227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.667004    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-web-config\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.667227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.667012    2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-cluster-tls-config\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.667227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.667039    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:28.667227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:28.667048    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79lzc\" (UniqueName: \"kubernetes.io/projected/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9-kube-api-access-79lzc\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:13:29.423143 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.423108    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4974b9e0-8dc0-4dba-8270-2b0aff40a8f9","Type":"ContainerDied","Data":"145ed63cb8bac5b83a23b09f61e99fa71455052fe7b2dce28f58b2ed9018a6c0"}
Sep 19 09:13:29.423596 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.423150    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.423596 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.423196    2579 scope.go:117] "RemoveContainer" containerID="92ebd5c30edd4274bbf0065da8a192eac579fd74c824fd20596fa5c1c2f4f2e8"
Sep 19 09:13:29.430439 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.430422    2579 scope.go:117] "RemoveContainer" containerID="3ab37b155a8fe55b433732f26f556c4dbad9daf3c634df5542e15c3e1b782b05"
Sep 19 09:13:29.437839 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.437823    2579 scope.go:117] "RemoveContainer" containerID="f7a0feb13bcf19e35f939d9d5b34b4cd6851e2ed41a4de2bfd66f60696f6a940"
Sep 19 09:13:29.444287 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.444268    2579 scope.go:117] "RemoveContainer" containerID="417448ad1bdfa6ae1a12a845f4581c88ee7680a2294e62d61ee88caddb1d6d3a"
Sep 19 09:13:29.450508 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.450494    2579 scope.go:117] "RemoveContainer" containerID="acfe9c685f7c30a6a1855476289efb640d70d899c23d089483fb0738e447633d"
Sep 19 09:13:29.457251 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.457226    2579 scope.go:117] "RemoveContainer" containerID="dd06cd86236efca2b689374258307a1d4ac0a30d6fe86cf4a892ae71b5f2abf9"
Sep 19 09:13:29.459961 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.459941    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 09:13:29.464517 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.464502    2579 scope.go:117] "RemoveContainer" containerID="d242cba47ad9595af4c9e65d769ee2891813c2870a7694e23ab70397b006470b"
Sep 19 09:13:29.481795 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.481771    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 09:13:29.567279 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567249    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 09:13:29.567516 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567505    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="alertmanager"
Sep 19 09:13:29.567565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567518    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="alertmanager"
Sep 19 09:13:29.567565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567529    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="config-reloader"
Sep 19 09:13:29.567565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567534    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="config-reloader"
Sep 19 09:13:29.567565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567543    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="prom-label-proxy"
Sep 19 09:13:29.567565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567549    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="prom-label-proxy"
Sep 19 09:13:29.567565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567557    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy-web"
Sep 19 09:13:29.567565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567562    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy-web"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567573    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="init-config-reloader"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567579    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="init-config-reloader"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567584    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567589    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567598    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy-metric"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567604    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy-metric"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567642    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy-web"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567650    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy-metric"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567656    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="alertmanager"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567661    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="config-reloader"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567666    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="kube-rbac-proxy"
Sep 19 09:13:29.567782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.567670    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" containerName="prom-label-proxy"
Sep 19 09:13:29.572523 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.572504    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.578959 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.578937    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 19 09:13:29.579050 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.578999    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 19 09:13:29.579264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.579248    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 19 09:13:29.579883 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.579863    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 19 09:13:29.579967 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.579932    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 19 09:13:29.579967 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.579944    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 19 09:13:29.580107 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.579948    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 19 09:13:29.580107 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.579950    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 19 09:13:29.594318 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.594299    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 19 09:13:29.595345 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.595333    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h6dch\""
Sep 19 09:13:29.634958 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.634931    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 09:13:29.673706 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.673671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.673867 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.673733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-config-volume\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.673867 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.673757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.673867 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.673774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.673867 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.673814    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83276d17-df85-475b-b372-1d1c3a51ae98-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.673867 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.673839    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.673867 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.673869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83276d17-df85-475b-b372-1d1c3a51ae98-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.674139 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.673888    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83276d17-df85-475b-b372-1d1c3a51ae98-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.674139 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.673941    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83276d17-df85-475b-b372-1d1c3a51ae98-config-out\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.674139 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.673984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49qk\" (UniqueName: \"kubernetes.io/projected/83276d17-df85-475b-b372-1d1c3a51ae98-kube-api-access-k49qk\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.674139 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.674029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-web-config\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.674139 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.674053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83276d17-df85-475b-b372-1d1c3a51ae98-tls-assets\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.674139 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.674090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774420 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-web-config\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774420 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83276d17-df85-475b-b372-1d1c3a51ae98-tls-assets\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774626 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774626 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774626 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-config-volume\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774626 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774626 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83276d17-df85-475b-b372-1d1c3a51ae98-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83276d17-df85-475b-b372-1d1c3a51ae98-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83276d17-df85-475b-b372-1d1c3a51ae98-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83276d17-df85-475b-b372-1d1c3a51ae98-config-out\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.774843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.774840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49qk\" (UniqueName: \"kubernetes.io/projected/83276d17-df85-475b-b372-1d1c3a51ae98-kube-api-access-k49qk\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.775557 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.775531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83276d17-df85-475b-b372-1d1c3a51ae98-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.776199 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.776168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83276d17-df85-475b-b372-1d1c3a51ae98-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.776661 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.776639    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83276d17-df85-475b-b372-1d1c3a51ae98-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.777664 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.777642    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.778103 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.777765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.778103 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.777979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-web-config\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.778252 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.778127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83276d17-df85-475b-b372-1d1c3a51ae98-tls-assets\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.778252 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.778175    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.779034 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.778994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.779445 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.779415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-config-volume\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.779525 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.779464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83276d17-df85-475b-b372-1d1c3a51ae98-config-out\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.779630 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.779606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83276d17-df85-475b-b372-1d1c3a51ae98-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.787667 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.787642    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49qk\" (UniqueName: \"kubernetes.io/projected/83276d17-df85-475b-b372-1d1c3a51ae98-kube-api-access-k49qk\") pod \"alertmanager-main-0\" (UID: \"83276d17-df85-475b-b372-1d1c3a51ae98\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:29.881530 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:29.881444    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 09:13:30.209470 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:30.209387    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 09:13:30.214965 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:13:30.214940    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83276d17_df85_475b_b372_1d1c3a51ae98.slice/crio-0b0134008e25f3683b1a60522b6731a9ad1075cb241dd46d60b4a6ef490b78ac WatchSource:0}: Error finding container 0b0134008e25f3683b1a60522b6731a9ad1075cb241dd46d60b4a6ef490b78ac: Status 404 returned error can't find the container with id 0b0134008e25f3683b1a60522b6731a9ad1075cb241dd46d60b4a6ef490b78ac
Sep 19 09:13:30.428396 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:30.428352    2579 generic.go:356] "Generic (PLEG): container finished" podID="83276d17-df85-475b-b372-1d1c3a51ae98" containerID="eb512608d60268bef7d73809f3ee24d4efc3ed2218bed0003e5f55fba326afec" exitCode=0
Sep 19 09:13:30.428759 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:30.428424    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83276d17-df85-475b-b372-1d1c3a51ae98","Type":"ContainerDied","Data":"eb512608d60268bef7d73809f3ee24d4efc3ed2218bed0003e5f55fba326afec"}
Sep 19 09:13:30.428759 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:30.428485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83276d17-df85-475b-b372-1d1c3a51ae98","Type":"ContainerStarted","Data":"0b0134008e25f3683b1a60522b6731a9ad1075cb241dd46d60b4a6ef490b78ac"}
Sep 19 09:13:30.902828 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:30.902791    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4974b9e0-8dc0-4dba-8270-2b0aff40a8f9" path="/var/lib/kubelet/pods/4974b9e0-8dc0-4dba-8270-2b0aff40a8f9/volumes"
Sep 19 09:13:31.435541 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:31.435509    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83276d17-df85-475b-b372-1d1c3a51ae98","Type":"ContainerStarted","Data":"1c568000821d29b63db9fc70342e0ab620e280144ec13c8480da15c1c237033c"}
Sep 19 09:13:31.435909 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:31.435577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83276d17-df85-475b-b372-1d1c3a51ae98","Type":"ContainerStarted","Data":"b81c2d75702870fa2ce0de0de5692ab167195a8706d2c5240bec1298e28ca5e5"}
Sep 19 09:13:31.435909 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:31.435605    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83276d17-df85-475b-b372-1d1c3a51ae98","Type":"ContainerStarted","Data":"35bfdaeba6feb804f591b6bf1370cc399d2b7399cc9bbbb947accdd844384d59"}
Sep 19 09:13:31.435909 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:31.435632    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83276d17-df85-475b-b372-1d1c3a51ae98","Type":"ContainerStarted","Data":"a450ca81baa334e94124e0e63b42f45c3850b5a92d03d90fd398dc8d2c4cd0b5"}
Sep 19 09:13:31.435909 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:31.435664    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83276d17-df85-475b-b372-1d1c3a51ae98","Type":"ContainerStarted","Data":"a56d558067da51e1015ffb9af6d1af7dafeb936b45f9485850d2c880ecf9f02d"}
Sep 19 09:13:31.435909 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:31.435687    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83276d17-df85-475b-b372-1d1c3a51ae98","Type":"ContainerStarted","Data":"d903fe85e56699abaf3d67288700c81c0860eca825e7ef82af5052fa7d7342cf"}
Sep 19 09:13:31.482526 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:31.482468    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.468195099 podStartE2EDuration="2.482447719s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.25262ms" isStatefulPod=false podCreationTimestamp="2026-09-19 09:13:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:13:31.481422424 +0000 UTC m=+394.648617654" watchObservedRunningTime="2026-09-19 09:13:31.482447719 +0000 UTC m=+394.649643240"
Sep 19 09:13:32.311760 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.311726    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"]
Sep 19 09:13:32.315428 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.315407    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.320420 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.320402    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 19 09:13:32.320694 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.320676    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 19 09:13:32.320769 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.320724    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 19 09:13:32.320769 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.320743    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 19 09:13:32.320874 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.320686    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ttnlk\""
Sep 19 09:13:32.321198 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.321169    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 19 09:13:32.325678 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.325662    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 19 09:13:32.340374 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.340352    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"]
Sep 19 09:13:32.395561 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.395532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d820479e-9130-48e5-affd-1bbaf87efc72-serving-certs-ca-bundle\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.395698 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.395568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d820479e-9130-48e5-affd-1bbaf87efc72-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.395698 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.395593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d820479e-9130-48e5-affd-1bbaf87efc72-metrics-client-ca\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.395698 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.395643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.395698 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.395688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sk2j\" (UniqueName: \"kubernetes.io/projected/d820479e-9130-48e5-affd-1bbaf87efc72-kube-api-access-7sk2j\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.395811 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.395709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-federate-client-tls\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.395811 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.395725    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-telemeter-client-tls\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.395811 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.395775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-secret-telemeter-client\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.496524 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.496480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d820479e-9130-48e5-affd-1bbaf87efc72-metrics-client-ca\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.496524 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.496525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.497002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.496560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sk2j\" (UniqueName: \"kubernetes.io/projected/d820479e-9130-48e5-affd-1bbaf87efc72-kube-api-access-7sk2j\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.497002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.496595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-federate-client-tls\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.497002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.496620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-telemeter-client-tls\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.497002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.496676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-secret-telemeter-client\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.497002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.496787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d820479e-9130-48e5-affd-1bbaf87efc72-serving-certs-ca-bundle\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.497002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.496861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d820479e-9130-48e5-affd-1bbaf87efc72-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.497391 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.497338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d820479e-9130-48e5-affd-1bbaf87efc72-metrics-client-ca\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.497614 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.497592    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d820479e-9130-48e5-affd-1bbaf87efc72-serving-certs-ca-bundle\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.497887 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.497865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d820479e-9130-48e5-affd-1bbaf87efc72-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.499379 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.499360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-federate-client-tls\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.499483 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.499447    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-telemeter-client-tls\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.499483 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.499476    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.499578 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.499513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d820479e-9130-48e5-affd-1bbaf87efc72-secret-telemeter-client\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.506060 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.506037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sk2j\" (UniqueName: \"kubernetes.io/projected/d820479e-9130-48e5-affd-1bbaf87efc72-kube-api-access-7sk2j\") pod \"telemeter-client-6b76778c4c-kvg7f\" (UID: \"d820479e-9130-48e5-affd-1bbaf87efc72\") " pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.625561 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.625475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"
Sep 19 09:13:32.929926 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.929842    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b76778c4c-kvg7f"]
Sep 19 09:13:32.932506 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:13:32.932483    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd820479e_9130_48e5_affd_1bbaf87efc72.slice/crio-1f0a22ab29868dc61f9e10538388fc8ff5766bb4cc872a28a38019e2ba596779 WatchSource:0}: Error finding container 1f0a22ab29868dc61f9e10538388fc8ff5766bb4cc872a28a38019e2ba596779: Status 404 returned error can't find the container with id 1f0a22ab29868dc61f9e10538388fc8ff5766bb4cc872a28a38019e2ba596779
Sep 19 09:13:32.934493 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:32.934479    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 09:13:33.445809 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.445778    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f" event={"ID":"d820479e-9130-48e5-affd-1bbaf87efc72","Type":"ContainerStarted","Data":"1f0a22ab29868dc61f9e10538388fc8ff5766bb4cc872a28a38019e2ba596779"}
Sep 19 09:13:33.948451 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.948404    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 09:13:33.953333 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.953303    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:33.957798 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.957776    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 19 09:13:33.958301 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.958280    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 19 09:13:33.959474 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.958570    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 19 09:13:33.959474 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.958754    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 19 09:13:33.959474 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.958889    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 19 09:13:33.959474 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.959079    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 19 09:13:33.959474 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.959271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9vtgt\""
Sep 19 09:13:33.959474 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.959466    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 19 09:13:33.959820 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.959477    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 19 09:13:33.959820 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.959569    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8pcqagitnd96n\""
Sep 19 09:13:33.959820 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.959699    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 19 09:13:33.960196 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.959983    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 19 09:13:33.960196 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.959997    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 19 09:13:33.966294 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.966251    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 19 09:13:33.966667 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.966505    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 19 09:13:33.970426 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.970259    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 19 09:13:33.987179 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:33.985917    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 09:13:34.111456 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111421    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.111456 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.111709 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.111709 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.111709 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvzqg\" (UniqueName: \"kubernetes.io/projected/e3d6c650-04b5-4457-a5f2-b61efed94647-kube-api-access-bvzqg\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.111709 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111610    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.111709 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.111709 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.111709 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111687    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.111709 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3d6c650-04b5-4457-a5f2-b61efed94647-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.112132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.112132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.112132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.112132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-config\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.112132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3d6c650-04b5-4457-a5f2-b61efed94647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.112132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.111956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.112132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.112042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.112132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.112094    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.112132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.112125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.112545 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.112169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvzqg\" (UniqueName: \"kubernetes.io/projected/e3d6c650-04b5-4457-a5f2-b61efed94647-kube-api-access-bvzqg\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3d6c650-04b5-4457-a5f2-b61efed94647-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-config\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213696    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3d6c650-04b5-4457-a5f2-b61efed94647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.215166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.216106 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.216106 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.216106 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.213805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.216106 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.215080    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.216106 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.215127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.216106 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.215222    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.216106 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.215631    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.216106 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.215996    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.216657 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.216621    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.217471 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.217144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.218536 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.218009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-config\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.218760 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.218655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.218760 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.218669    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.219601 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.219259    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3d6c650-04b5-4457-a5f2-b61efed94647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.219601 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.219533    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.222050 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.219822    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.222050 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.220047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3d6c650-04b5-4457-a5f2-b61efed94647-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.222050 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.221509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.222050 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.221804    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3d6c650-04b5-4457-a5f2-b61efed94647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.222284 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.222263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.222482 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.222462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.223674 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.223654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3d6c650-04b5-4457-a5f2-b61efed94647-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.226539 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.226519    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvzqg\" (UniqueName: \"kubernetes.io/projected/e3d6c650-04b5-4457-a5f2-b61efed94647-kube-api-access-bvzqg\") pod \"prometheus-k8s-0\" (UID: \"e3d6c650-04b5-4457-a5f2-b61efed94647\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.267868 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.267823    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:34.962640 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:34.962563    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 09:13:34.965615 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:13:34.965591    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d6c650_04b5_4457_a5f2_b61efed94647.slice/crio-cc78f62e2211590b557dc63034362101414059a9838abbc30102d0eb3cf3a0bd WatchSource:0}: Error finding container cc78f62e2211590b557dc63034362101414059a9838abbc30102d0eb3cf3a0bd: Status 404 returned error can't find the container with id cc78f62e2211590b557dc63034362101414059a9838abbc30102d0eb3cf3a0bd
Sep 19 09:13:35.455693 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:35.455661    2579 generic.go:356] "Generic (PLEG): container finished" podID="e3d6c650-04b5-4457-a5f2-b61efed94647" containerID="c11922d9fb4137bdb84f504fb53a775f8fb07fb1a005c15710481adf080e490d" exitCode=0
Sep 19 09:13:35.455871 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:35.455746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3d6c650-04b5-4457-a5f2-b61efed94647","Type":"ContainerDied","Data":"c11922d9fb4137bdb84f504fb53a775f8fb07fb1a005c15710481adf080e490d"}
Sep 19 09:13:35.455871 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:35.455816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3d6c650-04b5-4457-a5f2-b61efed94647","Type":"ContainerStarted","Data":"cc78f62e2211590b557dc63034362101414059a9838abbc30102d0eb3cf3a0bd"}
Sep 19 09:13:35.457900 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:35.457878    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f" event={"ID":"d820479e-9130-48e5-affd-1bbaf87efc72","Type":"ContainerStarted","Data":"cdc5e0322cef08d868419c9546325c5c8e3e4477ae67e6db93ff47f41354dd5d"}
Sep 19 09:13:35.457971 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:35.457929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f" event={"ID":"d820479e-9130-48e5-affd-1bbaf87efc72","Type":"ContainerStarted","Data":"558a3e9b839245854bc06de5d362d02c524fa9c7fce5a5540374254194c647b0"}
Sep 19 09:13:35.457971 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:35.457955    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f" event={"ID":"d820479e-9130-48e5-affd-1bbaf87efc72","Type":"ContainerStarted","Data":"fc64dffcb0ed083e63fa362655c900a6524120d83cf4276d640f18cb02bc4942"}
Sep 19 09:13:35.526092 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:35.526039    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6b76778c4c-kvg7f" podStartSLOduration=1.7288600010000001 podStartE2EDuration="3.526007388s" totalImagesPullingTime="1.797147387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:13:35.524293335 +0000 UTC m=+398.691488564" watchObservedRunningTime="2026-09-19 09:13:35.526007388 +0000 UTC m=+398.693202617"
Sep 19 09:13:39.479878 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:39.479841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3d6c650-04b5-4457-a5f2-b61efed94647","Type":"ContainerStarted","Data":"022eb7c0b015f9bba05c0ec20c5808816855f6de25d8711b2ba0111b3e59a47f"}
Sep 19 09:13:39.480370 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:39.479918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3d6c650-04b5-4457-a5f2-b61efed94647","Type":"ContainerStarted","Data":"318aa078293507491cea4df112a461209e061be44d82a5265ea911c276e6504b"}
Sep 19 09:13:39.480370 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:39.479958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3d6c650-04b5-4457-a5f2-b61efed94647","Type":"ContainerStarted","Data":"dd9ec47019fc2ca3c64524966803740b1c774520d69604e5fdbe805203c46842"}
Sep 19 09:13:39.480370 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:39.480003    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3d6c650-04b5-4457-a5f2-b61efed94647","Type":"ContainerStarted","Data":"f3faf473b775df2810a4789e01e14c7f32be2e5bfc01d04b4b5693dab42033d2"}
Sep 19 09:13:39.480370 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:39.480064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3d6c650-04b5-4457-a5f2-b61efed94647","Type":"ContainerStarted","Data":"0d182f3f37cf9fc6aef6778b81f86a5c32e4a340a811d6b631d844d3c1c2748f"}
Sep 19 09:13:39.480370 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:39.480106    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3d6c650-04b5-4457-a5f2-b61efed94647","Type":"ContainerStarted","Data":"15c7657a4b189320c9429d92bdeebc0548e8e6124165bbc55fc30094a113e380"}
Sep 19 09:13:39.512945 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:39.512894    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.204565766 podStartE2EDuration="6.512876466s" totalImagesPullingTime="3.290062254s" totalInitContainerRuntime="18.248446ms" isStatefulPod=false podCreationTimestamp="2026-09-19 09:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:13:39.511217741 +0000 UTC m=+402.678412989" watchObservedRunningTime="2026-09-19 09:13:39.512876466 +0000 UTC m=+402.680071695"
Sep 19 09:13:44.268957 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:44.268921    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:13:46.345763 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:13:46.345728    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f867489bc-8wz2w"]
Sep 19 09:14:11.365411 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.365317    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f867489bc-8wz2w" podUID="f758745c-8f3d-4f82-a783-622808054661" containerName="console" containerID="cri-o://6f729f10c16d453a006b7e60810935eaa150b71ab638187cf7a0d38432ed0f00" gracePeriod=15
Sep 19 09:14:11.611456 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.611423    2579 generic.go:356] "Generic (PLEG): container finished" podID="f758745c-8f3d-4f82-a783-622808054661" containerID="6f729f10c16d453a006b7e60810935eaa150b71ab638187cf7a0d38432ed0f00" exitCode=0
Sep 19 09:14:11.611583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.611463    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f867489bc-8wz2w" event={"ID":"f758745c-8f3d-4f82-a783-622808054661","Type":"ContainerDied","Data":"6f729f10c16d453a006b7e60810935eaa150b71ab638187cf7a0d38432ed0f00"}
Sep 19 09:14:11.611583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.611527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f867489bc-8wz2w" event={"ID":"f758745c-8f3d-4f82-a783-622808054661","Type":"ContainerDied","Data":"e0d69fed0a0eb0d565b15515c47c30fcc9190776fd10ba7d95f642f276b188b3"}
Sep 19 09:14:11.611583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.611542    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0d69fed0a0eb0d565b15515c47c30fcc9190776fd10ba7d95f642f276b188b3"
Sep 19 09:14:11.614483 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.614468    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:14:11.728700 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.728600    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-service-ca\") pod \"f758745c-8f3d-4f82-a783-622808054661\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") "
Sep 19 09:14:11.728700 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.728665    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-oauth-serving-cert\") pod \"f758745c-8f3d-4f82-a783-622808054661\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") "
Sep 19 09:14:11.728700 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.728685    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-console-config\") pod \"f758745c-8f3d-4f82-a783-622808054661\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") "
Sep 19 09:14:11.728700 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.728700    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-trusted-ca-bundle\") pod \"f758745c-8f3d-4f82-a783-622808054661\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") "
Sep 19 09:14:11.729011 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.728729    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h94fm\" (UniqueName: \"kubernetes.io/projected/f758745c-8f3d-4f82-a783-622808054661-kube-api-access-h94fm\") pod \"f758745c-8f3d-4f82-a783-622808054661\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") "
Sep 19 09:14:11.729011 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.728750    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-oauth-config\") pod \"f758745c-8f3d-4f82-a783-622808054661\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") "
Sep 19 09:14:11.729011 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.728872    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-serving-cert\") pod \"f758745c-8f3d-4f82-a783-622808054661\" (UID: \"f758745c-8f3d-4f82-a783-622808054661\") "
Sep 19 09:14:11.729184 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.729088    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-service-ca" (OuterVolumeSpecName: "service-ca") pod "f758745c-8f3d-4f82-a783-622808054661" (UID: "f758745c-8f3d-4f82-a783-622808054661"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:14:11.729235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.729187    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:14:11.729290 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.729223    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-console-config" (OuterVolumeSpecName: "console-config") pod "f758745c-8f3d-4f82-a783-622808054661" (UID: "f758745c-8f3d-4f82-a783-622808054661"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:14:11.729290 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.729232    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f758745c-8f3d-4f82-a783-622808054661" (UID: "f758745c-8f3d-4f82-a783-622808054661"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:14:11.729290 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.729229    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f758745c-8f3d-4f82-a783-622808054661" (UID: "f758745c-8f3d-4f82-a783-622808054661"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:14:11.731292 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.731267    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f758745c-8f3d-4f82-a783-622808054661" (UID: "f758745c-8f3d-4f82-a783-622808054661"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 09:14:11.731387 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.731301    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f758745c-8f3d-4f82-a783-622808054661-kube-api-access-h94fm" (OuterVolumeSpecName: "kube-api-access-h94fm") pod "f758745c-8f3d-4f82-a783-622808054661" (UID: "f758745c-8f3d-4f82-a783-622808054661"). InnerVolumeSpecName "kube-api-access-h94fm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:14:11.731387 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.731323    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f758745c-8f3d-4f82-a783-622808054661" (UID: "f758745c-8f3d-4f82-a783-622808054661"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 09:14:11.829786 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.829743    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-console-config\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:14:11.829786 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.829782    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-trusted-ca-bundle\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:14:11.829786 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.829792    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h94fm\" (UniqueName: \"kubernetes.io/projected/f758745c-8f3d-4f82-a783-622808054661-kube-api-access-h94fm\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:14:11.829786 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.829801    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-oauth-config\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:14:11.830077 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.829809    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f758745c-8f3d-4f82-a783-622808054661-console-serving-cert\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:14:11.830077 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:11.829817    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f758745c-8f3d-4f82-a783-622808054661-oauth-serving-cert\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:14:12.615237 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:12.615207    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f867489bc-8wz2w"
Sep 19 09:14:12.638644 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:12.638615    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f867489bc-8wz2w"]
Sep 19 09:14:12.639878 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:12.639858    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f867489bc-8wz2w"]
Sep 19 09:14:12.902652 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:12.902576    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f758745c-8f3d-4f82-a783-622808054661" path="/var/lib/kubelet/pods/f758745c-8f3d-4f82-a783-622808054661/volumes"
Sep 19 09:14:34.268277 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:34.268244    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:14:34.287009 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:34.286983    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:14:34.715157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:34.715129    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 09:14:58.839902 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:14:58.839873    2579 scope.go:117] "RemoveContainer" containerID="6f729f10c16d453a006b7e60810935eaa150b71ab638187cf7a0d38432ed0f00"
Sep 19 09:16:58.840523 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:16:58.840486    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:16:58.848087 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:16:58.848065    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:17:38.080915 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.080880    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xhjvh"]
Sep 19 09:17:38.081392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.081221    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f758745c-8f3d-4f82-a783-622808054661" containerName="console"
Sep 19 09:17:38.081392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.081231    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f758745c-8f3d-4f82-a783-622808054661" containerName="console"
Sep 19 09:17:38.081392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.081296    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f758745c-8f3d-4f82-a783-622808054661" containerName="console"
Sep 19 09:17:38.084316 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.084297    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh"
Sep 19 09:17:38.086837 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.086814    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2l82q\""
Sep 19 09:17:38.086949 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.086814    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 19 09:17:38.087543 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.087517    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 19 09:17:38.096495 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.096469    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xhjvh"]
Sep 19 09:17:38.115073 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.115047    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r78qd\" (UniqueName: \"kubernetes.io/projected/3845dc9e-bc5b-4a6b-8aae-83679b2f14aa-kube-api-access-r78qd\") pod \"cert-manager-webhook-6486ffd997-xhjvh\" (UID: \"3845dc9e-bc5b-4a6b-8aae-83679b2f14aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh"
Sep 19 09:17:38.115183 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.115090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3845dc9e-bc5b-4a6b-8aae-83679b2f14aa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xhjvh\" (UID: \"3845dc9e-bc5b-4a6b-8aae-83679b2f14aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh"
Sep 19 09:17:38.216133 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.216100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78qd\" (UniqueName: \"kubernetes.io/projected/3845dc9e-bc5b-4a6b-8aae-83679b2f14aa-kube-api-access-r78qd\") pod \"cert-manager-webhook-6486ffd997-xhjvh\" (UID: \"3845dc9e-bc5b-4a6b-8aae-83679b2f14aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh"
Sep 19 09:17:38.216307 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.216156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3845dc9e-bc5b-4a6b-8aae-83679b2f14aa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xhjvh\" (UID: \"3845dc9e-bc5b-4a6b-8aae-83679b2f14aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh"
Sep 19 09:17:38.226857 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.226825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3845dc9e-bc5b-4a6b-8aae-83679b2f14aa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xhjvh\" (UID: \"3845dc9e-bc5b-4a6b-8aae-83679b2f14aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh"
Sep 19 09:17:38.226981 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.226966    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r78qd\" (UniqueName: \"kubernetes.io/projected/3845dc9e-bc5b-4a6b-8aae-83679b2f14aa-kube-api-access-r78qd\") pod \"cert-manager-webhook-6486ffd997-xhjvh\" (UID: \"3845dc9e-bc5b-4a6b-8aae-83679b2f14aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh"
Sep 19 09:17:38.398292 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.398195    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh"
Sep 19 09:17:38.669313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:38.669223    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xhjvh"]
Sep 19 09:17:38.671880 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:17:38.671856    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3845dc9e_bc5b_4a6b_8aae_83679b2f14aa.slice/crio-ca0b06fcb52817733bf14648909d47e88e5a68f8b2aa2233a858c3cf716cb73e WatchSource:0}: Error finding container ca0b06fcb52817733bf14648909d47e88e5a68f8b2aa2233a858c3cf716cb73e: Status 404 returned error can't find the container with id ca0b06fcb52817733bf14648909d47e88e5a68f8b2aa2233a858c3cf716cb73e
Sep 19 09:17:39.414158 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.414123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh" event={"ID":"3845dc9e-bc5b-4a6b-8aae-83679b2f14aa","Type":"ContainerStarted","Data":"ca0b06fcb52817733bf14648909d47e88e5a68f8b2aa2233a858c3cf716cb73e"}
Sep 19 09:17:39.467712 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.467679    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5"]
Sep 19 09:17:39.471991 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.471973    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5"
Sep 19 09:17:39.474149 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.474132    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6d6v7\""
Sep 19 09:17:39.481968 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.481940    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5"]
Sep 19 09:17:39.526428 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.526395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmtjn\" (UniqueName: \"kubernetes.io/projected/c4c584d3-0408-420f-b191-cb4adb9c7b50-kube-api-access-pmtjn\") pod \"cert-manager-cainjector-559cdd8c87-8k2b5\" (UID: \"c4c584d3-0408-420f-b191-cb4adb9c7b50\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5"
Sep 19 09:17:39.526583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.526529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4c584d3-0408-420f-b191-cb4adb9c7b50-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8k2b5\" (UID: \"c4c584d3-0408-420f-b191-cb4adb9c7b50\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5"
Sep 19 09:17:39.627806 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.627765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4c584d3-0408-420f-b191-cb4adb9c7b50-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8k2b5\" (UID: \"c4c584d3-0408-420f-b191-cb4adb9c7b50\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5"
Sep 19 09:17:39.627992 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.627828    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmtjn\" (UniqueName: \"kubernetes.io/projected/c4c584d3-0408-420f-b191-cb4adb9c7b50-kube-api-access-pmtjn\") pod \"cert-manager-cainjector-559cdd8c87-8k2b5\" (UID: \"c4c584d3-0408-420f-b191-cb4adb9c7b50\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5"
Sep 19 09:17:39.636626 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.636592    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmtjn\" (UniqueName: \"kubernetes.io/projected/c4c584d3-0408-420f-b191-cb4adb9c7b50-kube-api-access-pmtjn\") pod \"cert-manager-cainjector-559cdd8c87-8k2b5\" (UID: \"c4c584d3-0408-420f-b191-cb4adb9c7b50\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5"
Sep 19 09:17:39.637874 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.637852    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4c584d3-0408-420f-b191-cb4adb9c7b50-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8k2b5\" (UID: \"c4c584d3-0408-420f-b191-cb4adb9c7b50\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5"
Sep 19 09:17:39.781353 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:39.781272    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5"
Sep 19 09:17:40.089866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:40.087513    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5"]
Sep 19 09:17:40.092808 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:17:40.092772    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4c584d3_0408_420f_b191_cb4adb9c7b50.slice/crio-37b59368cef298d1a6fb2925729419ad9e6a93ec6e1ad88b5dd53a433a4ba1a1 WatchSource:0}: Error finding container 37b59368cef298d1a6fb2925729419ad9e6a93ec6e1ad88b5dd53a433a4ba1a1: Status 404 returned error can't find the container with id 37b59368cef298d1a6fb2925729419ad9e6a93ec6e1ad88b5dd53a433a4ba1a1
Sep 19 09:17:40.419992 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:40.419905    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5" event={"ID":"c4c584d3-0408-420f-b191-cb4adb9c7b50","Type":"ContainerStarted","Data":"37b59368cef298d1a6fb2925729419ad9e6a93ec6e1ad88b5dd53a433a4ba1a1"}
Sep 19 09:17:42.429782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:42.429743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh" event={"ID":"3845dc9e-bc5b-4a6b-8aae-83679b2f14aa","Type":"ContainerStarted","Data":"e7be0ea89b8fb4caad4325f486ea7f014b77694fc5c207c1dd968fecb2f07d40"}
Sep 19 09:17:42.430233 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:42.429881    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh"
Sep 19 09:17:42.431206 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:42.431184    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5" event={"ID":"c4c584d3-0408-420f-b191-cb4adb9c7b50","Type":"ContainerStarted","Data":"e66e39cfe33d1d46832ff2719df923189719672fbbd4295f54d2041e2f357745"}
Sep 19 09:17:42.446164 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:42.446123    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh" podStartSLOduration=1.225853801 podStartE2EDuration="4.446110317s" totalImagesPullingTime="3.220256516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:17:42.445326084 +0000 UTC m=+645.612521312" watchObservedRunningTime="2026-09-19 09:17:42.446110317 +0000 UTC m=+645.613305546"
Sep 19 09:17:42.461218 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:42.461178    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k2b5" podStartSLOduration=1.662403681 podStartE2EDuration="3.461164957s" totalImagesPullingTime="1.798761276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:17:42.459575478 +0000 UTC m=+645.626770722" watchObservedRunningTime="2026-09-19 09:17:42.461164957 +0000 UTC m=+645.628360186"
Sep 19 09:17:48.437618 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:17:48.437586    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xhjvh"
Sep 19 09:18:21.413807 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.413765    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"]
Sep 19 09:18:21.417361 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.417341    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.422290 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:21.422258    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret"
Sep 19 09:18:21.422398 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:21.422272    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-7pvgm\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7pvgm\"" type="*v1.Secret"
Sep 19 09:18:21.422596 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:21.422567    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" podUID="e357301b-2daf-48e0-b590-e4bb49b273dd" pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.422903 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:21.422880    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 19 09:18:21.422984 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:21.422900    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret"
Sep 19 09:18:21.422984 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:21.422943    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-190.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 19 09:18:21.440433 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.440394    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"]
Sep 19 09:18:21.491071 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.491042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e357301b-2daf-48e0-b590-e4bb49b273dd-manifests\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.491071 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.491073    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e357301b-2daf-48e0-b590-e4bb49b273dd-webhook-cert\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.491263 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.491093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e357301b-2daf-48e0-b590-e4bb49b273dd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.491263 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.491121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e357301b-2daf-48e0-b590-e4bb49b273dd-tmp\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.491263 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.491151    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jcx4\" (UniqueName: \"kubernetes.io/projected/e357301b-2daf-48e0-b590-e4bb49b273dd-kube-api-access-5jcx4\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.592045 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.591996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e357301b-2daf-48e0-b590-e4bb49b273dd-manifests\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.592045 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.592047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e357301b-2daf-48e0-b590-e4bb49b273dd-webhook-cert\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.592299 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.592071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e357301b-2daf-48e0-b590-e4bb49b273dd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.592299 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.592100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e357301b-2daf-48e0-b590-e4bb49b273dd-tmp\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.592299 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.592149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jcx4\" (UniqueName: \"kubernetes.io/projected/e357301b-2daf-48e0-b590-e4bb49b273dd-kube-api-access-5jcx4\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.592506 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.592412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e357301b-2daf-48e0-b590-e4bb49b273dd-manifests\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:21.594338 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:21.594319    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e357301b-2daf-48e0-b590-e4bb49b273dd-tmp\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:22.380189 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:22.380159    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 19 09:18:22.385488 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:22.385460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e357301b-2daf-48e0-b590-e4bb49b273dd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:22.385704 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:22.385509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e357301b-2daf-48e0-b590-e4bb49b273dd-webhook-cert\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:22.392487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:22.392460    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 19 09:18:22.517255 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:22.517219    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7pvgm\""
Sep 19 09:18:22.614431 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:22.614399    2579 projected.go:291] Couldn't get configMap opendatahub/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 19 09:18:22.614431 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:22.614437    2579 projected.go:196] Error preparing data for projected volume kube-api-access-5jcx4 for pod opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5: failed to sync configmap cache: timed out waiting for the condition
Sep 19 09:18:22.614626 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:22.614501    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e357301b-2daf-48e0-b590-e4bb49b273dd-kube-api-access-5jcx4 podName:e357301b-2daf-48e0-b590-e4bb49b273dd nodeName:}" failed. No retries permitted until 2026-09-19 09:18:23.11448652 +0000 UTC m=+686.281681728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5jcx4" (UniqueName: "kubernetes.io/projected/e357301b-2daf-48e0-b590-e4bb49b273dd-kube-api-access-5jcx4") pod "opendatahub-operator-controller-manager-56479975c9-8zfz5" (UID: "e357301b-2daf-48e0-b590-e4bb49b273dd") : failed to sync configmap cache: timed out waiting for the condition
Sep 19 09:18:22.685575 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:22.685508    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 19 09:18:23.012897 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:23.012816    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 19 09:18:23.203258 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:23.203224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jcx4\" (UniqueName: \"kubernetes.io/projected/e357301b-2daf-48e0-b590-e4bb49b273dd-kube-api-access-5jcx4\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:23.205739 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:23.205709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jcx4\" (UniqueName: \"kubernetes.io/projected/e357301b-2daf-48e0-b590-e4bb49b273dd-kube-api-access-5jcx4\") pod \"opendatahub-operator-controller-manager-56479975c9-8zfz5\" (UID: \"e357301b-2daf-48e0-b590-e4bb49b273dd\") " pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:23.227694 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:23.227669    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:23.502667 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:23.502640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"]
Sep 19 09:18:23.504992 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:18:23.504956    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode357301b_2daf_48e0_b590_e4bb49b273dd.slice/crio-0ed89c59016f42e8a9fe787b522e6b06f7a9228d3f4b9e4207bbd288385c5dcd WatchSource:0}: Error finding container 0ed89c59016f42e8a9fe787b522e6b06f7a9228d3f4b9e4207bbd288385c5dcd: Status 404 returned error can't find the container with id 0ed89c59016f42e8a9fe787b522e6b06f7a9228d3f4b9e4207bbd288385c5dcd
Sep 19 09:18:23.600961 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:23.600930    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5" event={"ID":"e357301b-2daf-48e0-b590-e4bb49b273dd","Type":"ContainerStarted","Data":"0ed89c59016f42e8a9fe787b522e6b06f7a9228d3f4b9e4207bbd288385c5dcd"}
Sep 19 09:18:26.617046 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:26.616990    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5" event={"ID":"e357301b-2daf-48e0-b590-e4bb49b273dd","Type":"ContainerStarted","Data":"df6b4b811025da70904f1ca99f150c025771efdeeca8029fc85b3fd754840235"}
Sep 19 09:18:27.622839 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:27.622750    2579 generic.go:356] "Generic (PLEG): container finished" podID="e357301b-2daf-48e0-b590-e4bb49b273dd" containerID="df6b4b811025da70904f1ca99f150c025771efdeeca8029fc85b3fd754840235" exitCode=0
Sep 19 09:18:27.623260 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:27.622837    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5" event={"ID":"e357301b-2daf-48e0-b590-e4bb49b273dd","Type":"ContainerDied","Data":"df6b4b811025da70904f1ca99f150c025771efdeeca8029fc85b3fd754840235"}
Sep 19 09:18:28.629178 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:28.629143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5" event={"ID":"e357301b-2daf-48e0-b590-e4bb49b273dd","Type":"ContainerStarted","Data":"ed3b5c667574a8197da319bc5683888b445b2fc582c711b48cc59a2a1792dac8"}
Sep 19 09:18:28.629542 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:28.629280    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:28.652565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:28.652522    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5" podStartSLOduration=3.433316705 podStartE2EDuration="7.652507716s" totalImagesPullingTime="3.159546902s" totalInitContainerRuntime="1.059644109s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:18:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:18:28.650756135 +0000 UTC m=+691.817951365" watchObservedRunningTime="2026-09-19 09:18:28.652507716 +0000 UTC m=+691.819702945"
Sep 19 09:18:39.636280 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:39.636249    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56479975c9-8zfz5"
Sep 19 09:18:41.670288 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.670249    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"]
Sep 19 09:18:41.683650 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.683624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.686507 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.686479    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bx8tv\""
Sep 19 09:18:41.686649 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.686532    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 19 09:18:41.686742 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.686715    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 19 09:18:41.686829 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.686808    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 19 09:18:41.686897 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.686843    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 19 09:18:41.686897 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.686808    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 19 09:18:41.696365 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.696341    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"]
Sep 19 09:18:41.766603 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.766567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c804249-d91c-43d8-bc2f-633afcf6c020-cert\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.766749 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.766619    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c804249-d91c-43d8-bc2f-633afcf6c020-metrics-cert\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.766749 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.766700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c804249-d91c-43d8-bc2f-633afcf6c020-manager-config\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.766749 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.766728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx6pz\" (UniqueName: \"kubernetes.io/projected/6c804249-d91c-43d8-bc2f-633afcf6c020-kube-api-access-bx6pz\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.867873 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.867832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c804249-d91c-43d8-bc2f-633afcf6c020-cert\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.868049 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.867889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c804249-d91c-43d8-bc2f-633afcf6c020-metrics-cert\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.868049 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.867935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c804249-d91c-43d8-bc2f-633afcf6c020-manager-config\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.868049 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.867958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx6pz\" (UniqueName: \"kubernetes.io/projected/6c804249-d91c-43d8-bc2f-633afcf6c020-kube-api-access-bx6pz\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.868650 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.868626    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c804249-d91c-43d8-bc2f-633afcf6c020-manager-config\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.870411 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.870386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c804249-d91c-43d8-bc2f-633afcf6c020-metrics-cert\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.870495 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.870433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c804249-d91c-43d8-bc2f-633afcf6c020-cert\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.883514 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.883488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx6pz\" (UniqueName: \"kubernetes.io/projected/6c804249-d91c-43d8-bc2f-633afcf6c020-kube-api-access-bx6pz\") pod \"lws-controller-manager-9b48b7f58-kgbvq\" (UID: \"6c804249-d91c-43d8-bc2f-633afcf6c020\") " pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:41.993627 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:41.993547    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:42.280221 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:42.280198    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"]
Sep 19 09:18:42.281972 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:18:42.281940    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c804249_d91c_43d8_bc2f_633afcf6c020.slice/crio-9c35e5d3ee08a9855f335091fbca9e14f808834f08461ec4586262062e419053 WatchSource:0}: Error finding container 9c35e5d3ee08a9855f335091fbca9e14f808834f08461ec4586262062e419053: Status 404 returned error can't find the container with id 9c35e5d3ee08a9855f335091fbca9e14f808834f08461ec4586262062e419053
Sep 19 09:18:42.283867 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:42.283848    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 09:18:42.694787 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:42.694748    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq" event={"ID":"6c804249-d91c-43d8-bc2f-633afcf6c020","Type":"ContainerStarted","Data":"9c35e5d3ee08a9855f335091fbca9e14f808834f08461ec4586262062e419053"}
Sep 19 09:18:45.710282 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:45.710250    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq" event={"ID":"6c804249-d91c-43d8-bc2f-633afcf6c020","Type":"ContainerStarted","Data":"cace556087e51c061a03a7a788984a41c413bfd77233fb377f1f8a4651643fe7"}
Sep 19 09:18:45.710673 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:45.710383    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:45.728825 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:45.728774    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq" podStartSLOduration=2.257381938 podStartE2EDuration="4.728757357s" totalImagesPullingTime="2.471375419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:18:45.72828627 +0000 UTC m=+708.895481499" watchObservedRunningTime="2026-09-19 09:18:45.728757357 +0000 UTC m=+708.895952587"
Sep 19 09:18:48.568092 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.568049    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"]
Sep 19 09:18:48.571748 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.571725    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.574194 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.574166    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 19 09:18:48.574327 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.574203    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 19 09:18:48.574327 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.574237    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 09:18:48.574327 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.574243    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-42p89\""
Sep 19 09:18:48.591313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.591285    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"]
Sep 19 09:18:48.629773 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.629731    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.629773 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.629779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.629974 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.629841    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.629974 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.629917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvdct\" (UniqueName: \"kubernetes.io/projected/75a5ec1f-78ee-4845-8243-6c0273c70e56-kube-api-access-qvdct\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.629974 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.629950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.630112 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.629992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.630112 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.630065    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.630175 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.630119    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.630175 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.630137    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75a5ec1f-78ee-4845-8243-6c0273c70e56-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.730581 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.730551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.730581 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.730582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75a5ec1f-78ee-4845-8243-6c0273c70e56-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.730823 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.730606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.730823 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.730629    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.730823 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.730662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.730982 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.730814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvdct\" (UniqueName: \"kubernetes.io/projected/75a5ec1f-78ee-4845-8243-6c0273c70e56-kube-api-access-qvdct\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.730982 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.730867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.730982 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.730938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.730982 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.730975    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.731205 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.731039    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.731205 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.731068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.731369 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.731351    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.731531 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.731512    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.731940 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.731919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75a5ec1f-78ee-4845-8243-6c0273c70e56-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.733199 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.733182    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.733331 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.733310    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.738954 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.738936    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75a5ec1f-78ee-4845-8243-6c0273c70e56-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.739248 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.739227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvdct\" (UniqueName: \"kubernetes.io/projected/75a5ec1f-78ee-4845-8243-6c0273c70e56-kube-api-access-qvdct\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg\" (UID: \"75a5ec1f-78ee-4845-8243-6c0273c70e56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:48.882522 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:48.882433    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:49.162765 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:49.162636    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"]
Sep 19 09:18:49.165358 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:18:49.165326    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a5ec1f_78ee_4845_8243_6c0273c70e56.slice/crio-f4766176085b1cb8df815f90f549738bc4eea6fd2083a86a880f89a3112f1418 WatchSource:0}: Error finding container f4766176085b1cb8df815f90f549738bc4eea6fd2083a86a880f89a3112f1418: Status 404 returned error can't find the container with id f4766176085b1cb8df815f90f549738bc4eea6fd2083a86a880f89a3112f1418
Sep 19 09:18:49.729718 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:49.729689    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg" event={"ID":"75a5ec1f-78ee-4845-8243-6c0273c70e56","Type":"ContainerStarted","Data":"f4766176085b1cb8df815f90f549738bc4eea6fd2083a86a880f89a3112f1418"}
Sep 19 09:18:52.216252 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.216216    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w28cp"]
Sep 19 09:18:52.219526 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.219508    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:18:52.221805 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.221790    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-b8k5h\""
Sep 19 09:18:52.221922 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.221907    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 19 09:18:52.222919 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.222892    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:18:52.222990 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.222945    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:18:52.222990 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.222972    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:18:52.235061 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.235038    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w28cp"]
Sep 19 09:18:52.363500 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.363455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfw9z\" (UniqueName: \"kubernetes.io/projected/8ad9cf84-5812-42ae-bfcf-1fc81183761e-kube-api-access-wfw9z\") pod \"odh-model-controller-7998c67dc4-w28cp\" (UID: \"8ad9cf84-5812-42ae-bfcf-1fc81183761e\") " pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:18:52.363776 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.363534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ad9cf84-5812-42ae-bfcf-1fc81183761e-cert\") pod \"odh-model-controller-7998c67dc4-w28cp\" (UID: \"8ad9cf84-5812-42ae-bfcf-1fc81183761e\") " pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:18:52.464955 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.464920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfw9z\" (UniqueName: \"kubernetes.io/projected/8ad9cf84-5812-42ae-bfcf-1fc81183761e-kube-api-access-wfw9z\") pod \"odh-model-controller-7998c67dc4-w28cp\" (UID: \"8ad9cf84-5812-42ae-bfcf-1fc81183761e\") " pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:18:52.465164 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.464973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ad9cf84-5812-42ae-bfcf-1fc81183761e-cert\") pod \"odh-model-controller-7998c67dc4-w28cp\" (UID: \"8ad9cf84-5812-42ae-bfcf-1fc81183761e\") " pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:18:52.465164 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:52.465102    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 19 09:18:52.465164 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:52.465163    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad9cf84-5812-42ae-bfcf-1fc81183761e-cert podName:8ad9cf84-5812-42ae-bfcf-1fc81183761e nodeName:}" failed. No retries permitted until 2026-09-19 09:18:52.965142888 +0000 UTC m=+716.132338097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8ad9cf84-5812-42ae-bfcf-1fc81183761e-cert") pod "odh-model-controller-7998c67dc4-w28cp" (UID: "8ad9cf84-5812-42ae-bfcf-1fc81183761e") : secret "odh-model-controller-webhook-cert" not found
Sep 19 09:18:52.474099 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.474037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfw9z\" (UniqueName: \"kubernetes.io/projected/8ad9cf84-5812-42ae-bfcf-1fc81183761e-kube-api-access-wfw9z\") pod \"odh-model-controller-7998c67dc4-w28cp\" (UID: \"8ad9cf84-5812-42ae-bfcf-1fc81183761e\") " pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:18:52.748175 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.748088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg" event={"ID":"75a5ec1f-78ee-4845-8243-6c0273c70e56","Type":"ContainerStarted","Data":"72979d16b10d8446b93ccd07eddb47a2f7d6835fb36381476a75d9c62bd74cb0"}
Sep 19 09:18:52.778483 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.778435    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg" podStartSLOduration=1.723073474 podStartE2EDuration="4.778418476s" totalImagesPullingTime="3.055345002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:18:52.776777355 +0000 UTC m=+715.943972595" watchObservedRunningTime="2026-09-19 09:18:52.778418476 +0000 UTC m=+715.945613705"
Sep 19 09:18:52.845998 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.845968    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d4qgm"]
Sep 19 09:18:52.849413 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.849397    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm"
Sep 19 09:18:52.851649 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.851621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 19 09:18:52.862009 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.861988    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d4qgm"]
Sep 19 09:18:52.882639 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.882555    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:52.969749 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.969719    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ad9cf84-5812-42ae-bfcf-1fc81183761e-cert\") pod \"odh-model-controller-7998c67dc4-w28cp\" (UID: \"8ad9cf84-5812-42ae-bfcf-1fc81183761e\") " pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:18:52.969943 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.969797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e-tls-certs\") pod \"model-serving-api-54d89bd5fc-d4qgm\" (UID: \"0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e\") " pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm"
Sep 19 09:18:52.969943 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:52.969851    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jpwl\" (UniqueName: \"kubernetes.io/projected/0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e-kube-api-access-7jpwl\") pod \"model-serving-api-54d89bd5fc-d4qgm\" (UID: \"0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e\") " pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm"
Sep 19 09:18:52.969943 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:52.969920    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 19 09:18:52.970149 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:18:52.969987    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad9cf84-5812-42ae-bfcf-1fc81183761e-cert podName:8ad9cf84-5812-42ae-bfcf-1fc81183761e nodeName:}" failed. No retries permitted until 2026-09-19 09:18:53.969967982 +0000 UTC m=+717.137163191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8ad9cf84-5812-42ae-bfcf-1fc81183761e-cert") pod "odh-model-controller-7998c67dc4-w28cp" (UID: "8ad9cf84-5812-42ae-bfcf-1fc81183761e") : secret "odh-model-controller-webhook-cert" not found
Sep 19 09:18:53.070512 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:53.070479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e-tls-certs\") pod \"model-serving-api-54d89bd5fc-d4qgm\" (UID: \"0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e\") " pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm"
Sep 19 09:18:53.070512 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:53.070511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jpwl\" (UniqueName: \"kubernetes.io/projected/0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e-kube-api-access-7jpwl\") pod \"model-serving-api-54d89bd5fc-d4qgm\" (UID: \"0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e\") " pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm"
Sep 19 09:18:53.073294 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:53.073275    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e-tls-certs\") pod \"model-serving-api-54d89bd5fc-d4qgm\" (UID: \"0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e\") " pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm"
Sep 19 09:18:53.078085 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:53.078062    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jpwl\" (UniqueName: \"kubernetes.io/projected/0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e-kube-api-access-7jpwl\") pod \"model-serving-api-54d89bd5fc-d4qgm\" (UID: \"0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e\") " pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm"
Sep 19 09:18:53.159760 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:53.159717    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm"
Sep 19 09:18:53.430165 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:53.429886    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d4qgm"]
Sep 19 09:18:53.432370 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:18:53.432343    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f663d0f_ee4a_48b2_bfa6_ff7a4e0ff14e.slice/crio-eef7909a99416f91d1916e3a74557429f98660526d1d872e910db45d06f5be27 WatchSource:0}: Error finding container eef7909a99416f91d1916e3a74557429f98660526d1d872e910db45d06f5be27: Status 404 returned error can't find the container with id eef7909a99416f91d1916e3a74557429f98660526d1d872e910db45d06f5be27
Sep 19 09:18:53.754418 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:53.754336    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm" event={"ID":"0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e","Type":"ContainerStarted","Data":"eef7909a99416f91d1916e3a74557429f98660526d1d872e910db45d06f5be27"}
Sep 19 09:18:53.887721 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:53.887693    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:53.978355 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:53.978318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ad9cf84-5812-42ae-bfcf-1fc81183761e-cert\") pod \"odh-model-controller-7998c67dc4-w28cp\" (UID: \"8ad9cf84-5812-42ae-bfcf-1fc81183761e\") " pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:18:53.980886 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:53.980858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ad9cf84-5812-42ae-bfcf-1fc81183761e-cert\") pod \"odh-model-controller-7998c67dc4-w28cp\" (UID: \"8ad9cf84-5812-42ae-bfcf-1fc81183761e\") " pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:18:54.029655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:54.029585    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:18:54.315865 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:54.315837    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w28cp"]
Sep 19 09:18:54.318935 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:18:54.318897    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad9cf84_5812_42ae_bfcf_1fc81183761e.slice/crio-9ff02b3a8c4d870005e9d49daff3b18495e1e6160eee84afcccad4c4cb07c3ef WatchSource:0}: Error finding container 9ff02b3a8c4d870005e9d49daff3b18495e1e6160eee84afcccad4c4cb07c3ef: Status 404 returned error can't find the container with id 9ff02b3a8c4d870005e9d49daff3b18495e1e6160eee84afcccad4c4cb07c3ef
Sep 19 09:18:54.761100 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:54.761005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w28cp" event={"ID":"8ad9cf84-5812-42ae-bfcf-1fc81183761e","Type":"ContainerStarted","Data":"9ff02b3a8c4d870005e9d49daff3b18495e1e6160eee84afcccad4c4cb07c3ef"}
Sep 19 09:18:54.761524 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:54.761311    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:54.762430 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:54.762414    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg"
Sep 19 09:18:56.717391 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:56.717356    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9b48b7f58-kgbvq"
Sep 19 09:18:57.777493 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:57.777455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm" event={"ID":"0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e","Type":"ContainerStarted","Data":"d0617368a78d2e1acab2a54dee48a2a27708f462b50fc79b71760062fc1e0d84"}
Sep 19 09:18:57.777917 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:57.777518    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm"
Sep 19 09:18:57.778783 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:57.778760    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w28cp" event={"ID":"8ad9cf84-5812-42ae-bfcf-1fc81183761e","Type":"ContainerStarted","Data":"92d696125381d73b054168d98204cdcefc7e17fcd17032ef8a45362db7c694f3"}
Sep 19 09:18:57.778885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:57.778874    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:18:57.797991 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:57.797950    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm" podStartSLOduration=2.122714636 podStartE2EDuration="5.797936751s" totalImagesPullingTime="3.675222115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:18:57.795315862 +0000 UTC m=+720.962511091" watchObservedRunningTime="2026-09-19 09:18:57.797936751 +0000 UTC m=+720.965131980"
Sep 19 09:18:57.819489 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:57.819433    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-w28cp" podStartSLOduration=2.987675632 podStartE2EDuration="5.819416806s" totalImagesPullingTime="2.831741174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:18:57.816954737 +0000 UTC m=+720.984150073" watchObservedRunningTime="2026-09-19 09:18:57.819416806 +0000 UTC m=+720.986612036"
Sep 19 09:18:58.870877 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:58.870845    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"]
Sep 19 09:18:58.875836 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:58.875818    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:58.882128 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:58.882098    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 19 09:18:58.882252 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:58.882123    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pvvx2\""
Sep 19 09:18:58.882252 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:58.882222    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 19 09:18:58.882393 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:58.882377    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 19 09:18:58.891247 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:58.891221    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"]
Sep 19 09:18:59.032082 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.032042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.032267 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.032125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjkph\" (UniqueName: \"kubernetes.io/projected/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-kube-api-access-cjkph\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.032267 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.032174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.032267 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.032199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.032267 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.032234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.032267 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.032264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.032487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.032344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.133828 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.133743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.133828 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.133780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.133828 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.133814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjkph\" (UniqueName: \"kubernetes.io/projected/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-kube-api-access-cjkph\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.134127 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.133840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.134127 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.133855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.134127 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.133884    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.134127 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.133923    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.134773 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.134735    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.136332 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.136315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.136451 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.136429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.136763 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.136742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.136814 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.136801    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.144054 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.144035    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjkph\" (UniqueName: \"kubernetes.io/projected/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-kube-api-access-cjkph\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.156591 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.156572    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a11417a-8f88-49a5-8d2e-4e3df2a0763c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8cfdp\" (UID: \"9a11417a-8f88-49a5-8d2e-4e3df2a0763c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.186237 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.186206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:18:59.479444 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.479421    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"]
Sep 19 09:18:59.480738 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:18:59.480705    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a11417a_8f88_49a5_8d2e_4e3df2a0763c.slice/crio-427deba3f6dd60750c2f86e5d09adc6ba3512736c90537d73e6c4bda0babfbc8 WatchSource:0}: Error finding container 427deba3f6dd60750c2f86e5d09adc6ba3512736c90537d73e6c4bda0babfbc8: Status 404 returned error can't find the container with id 427deba3f6dd60750c2f86e5d09adc6ba3512736c90537d73e6c4bda0babfbc8
Sep 19 09:18:59.788623 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:18:59.788594    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp" event={"ID":"9a11417a-8f88-49a5-8d2e-4e3df2a0763c","Type":"ContainerStarted","Data":"427deba3f6dd60750c2f86e5d09adc6ba3512736c90537d73e6c4bda0babfbc8"}
Sep 19 09:19:01.638923 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:19:01.638885    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:19:01.639305 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:19:01.638965    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:19:01.800135 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:19:01.800091    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp" event={"ID":"9a11417a-8f88-49a5-8d2e-4e3df2a0763c","Type":"ContainerStarted","Data":"5e9ad09e2b607301e9a9a30d05b32131c79fa0b63fbcb9d969bcca91da37fe9c"}
Sep 19 09:19:01.800328 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:19:01.800245    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:19:01.824922 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:19:01.824877    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp" podStartSLOduration=1.668995948 podStartE2EDuration="3.824862414s" totalImagesPullingTime="2.155866466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:19:01.823005119 +0000 UTC m=+724.990200350" watchObservedRunningTime="2026-09-19 09:19:01.824862414 +0000 UTC m=+724.992057643"
Sep 19 09:19:02.806612 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:19:02.806585    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8cfdp"
Sep 19 09:19:08.785519 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:19:08.785489    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-w28cp"
Sep 19 09:19:08.787437 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:19:08.787417    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-d4qgm"
Sep 19 09:21:05.491980 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.491951    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"]
Sep 19 09:21:05.495437 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.495418    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.497739 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.497719    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vnlhp\""
Sep 19 09:21:05.512507 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.512481    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"]
Sep 19 09:21:05.562494 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.562464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.562494 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.562498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.562681 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.562519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9c91454-58cc-4999-8040-9e136429ef9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.562681 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.562535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9c91454-58cc-4999-8040-9e136429ef9a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.562681 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.562606    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpvwl\" (UniqueName: \"kubernetes.io/projected/f9c91454-58cc-4999-8040-9e136429ef9a-kube-api-access-fpvwl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.562681 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.562627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.562681 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.562667    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.562836 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.562688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9c91454-58cc-4999-8040-9e136429ef9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.562836 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.562709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.663866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.663826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.663866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.663867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664121 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.663889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9c91454-58cc-4999-8040-9e136429ef9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664121 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.663906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9c91454-58cc-4999-8040-9e136429ef9a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664121 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.663930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpvwl\" (UniqueName: \"kubernetes.io/projected/f9c91454-58cc-4999-8040-9e136429ef9a-kube-api-access-fpvwl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664121 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.663961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664121 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.663992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664121 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.664038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9c91454-58cc-4999-8040-9e136429ef9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664121 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.664073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664445 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.664322    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664496 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.664446    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664554 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.664513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664554 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.664547    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.664835 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.664815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9c91454-58cc-4999-8040-9e136429ef9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.666301 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.666284    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9c91454-58cc-4999-8040-9e136429ef9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.666602 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.666583    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9c91454-58cc-4999-8040-9e136429ef9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.672111 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.672082    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9c91454-58cc-4999-8040-9e136429ef9a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.672349 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.672331    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpvwl\" (UniqueName: \"kubernetes.io/projected/f9c91454-58cc-4999-8040-9e136429ef9a-kube-api-access-fpvwl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4fvmc\" (UID: \"f9c91454-58cc-4999-8040-9e136429ef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:05.804467 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:05.804432    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:06.080315 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:06.079875    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"]
Sep 19 09:21:06.083685 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:21:06.083657    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c91454_58cc_4999_8040_9e136429ef9a.slice/crio-50faf090c9e4407220c1482553c1506bb21849646f554843591222211a8d2b6d WatchSource:0}: Error finding container 50faf090c9e4407220c1482553c1506bb21849646f554843591222211a8d2b6d: Status 404 returned error can't find the container with id 50faf090c9e4407220c1482553c1506bb21849646f554843591222211a8d2b6d
Sep 19 09:21:06.085870 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:06.085832    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:21:06.085946 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:06.085906    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:21:06.085946 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:06.085936    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:21:06.383324 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:06.383230    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc" event={"ID":"f9c91454-58cc-4999-8040-9e136429ef9a","Type":"ContainerStarted","Data":"509aa1440168b27e8ae1a64b45c2ad2832628eb64b15c666691f1ab2efef63aa"}
Sep 19 09:21:06.383324 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:06.383294    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc" event={"ID":"f9c91454-58cc-4999-8040-9e136429ef9a","Type":"ContainerStarted","Data":"50faf090c9e4407220c1482553c1506bb21849646f554843591222211a8d2b6d"}
Sep 19 09:21:06.407390 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:06.407343    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc" podStartSLOduration=1.407326986 podStartE2EDuration="1.407326986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:21:06.405056598 +0000 UTC m=+849.572251826" watchObservedRunningTime="2026-09-19 09:21:06.407326986 +0000 UTC m=+849.574522215"
Sep 19 09:21:06.805038 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:06.804975    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:07.809658 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:07.809628    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:08.391699 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:08.391671    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:08.392660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:08.392643    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:21:58.871813 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:58.871778    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:21:58.877050 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:21:58.877006    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:22:34.735282 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.735253    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"]
Sep 19 09:22:34.738601 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.738584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"
Sep 19 09:22:34.741364 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.741342    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 19 09:22:34.741471 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.741453    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2s8d8\""
Sep 19 09:22:34.750422 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.750401    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"]
Sep 19 09:22:34.783529 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.783502    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"]
Sep 19 09:22:34.787089 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.787073    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"
Sep 19 09:22:34.802109 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.802086    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"]
Sep 19 09:22:34.870440 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.870409    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwls5\" (UniqueName: \"kubernetes.io/projected/6b21d1b6-4a79-4a72-827b-242b01e840d1-kube-api-access-jwls5\") pod \"payload-processing-5b54b7fbb7-w2qx6\" (UID: \"6b21d1b6-4a79-4a72-827b-242b01e840d1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"
Sep 19 09:22:34.870440 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.870442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfbe6107-0ffa-4805-ab54-964f1afe2e64-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-mxqcf\" (UID: \"dfbe6107-0ffa-4805-ab54-964f1afe2e64\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"
Sep 19 09:22:34.870655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.870505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b21d1b6-4a79-4a72-827b-242b01e840d1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-w2qx6\" (UID: \"6b21d1b6-4a79-4a72-827b-242b01e840d1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"
Sep 19 09:22:34.870655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.870594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpqmg\" (UniqueName: \"kubernetes.io/projected/dfbe6107-0ffa-4805-ab54-964f1afe2e64-kube-api-access-tpqmg\") pod \"payload-pre-processing-59fbc47bf8-mxqcf\" (UID: \"dfbe6107-0ffa-4805-ab54-964f1afe2e64\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"
Sep 19 09:22:34.971082 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.971049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpqmg\" (UniqueName: \"kubernetes.io/projected/dfbe6107-0ffa-4805-ab54-964f1afe2e64-kube-api-access-tpqmg\") pod \"payload-pre-processing-59fbc47bf8-mxqcf\" (UID: \"dfbe6107-0ffa-4805-ab54-964f1afe2e64\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"
Sep 19 09:22:34.971269 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.971139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwls5\" (UniqueName: \"kubernetes.io/projected/6b21d1b6-4a79-4a72-827b-242b01e840d1-kube-api-access-jwls5\") pod \"payload-processing-5b54b7fbb7-w2qx6\" (UID: \"6b21d1b6-4a79-4a72-827b-242b01e840d1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"
Sep 19 09:22:34.971269 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.971159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfbe6107-0ffa-4805-ab54-964f1afe2e64-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-mxqcf\" (UID: \"dfbe6107-0ffa-4805-ab54-964f1afe2e64\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"
Sep 19 09:22:34.971269 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.971226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b21d1b6-4a79-4a72-827b-242b01e840d1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-w2qx6\" (UID: \"6b21d1b6-4a79-4a72-827b-242b01e840d1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"
Sep 19 09:22:34.972117 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.972093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b21d1b6-4a79-4a72-827b-242b01e840d1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-w2qx6\" (UID: \"6b21d1b6-4a79-4a72-827b-242b01e840d1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"
Sep 19 09:22:34.972393 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.972366    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfbe6107-0ffa-4805-ab54-964f1afe2e64-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-mxqcf\" (UID: \"dfbe6107-0ffa-4805-ab54-964f1afe2e64\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"
Sep 19 09:22:34.986632 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.986574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpqmg\" (UniqueName: \"kubernetes.io/projected/dfbe6107-0ffa-4805-ab54-964f1afe2e64-kube-api-access-tpqmg\") pod \"payload-pre-processing-59fbc47bf8-mxqcf\" (UID: \"dfbe6107-0ffa-4805-ab54-964f1afe2e64\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"
Sep 19 09:22:34.987591 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:34.987571    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwls5\" (UniqueName: \"kubernetes.io/projected/6b21d1b6-4a79-4a72-827b-242b01e840d1-kube-api-access-jwls5\") pod \"payload-processing-5b54b7fbb7-w2qx6\" (UID: \"6b21d1b6-4a79-4a72-827b-242b01e840d1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"
Sep 19 09:22:35.048185 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:35.048149    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"
Sep 19 09:22:35.097978 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:35.097780    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"
Sep 19 09:22:35.321235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:35.321208    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"]
Sep 19 09:22:35.323083 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:22:35.323046    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfbe6107_0ffa_4805_ab54_964f1afe2e64.slice/crio-ac836e23f8e01ab8f65df479fa8c1c39941a01f3245214e17b0de1bb90baa515 WatchSource:0}: Error finding container ac836e23f8e01ab8f65df479fa8c1c39941a01f3245214e17b0de1bb90baa515: Status 404 returned error can't find the container with id ac836e23f8e01ab8f65df479fa8c1c39941a01f3245214e17b0de1bb90baa515
Sep 19 09:22:35.373293 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:35.373237    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"]
Sep 19 09:22:35.375455 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:22:35.375431    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b21d1b6_4a79_4a72_827b_242b01e840d1.slice/crio-4ba004dbbb1a5f6f9d387a4363bef7560a7266b70e8dbf7b0faa6c262e2d6ab6 WatchSource:0}: Error finding container 4ba004dbbb1a5f6f9d387a4363bef7560a7266b70e8dbf7b0faa6c262e2d6ab6: Status 404 returned error can't find the container with id 4ba004dbbb1a5f6f9d387a4363bef7560a7266b70e8dbf7b0faa6c262e2d6ab6
Sep 19 09:22:35.804062 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:35.804028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf" event={"ID":"dfbe6107-0ffa-4805-ab54-964f1afe2e64","Type":"ContainerStarted","Data":"ac836e23f8e01ab8f65df479fa8c1c39941a01f3245214e17b0de1bb90baa515"}
Sep 19 09:22:35.805137 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:35.805101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6" event={"ID":"6b21d1b6-4a79-4a72-827b-242b01e840d1","Type":"ContainerStarted","Data":"4ba004dbbb1a5f6f9d387a4363bef7560a7266b70e8dbf7b0faa6c262e2d6ab6"}
Sep 19 09:22:37.816480 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:37.816432    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6" event={"ID":"6b21d1b6-4a79-4a72-827b-242b01e840d1","Type":"ContainerStarted","Data":"493551ebdcf364b32fed10a24a98ec816cfb97b01158ced35175fea7b8b5e472"}
Sep 19 09:22:37.817272 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:37.817246    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"
Sep 19 09:22:37.819321 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:37.819289    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf" event={"ID":"dfbe6107-0ffa-4805-ab54-964f1afe2e64","Type":"ContainerStarted","Data":"f433b6fa192d990e9d96339af30f471a052a405464afcc6e427ca017f007d174"}
Sep 19 09:22:37.819816 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:37.819791    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"
Sep 19 09:22:37.836451 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:37.836378    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6" podStartSLOduration=2.322778881 podStartE2EDuration="3.836357698s" totalImagesPullingTime="1.513578817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:22:37.835228439 +0000 UTC m=+941.002423663" watchObservedRunningTime="2026-09-19 09:22:37.836357698 +0000 UTC m=+941.003552930"
Sep 19 09:22:37.855361 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:37.855293    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf" podStartSLOduration=2.291865774 podStartE2EDuration="3.855273655s" totalImagesPullingTime="1.563407881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:22:37.852735923 +0000 UTC m=+941.019931153" watchObservedRunningTime="2026-09-19 09:22:37.855273655 +0000 UTC m=+941.022468886"
Sep 19 09:22:44.862887 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:44.862853    2579 generic.go:356] "Generic (PLEG): container finished" podID="f9c91454-58cc-4999-8040-9e136429ef9a" containerID="509aa1440168b27e8ae1a64b45c2ad2832628eb64b15c666691f1ab2efef63aa" exitCode=0
Sep 19 09:22:44.863307 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:44.862927    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc" event={"ID":"f9c91454-58cc-4999-8040-9e136429ef9a","Type":"ContainerDied","Data":"509aa1440168b27e8ae1a64b45c2ad2832628eb64b15c666691f1ab2efef63aa"}
Sep 19 09:22:44.863374 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:44.863359    2579 scope.go:117] "RemoveContainer" containerID="509aa1440168b27e8ae1a64b45c2ad2832628eb64b15c666691f1ab2efef63aa"
Sep 19 09:22:44.864317 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:44.864291    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:22:44.864384 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:44.864368    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:22:44.864425 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:44.864412    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:22:45.869079 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:45.869049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc" event={"ID":"f9c91454-58cc-4999-8040-9e136429ef9a","Type":"ContainerStarted","Data":"b6fcdb579cb20f6a821d66f5cbc31de8eca0cc4bc7e39e6d4c4dacb105e4762e"}
Sep 19 09:22:46.805618 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:46.805580    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:22:46.805804 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:46.805781    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4fvmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 19 09:22:46.805858 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:46.805836    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc" podUID="f9c91454-58cc-4999-8040-9e136429ef9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 19 09:22:47.805533 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:47.805489    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4fvmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 19 09:22:47.805926 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:47.805551    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc" podUID="f9c91454-58cc-4999-8040-9e136429ef9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 19 09:22:48.805398 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:48.805363    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4fvmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 19 09:22:48.805567 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:48.805418    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc" podUID="f9c91454-58cc-4999-8040-9e136429ef9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 19 09:22:49.805337 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:49.805296    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4fvmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 19 09:22:49.805562 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:49.805356    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc" podUID="f9c91454-58cc-4999-8040-9e136429ef9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 19 09:22:49.841076 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:49.840385    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mxqcf"
Sep 19 09:22:49.841546 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:49.841199    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-w2qx6"
Sep 19 09:22:50.809480 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:50.809450    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:22:50.809785 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:50.809753    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:22:50.810398 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:22:50.810384    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4fvmc"
Sep 19 09:23:05.767154 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.767118    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"]
Sep 19 09:23:05.773277 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.773255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.775569 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.775549    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 19 09:23:05.776208 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.776185    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 19 09:23:05.776348 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.776323    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-942q6\""
Sep 19 09:23:05.776348 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.776342    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 19 09:23:05.781038 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.780996    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"]
Sep 19 09:23:05.867530 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.867499    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.867530 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.867564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf8cs\" (UniqueName: \"kubernetes.io/projected/14ba9388-32ee-4f86-ba94-1c35b1740927-kube-api-access-nf8cs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.868049 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.867584    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.868049 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.867713    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14ba9388-32ee-4f86-ba94-1c35b1740927-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.868049 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.867747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.868049 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.867805    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.968892 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.968858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14ba9388-32ee-4f86-ba94-1c35b1740927-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.968892 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.968891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.969166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.968916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.969166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.968950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.969166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.968991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf8cs\" (UniqueName: \"kubernetes.io/projected/14ba9388-32ee-4f86-ba94-1c35b1740927-kube-api-access-nf8cs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.969166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.969042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.969414 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.969347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.969414 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.969349    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.969505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.969487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.971463 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.971444    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14ba9388-32ee-4f86-ba94-1c35b1740927-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.971621 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.971603    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14ba9388-32ee-4f86-ba94-1c35b1740927-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:05.976680 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:05.976657    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf8cs\" (UniqueName: \"kubernetes.io/projected/14ba9388-32ee-4f86-ba94-1c35b1740927-kube-api-access-nf8cs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsmbc\" (UID: \"14ba9388-32ee-4f86-ba94-1c35b1740927\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:06.085056 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:06.085025    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:06.356247 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:06.356157    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"]
Sep 19 09:23:06.359600 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:23:06.359569    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ba9388_32ee_4f86_ba94_1c35b1740927.slice/crio-24128c4bcb0ba359d8d0b9d9d875a2b9e4555d22ebf17f4128bec0e475758d6c WatchSource:0}: Error finding container 24128c4bcb0ba359d8d0b9d9d875a2b9e4555d22ebf17f4128bec0e475758d6c: Status 404 returned error can't find the container with id 24128c4bcb0ba359d8d0b9d9d875a2b9e4555d22ebf17f4128bec0e475758d6c
Sep 19 09:23:06.980736 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:06.980702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc" event={"ID":"14ba9388-32ee-4f86-ba94-1c35b1740927","Type":"ContainerStarted","Data":"24128c4bcb0ba359d8d0b9d9d875a2b9e4555d22ebf17f4128bec0e475758d6c"}
Sep 19 09:23:07.987358 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:07.987325    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc" event={"ID":"14ba9388-32ee-4f86-ba94-1c35b1740927","Type":"ContainerStarted","Data":"17ebb9d7bbeddc1e77624c54c3322932f86e8e986b7db1dc79d444e2519e8e03"}
Sep 19 09:23:08.008116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:08.008061    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc" podStartSLOduration=2.041793056 podStartE2EDuration="3.008045023s" totalImagesPullingTime="966.251967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:23:08.006887553 +0000 UTC m=+971.174082783" watchObservedRunningTime="2026-09-19 09:23:08.008045023 +0000 UTC m=+971.175240250"
Sep 19 09:23:16.085189 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:16.085097    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:16.085647 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:16.085196    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:16.097991 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:16.097961    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:17.041630 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:17.041599    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsmbc"
Sep 19 09:23:38.979332 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:38.979296    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"]
Sep 19 09:23:38.984280 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:38.984262    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:38.986750 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:38.986730    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 19 09:23:38.991713 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:38.991693    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"]
Sep 19 09:23:39.085684 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.085652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.085844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.085691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfv9p\" (UniqueName: \"kubernetes.io/projected/9eda24c7-3c2d-45bc-a36b-ee584303f02b-kube-api-access-rfv9p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.085844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.085714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.085844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.085807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.085844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.085840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eda24c7-3c2d-45bc-a36b-ee584303f02b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.085975 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.085862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.187405 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.187366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.187405 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.187410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfv9p\" (UniqueName: \"kubernetes.io/projected/9eda24c7-3c2d-45bc-a36b-ee584303f02b-kube-api-access-rfv9p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.187645 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.187431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.187645 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.187467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.187645 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.187487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eda24c7-3c2d-45bc-a36b-ee584303f02b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.187645 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.187505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.187867 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.187844    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.187924 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.187872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.187924 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.187905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.189871 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.189850    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eda24c7-3c2d-45bc-a36b-ee584303f02b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.190048 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.190007    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eda24c7-3c2d-45bc-a36b-ee584303f02b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.195731 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.195708    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfv9p\" (UniqueName: \"kubernetes.io/projected/9eda24c7-3c2d-45bc-a36b-ee584303f02b-kube-api-access-rfv9p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55\" (UID: \"9eda24c7-3c2d-45bc-a36b-ee584303f02b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.294519 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.294490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:39.567929 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:39.567902    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"]
Sep 19 09:23:39.570095 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:23:39.570068    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eda24c7_3c2d_45bc_a36b_ee584303f02b.slice/crio-e50efae55eb62dccee8e144279a9fd39bec568eee0734f1e4eca00636fe4f92e WatchSource:0}: Error finding container e50efae55eb62dccee8e144279a9fd39bec568eee0734f1e4eca00636fe4f92e: Status 404 returned error can't find the container with id e50efae55eb62dccee8e144279a9fd39bec568eee0734f1e4eca00636fe4f92e
Sep 19 09:23:40.141532 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:40.141495    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55" event={"ID":"9eda24c7-3c2d-45bc-a36b-ee584303f02b","Type":"ContainerStarted","Data":"fdc8d40425327e3c3d3a03e9f62ed60abc21a3099d4d3231266881f6dfe165ce"}
Sep 19 09:23:40.141970 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:40.141548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55" event={"ID":"9eda24c7-3c2d-45bc-a36b-ee584303f02b","Type":"ContainerStarted","Data":"e50efae55eb62dccee8e144279a9fd39bec568eee0734f1e4eca00636fe4f92e"}
Sep 19 09:23:40.159098 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:40.159049    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55" podStartSLOduration=1.992440811 podStartE2EDuration="2.15903215s" totalImagesPullingTime="166.591339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:23:40.158859494 +0000 UTC m=+1003.326054726" watchObservedRunningTime="2026-09-19 09:23:40.15903215 +0000 UTC m=+1003.326227373"
Sep 19 09:23:49.295628 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:49.295598    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:49.295996 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:49.295670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:49.308475 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:49.308452    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:23:50.199318 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:23:50.199291    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55"
Sep 19 09:25:52.086834 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.086795    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"]
Sep 19 09:25:52.090471 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.090449    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.093126 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.093107    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-14e3f6-openshift-default-dockercfg-jvvjk\""
Sep 19 09:25:52.119406 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.119378    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"]
Sep 19 09:25:52.192314 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.192275    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-podinfo\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.192314 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.192312    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-certs\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.192552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.192379    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-token\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.192552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.192437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-credential-socket\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.192552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.192473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-data\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.192552 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.192528    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-socket\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.192771 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.192559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-envoy\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.192771 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.192601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2q8x\" (UniqueName: \"kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-kube-api-access-d2q8x\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.192771 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.192661    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istiod-ca-cert\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.269087 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.269050    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"]
Sep 19 09:25:52.272622 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.272599    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.274869 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.274854    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-acc640-openshift-default-dockercfg-vwh8l\""
Sep 19 09:25:52.285129 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.285098    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"]
Sep 19 09:25:52.294321 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.294296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2q8x\" (UniqueName: \"kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-kube-api-access-d2q8x\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.294431 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.294346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istiod-ca-cert\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.294431 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.294401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-podinfo\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.294536 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.294429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-certs\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.294536 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.294460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-token\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.294536 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.294499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-credential-socket\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.294690 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.294549    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-data\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.294690 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.294591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-socket\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.294690 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.294638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-envoy\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.294855 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.294827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-certs\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.294973 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.294945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-credential-socket\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.295103 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.295088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-socket\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.295178 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.295158    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istiod-ca-cert\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.295321 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.295270    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-data\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.297120 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.297096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-envoy\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.297268 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.297253    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-podinfo\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.306605 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.306581    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-token\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.307483 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.307463    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2q8x\" (UniqueName: \"kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-kube-api-access-d2q8x\") pod \"e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") " pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.395350 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.395257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-podinfo\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.395350 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.395298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-envoy\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.395350 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.395317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-credential-socket\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.395600 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.395405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-token\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.395600 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.395436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l89rd\" (UniqueName: \"kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-kube-api-access-l89rd\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.395600 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.395470    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-data\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.395600 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.395501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-certs\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.395600 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.395585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istiod-ca-cert\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.395815 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.395647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-socket\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.400063 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.400032    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:52.496712 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.496684    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-token\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.496898 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.496721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l89rd\" (UniqueName: \"kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-kube-api-access-l89rd\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.496898 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.496747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-data\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.496898 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.496769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-certs\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.496898 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.496805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istiod-ca-cert\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.496898 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.496845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-socket\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.497217 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.496914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-podinfo\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.497217 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.496939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-envoy\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.497217 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.496960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-credential-socket\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.497217 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.497193    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-data\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.497410 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.497244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-certs\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.497410 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.497342    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-socket\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.497410 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.497347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-credential-socket\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.497595 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.497573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istiod-ca-cert\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.499390 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.499367    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-envoy\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.499485 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.499452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-podinfo\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.504957 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.504928    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-token\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.505223 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.505206    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l89rd\" (UniqueName: \"kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-kube-api-access-l89rd\") pod \"e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") " pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.583528 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.583496    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:52.681681 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.681655    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"]
Sep 19 09:25:52.683309 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:25:52.683286    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ad42c5_4c31_479d_a58a_ef36ca1edbc1.slice/crio-3fd36fb298debf4a25edf1f98d7e2675ed068e41f9b3922fdb01a90a23b4b3c2 WatchSource:0}: Error finding container 3fd36fb298debf4a25edf1f98d7e2675ed068e41f9b3922fdb01a90a23b4b3c2: Status 404 returned error can't find the container with id 3fd36fb298debf4a25edf1f98d7e2675ed068e41f9b3922fdb01a90a23b4b3c2
Sep 19 09:25:52.685421 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.685394    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:25:52.685499 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.685464    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:25:52.685540 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.685496    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:25:52.798256 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.798219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" event={"ID":"87ad42c5-4c31-479d-a58a-ef36ca1edbc1","Type":"ContainerStarted","Data":"2a169c784d46f6e4d1998260aa8f3de0a0557b60b44e10b7f9e9e0de5598ee07"}
Sep 19 09:25:52.798439 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.798282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" event={"ID":"87ad42c5-4c31-479d-a58a-ef36ca1edbc1","Type":"ContainerStarted","Data":"3fd36fb298debf4a25edf1f98d7e2675ed068e41f9b3922fdb01a90a23b4b3c2"}
Sep 19 09:25:52.822314 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.822248    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" podStartSLOduration=0.822226984 podStartE2EDuration="822.226984ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:25:52.821355978 +0000 UTC m=+1135.988551211" watchObservedRunningTime="2026-09-19 09:25:52.822226984 +0000 UTC m=+1135.989422232"
Sep 19 09:25:52.860889 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.860863    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"]
Sep 19 09:25:52.862834 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:25:52.862806    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd4e9da_da12_46a7_b66a_5b27f042c08b.slice/crio-2886dcabcbb40d27ce9f6716bff4837315989ab91ff0ce658601ebb65c0a59b6 WatchSource:0}: Error finding container 2886dcabcbb40d27ce9f6716bff4837315989ab91ff0ce658601ebb65c0a59b6: Status 404 returned error can't find the container with id 2886dcabcbb40d27ce9f6716bff4837315989ab91ff0ce658601ebb65c0a59b6
Sep 19 09:25:52.865254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.865218    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:25:52.865326 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.865300    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:25:52.865362 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:52.865340    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:25:53.401099 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:53.401064    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:53.405548 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:53.405519    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:53.804872 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:53.804834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" event={"ID":"5fd4e9da-da12-46a7-b66a-5b27f042c08b","Type":"ContainerStarted","Data":"cad90ff321f8e2873f6ea6172cfcdb96a076749634244585d84ed01d29d99e05"}
Sep 19 09:25:53.805085 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:53.804888    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" event={"ID":"5fd4e9da-da12-46a7-b66a-5b27f042c08b","Type":"ContainerStarted","Data":"2886dcabcbb40d27ce9f6716bff4837315989ab91ff0ce658601ebb65c0a59b6"}
Sep 19 09:25:53.805160 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:53.805129    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:53.805974 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:53.805954    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:25:53.824822 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:53.824779    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" podStartSLOduration=1.82476368 podStartE2EDuration="1.82476368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:25:53.822996087 +0000 UTC m=+1136.990191352" watchObservedRunningTime="2026-09-19 09:25:53.82476368 +0000 UTC m=+1136.991958909"
Sep 19 09:25:54.583727 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:54.583690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:54.588507 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:54.588484    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:54.809868 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:54.809834    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:54.810824 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:54.810807    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:25:57.497235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.497200    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"]
Sep 19 09:25:57.501613 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.501590    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:25:57.504104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.504084    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-14e3f6-dockercfg-p5smk\""
Sep 19 09:25:57.504230 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.504084    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-14e3f6\""
Sep 19 09:25:57.520361 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.520333    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"]
Sep 19 09:25:57.579413 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.579380    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"]
Sep 19 09:25:57.582883 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.582866    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:25:57.596088 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.596063    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"]
Sep 19 09:25:57.654869 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.654838    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl5lw\" (UniqueName: \"kubernetes.io/projected/4d417ec5-3c67-431d-be5b-be939e19406a-kube-api-access-pl5lw\") pod \"payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg\" (UID: \"4d417ec5-3c67-431d-be5b-be939e19406a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:25:57.655041 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.654896    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d417ec5-3c67-431d-be5b-be939e19406a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg\" (UID: \"4d417ec5-3c67-431d-be5b-be939e19406a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:25:57.755649 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.755564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdvtq\" (UniqueName: \"kubernetes.io/projected/e6bb31b6-067c-411f-8e1b-4276c77d4946-kube-api-access-zdvtq\") pod \"payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6\" (UID: \"e6bb31b6-067c-411f-8e1b-4276c77d4946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:25:57.755649 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.755607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl5lw\" (UniqueName: \"kubernetes.io/projected/4d417ec5-3c67-431d-be5b-be939e19406a-kube-api-access-pl5lw\") pod \"payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg\" (UID: \"4d417ec5-3c67-431d-be5b-be939e19406a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:25:57.755840 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.755691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d417ec5-3c67-431d-be5b-be939e19406a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg\" (UID: \"4d417ec5-3c67-431d-be5b-be939e19406a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:25:57.755840 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.755735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6bb31b6-067c-411f-8e1b-4276c77d4946-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6\" (UID: \"e6bb31b6-067c-411f-8e1b-4276c77d4946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:25:57.756394 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.756376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d417ec5-3c67-431d-be5b-be939e19406a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg\" (UID: \"4d417ec5-3c67-431d-be5b-be939e19406a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:25:57.768431 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.768402    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl5lw\" (UniqueName: \"kubernetes.io/projected/4d417ec5-3c67-431d-be5b-be939e19406a-kube-api-access-pl5lw\") pod \"payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg\" (UID: \"4d417ec5-3c67-431d-be5b-be939e19406a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:25:57.812603 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.812564    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:25:57.856503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.856466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdvtq\" (UniqueName: \"kubernetes.io/projected/e6bb31b6-067c-411f-8e1b-4276c77d4946-kube-api-access-zdvtq\") pod \"payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6\" (UID: \"e6bb31b6-067c-411f-8e1b-4276c77d4946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:25:57.856665 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.856525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6bb31b6-067c-411f-8e1b-4276c77d4946-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6\" (UID: \"e6bb31b6-067c-411f-8e1b-4276c77d4946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:25:57.857194 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.857177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6bb31b6-067c-411f-8e1b-4276c77d4946-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6\" (UID: \"e6bb31b6-067c-411f-8e1b-4276c77d4946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:25:57.871403 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.871376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdvtq\" (UniqueName: \"kubernetes.io/projected/e6bb31b6-067c-411f-8e1b-4276c77d4946-kube-api-access-zdvtq\") pod \"payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6\" (UID: \"e6bb31b6-067c-411f-8e1b-4276c77d4946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:25:57.892735 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:57.892702    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:25:58.119203 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:58.119179    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"]
Sep 19 09:25:58.120645 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:25:58.120621    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d417ec5_3c67_431d_be5b_be939e19406a.slice/crio-fa9ef0fd3f3f934818f34c0e2cde8a5d091578f91fa223ee28b3dc633133c0fb WatchSource:0}: Error finding container fa9ef0fd3f3f934818f34c0e2cde8a5d091578f91fa223ee28b3dc633133c0fb: Status 404 returned error can't find the container with id fa9ef0fd3f3f934818f34c0e2cde8a5d091578f91fa223ee28b3dc633133c0fb
Sep 19 09:25:58.203164 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:58.203131    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"]
Sep 19 09:25:58.206454 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:25:58.206424    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6bb31b6_067c_411f_8e1b_4276c77d4946.slice/crio-f597920da6addc0e71c526f56e3b6b4be498de213d00729fd87eedfe9b276517 WatchSource:0}: Error finding container f597920da6addc0e71c526f56e3b6b4be498de213d00729fd87eedfe9b276517: Status 404 returned error can't find the container with id f597920da6addc0e71c526f56e3b6b4be498de213d00729fd87eedfe9b276517
Sep 19 09:25:58.844073 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:58.844011    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6" event={"ID":"e6bb31b6-067c-411f-8e1b-4276c77d4946","Type":"ContainerStarted","Data":"cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085"}
Sep 19 09:25:58.844550 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:58.844139    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:25:58.844550 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:58.844165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6" event={"ID":"e6bb31b6-067c-411f-8e1b-4276c77d4946","Type":"ContainerStarted","Data":"f597920da6addc0e71c526f56e3b6b4be498de213d00729fd87eedfe9b276517"}
Sep 19 09:25:58.845902 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:58.845877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg" event={"ID":"4d417ec5-3c67-431d-be5b-be939e19406a","Type":"ContainerStarted","Data":"9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591"}
Sep 19 09:25:58.846049 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:58.845921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg" event={"ID":"4d417ec5-3c67-431d-be5b-be939e19406a","Type":"ContainerStarted","Data":"fa9ef0fd3f3f934818f34c0e2cde8a5d091578f91fa223ee28b3dc633133c0fb"}
Sep 19 09:25:58.846049 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:58.845942    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:25:58.868843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:58.868794    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6" podStartSLOduration=1.868781374 podStartE2EDuration="1.868781374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:25:58.868113009 +0000 UTC m=+1142.035308252" watchObservedRunningTime="2026-09-19 09:25:58.868781374 +0000 UTC m=+1142.035976603"
Sep 19 09:25:58.896884 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:58.896830    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg" podStartSLOduration=1.896815503 podStartE2EDuration="1.896815503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:25:58.89223276 +0000 UTC m=+1142.059427990" watchObservedRunningTime="2026-09-19 09:25:58.896815503 +0000 UTC m=+1142.064010733"
Sep 19 09:25:59.649448 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.649416    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"]
Sep 19 09:25:59.653276 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.653261    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:25:59.658975 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.658944    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-acc640\""
Sep 19 09:25:59.659153 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.659077    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-acc640-dockercfg-txjjp\""
Sep 19 09:25:59.758892 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.758861    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"]
Sep 19 09:25:59.776317 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.776285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5\" (UID: \"b409cdbb-0a61-4e3c-b81d-9752e9b57f03\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:25:59.776487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.776465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25lp8\" (UniqueName: \"kubernetes.io/projected/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-kube-api-access-25lp8\") pod \"payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5\" (UID: \"b409cdbb-0a61-4e3c-b81d-9752e9b57f03\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:25:59.877612 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.877575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25lp8\" (UniqueName: \"kubernetes.io/projected/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-kube-api-access-25lp8\") pod \"payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5\" (UID: \"b409cdbb-0a61-4e3c-b81d-9752e9b57f03\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:25:59.877960 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.877623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5\" (UID: \"b409cdbb-0a61-4e3c-b81d-9752e9b57f03\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:25:59.878306 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.878289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5\" (UID: \"b409cdbb-0a61-4e3c-b81d-9752e9b57f03\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:25:59.897540 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.897511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25lp8\" (UniqueName: \"kubernetes.io/projected/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-kube-api-access-25lp8\") pod \"payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5\" (UID: \"b409cdbb-0a61-4e3c-b81d-9752e9b57f03\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:25:59.965842 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:25:59.965762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:26:00.250540 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.250511    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"]
Sep 19 09:26:00.252937 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:26:00.252912    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb409cdbb_0a61_4e3c_b81d_9752e9b57f03.slice/crio-cc4c191044a6a1f38386bea67f5c4484f449c1da874c10a09454e76bb3104feb WatchSource:0}: Error finding container cc4c191044a6a1f38386bea67f5c4484f449c1da874c10a09454e76bb3104feb: Status 404 returned error can't find the container with id cc4c191044a6a1f38386bea67f5c4484f449c1da874c10a09454e76bb3104feb
Sep 19 09:26:00.512986 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.512903    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"]
Sep 19 09:26:00.516695 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.516674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.520793 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.520769    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-0ce808-openshift-default-dockercfg-5xnch\""
Sep 19 09:26:00.534594 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.534570    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"]
Sep 19 09:26:00.685318 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.685283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-credential-socket\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.685511 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.685328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-data\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.685511 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.685399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-token\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.685511 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.685476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istiod-ca-cert\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.685511 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.685501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f76hh\" (UniqueName: \"kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-kube-api-access-f76hh\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.685706 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.685557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-certs\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.685706 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.685574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-envoy\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.685706 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.685588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-podinfo\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.685706 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.685648    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-socket\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.786971 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.786883    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-certs\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.786971 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.786917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-envoy\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.786971 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.786938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-podinfo\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.786971 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.786963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-socket\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.787885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.787049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-credential-socket\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.787885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.787083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-data\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.787885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.787127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-token\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.787885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.787159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istiod-ca-cert\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.787885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.787192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f76hh\" (UniqueName: \"kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-kube-api-access-f76hh\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.787885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.787464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-certs\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.787885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.787565    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-socket\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.787885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.787600    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-data\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.787885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.787683    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-credential-socket\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.788259 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.788234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istiod-ca-cert\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.789462 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.789440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-envoy\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.789692 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.789656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-podinfo\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.797000 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.796978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-token\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.797401 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.797384    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f76hh\" (UniqueName: \"kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-kube-api-access-f76hh\") pod \"e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") " pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.827583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.827559    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:00.859810 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.859210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5" event={"ID":"b409cdbb-0a61-4e3c-b81d-9752e9b57f03","Type":"ContainerStarted","Data":"1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3"}
Sep 19 09:26:00.859810 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.859269    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5" event={"ID":"b409cdbb-0a61-4e3c-b81d-9752e9b57f03","Type":"ContainerStarted","Data":"cc4c191044a6a1f38386bea67f5c4484f449c1da874c10a09454e76bb3104feb"}
Sep 19 09:26:00.859810 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.859327    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:26:00.883202 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:00.882737    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5" podStartSLOduration=1.8827178230000001 podStartE2EDuration="1.882717823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:25:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:26:00.880979551 +0000 UTC m=+1144.048174782" watchObservedRunningTime="2026-09-19 09:26:00.882717823 +0000 UTC m=+1144.049913052"
Sep 19 09:26:01.109964 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:01.109934    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"]
Sep 19 09:26:01.112065 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:26:01.111485    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c721d5_9132_45b7_bfe3_cf75c699c01c.slice/crio-9385ff88146a80c9d1dc6a105116a1b5605a782f3290566de0b8ef467f121c5c WatchSource:0}: Error finding container 9385ff88146a80c9d1dc6a105116a1b5605a782f3290566de0b8ef467f121c5c: Status 404 returned error can't find the container with id 9385ff88146a80c9d1dc6a105116a1b5605a782f3290566de0b8ef467f121c5c
Sep 19 09:26:01.117118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:01.117086    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:01.117191 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:01.117153    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:01.117191 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:01.117184    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:01.866179 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:01.866143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" event={"ID":"a9c721d5-9132-45b7-bfe3-cf75c699c01c","Type":"ContainerStarted","Data":"01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098"}
Sep 19 09:26:01.866368 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:01.866199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" event={"ID":"a9c721d5-9132-45b7-bfe3-cf75c699c01c","Type":"ContainerStarted","Data":"9385ff88146a80c9d1dc6a105116a1b5605a782f3290566de0b8ef467f121c5c"}
Sep 19 09:26:01.916392 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:01.916347    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" podStartSLOduration=1.9163297190000002 podStartE2EDuration="1.916329719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:26:01.916275329 +0000 UTC m=+1145.083470562" watchObservedRunningTime="2026-09-19 09:26:01.916329719 +0000 UTC m=+1145.083524949"
Sep 19 09:26:02.828512 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:02.828475    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:02.833781 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:02.833754    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:02.871981 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:02.871945    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:02.872908 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:02.872891    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:08.699303 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:08.699273    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"]
Sep 19 09:26:08.702690 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:08.702673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:26:08.704803 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:08.704786    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-0ce808\""
Sep 19 09:26:08.705003 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:08.704986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-0ce808-dockercfg-zkttz\""
Sep 19 09:26:08.715089 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:08.715067    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"]
Sep 19 09:26:08.778806 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:08.778710    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1e586dc-6e8e-4322-9d95-44d3c7e27397-plugins-config-volume\") pod \"payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5\" (UID: \"c1e586dc-6e8e-4322-9d95-44d3c7e27397\") " pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:26:08.778991 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:08.778887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nprks\" (UniqueName: \"kubernetes.io/projected/c1e586dc-6e8e-4322-9d95-44d3c7e27397-kube-api-access-nprks\") pod \"payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5\" (UID: \"c1e586dc-6e8e-4322-9d95-44d3c7e27397\") " pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:26:08.879607 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:08.879570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nprks\" (UniqueName: \"kubernetes.io/projected/c1e586dc-6e8e-4322-9d95-44d3c7e27397-kube-api-access-nprks\") pod \"payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5\" (UID: \"c1e586dc-6e8e-4322-9d95-44d3c7e27397\") " pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:26:08.879775 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:08.879664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1e586dc-6e8e-4322-9d95-44d3c7e27397-plugins-config-volume\") pod \"payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5\" (UID: \"c1e586dc-6e8e-4322-9d95-44d3c7e27397\") " pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:26:08.880414 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:08.880396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1e586dc-6e8e-4322-9d95-44d3c7e27397-plugins-config-volume\") pod \"payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5\" (UID: \"c1e586dc-6e8e-4322-9d95-44d3c7e27397\") " pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:26:08.888301 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:08.888273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nprks\" (UniqueName: \"kubernetes.io/projected/c1e586dc-6e8e-4322-9d95-44d3c7e27397-kube-api-access-nprks\") pod \"payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5\" (UID: \"c1e586dc-6e8e-4322-9d95-44d3c7e27397\") " pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:26:09.012934 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:09.012850    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:26:09.351043 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:09.350096    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"]
Sep 19 09:26:09.853998 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:09.853954    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:26:09.855192 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:09.855166    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:26:09.917041 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:09.914444    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5" event={"ID":"c1e586dc-6e8e-4322-9d95-44d3c7e27397","Type":"ContainerStarted","Data":"0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387"}
Sep 19 09:26:09.917041 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:09.914520    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5" event={"ID":"c1e586dc-6e8e-4322-9d95-44d3c7e27397","Type":"ContainerStarted","Data":"fdde6f10b0a8c88e4c0348df35c14031fc8fcb33578905da401d660bdf0e4fcc"}
Sep 19 09:26:09.917041 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:09.914763    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:26:10.001977 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:10.001907    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5" podStartSLOduration=2.001887334 podStartE2EDuration="2.001887334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:26:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:26:10.000424673 +0000 UTC m=+1153.167619914" watchObservedRunningTime="2026-09-19 09:26:10.001887334 +0000 UTC m=+1153.169082583"
Sep 19 09:26:10.888256 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:10.888225    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"]
Sep 19 09:26:10.892009 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:10.891984    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:10.894597 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:10.894576    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b272f719\""
Sep 19 09:26:10.894777 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:10.894597    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b272f719-dockercfg-x8x5p\""
Sep 19 09:26:10.903234 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:10.903212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d74bc323-3808-4621-a16c-53187a4ba45d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj\" (UID: \"d74bc323-3808-4621-a16c-53187a4ba45d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:10.903341 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:10.903247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnvh5\" (UniqueName: \"kubernetes.io/projected/d74bc323-3808-4621-a16c-53187a4ba45d-kube-api-access-cnvh5\") pod \"payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj\" (UID: \"d74bc323-3808-4621-a16c-53187a4ba45d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:10.911211 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:10.911186    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"]
Sep 19 09:26:11.006175 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:11.004982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d74bc323-3808-4621-a16c-53187a4ba45d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj\" (UID: \"d74bc323-3808-4621-a16c-53187a4ba45d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:11.006175 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:11.005080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnvh5\" (UniqueName: \"kubernetes.io/projected/d74bc323-3808-4621-a16c-53187a4ba45d-kube-api-access-cnvh5\") pod \"payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj\" (UID: \"d74bc323-3808-4621-a16c-53187a4ba45d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:11.006175 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:11.005894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d74bc323-3808-4621-a16c-53187a4ba45d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj\" (UID: \"d74bc323-3808-4621-a16c-53187a4ba45d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:11.020040 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:11.016812    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnvh5\" (UniqueName: \"kubernetes.io/projected/d74bc323-3808-4621-a16c-53187a4ba45d-kube-api-access-cnvh5\") pod \"payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj\" (UID: \"d74bc323-3808-4621-a16c-53187a4ba45d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:11.203454 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:11.203344    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:11.532721 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:11.532621    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"]
Sep 19 09:26:11.539398 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:26:11.539348    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74bc323_3808_4621_a16c_53187a4ba45d.slice/crio-38becb9b93621f101c1d6758dbe8824f18159d4de53d7e7d6e785626446e90bb WatchSource:0}: Error finding container 38becb9b93621f101c1d6758dbe8824f18159d4de53d7e7d6e785626446e90bb: Status 404 returned error can't find the container with id 38becb9b93621f101c1d6758dbe8824f18159d4de53d7e7d6e785626446e90bb
Sep 19 09:26:11.868243 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:11.868204    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:26:11.950042 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:11.941992    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj" event={"ID":"d74bc323-3808-4621-a16c-53187a4ba45d","Type":"ContainerStarted","Data":"a85e2cd57ae0245d5295ecdb5bb334ae05788383e4a5ec7361b363844fcd19f3"}
Sep 19 09:26:11.950042 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:11.942082    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj" event={"ID":"d74bc323-3808-4621-a16c-53187a4ba45d","Type":"ContainerStarted","Data":"38becb9b93621f101c1d6758dbe8824f18159d4de53d7e7d6e785626446e90bb"}
Sep 19 09:26:11.950042 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:11.942905    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:11.967043 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:11.966595    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj" podStartSLOduration=1.966559496 podStartE2EDuration="1.966559496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:26:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:26:11.96573105 +0000 UTC m=+1155.132926281" watchObservedRunningTime="2026-09-19 09:26:11.966559496 +0000 UTC m=+1155.133754749"
Sep 19 09:26:15.972877 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:15.972837    2579 generic.go:356] "Generic (PLEG): container finished" podID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerID="cad90ff321f8e2873f6ea6172cfcdb96a076749634244585d84ed01d29d99e05" exitCode=0
Sep 19 09:26:15.973397 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:15.972976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" event={"ID":"5fd4e9da-da12-46a7-b66a-5b27f042c08b","Type":"ContainerDied","Data":"cad90ff321f8e2873f6ea6172cfcdb96a076749634244585d84ed01d29d99e05"}
Sep 19 09:26:15.973536 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:15.973503    2579 scope.go:117] "RemoveContainer" containerID="cad90ff321f8e2873f6ea6172cfcdb96a076749634244585d84ed01d29d99e05"
Sep 19 09:26:15.974848 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:15.974816    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:15.974955 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:15.974936    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:15.975039 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:15.974996    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:16.980109 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:16.980073    2579 generic.go:356] "Generic (PLEG): container finished" podID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerID="2a169c784d46f6e4d1998260aa8f3de0a0557b60b44e10b7f9e9e0de5598ee07" exitCode=0
Sep 19 09:26:16.980575 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:16.980147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" event={"ID":"87ad42c5-4c31-479d-a58a-ef36ca1edbc1","Type":"ContainerDied","Data":"2a169c784d46f6e4d1998260aa8f3de0a0557b60b44e10b7f9e9e0de5598ee07"}
Sep 19 09:26:16.980644 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:16.980615    2579 scope.go:117] "RemoveContainer" containerID="2a169c784d46f6e4d1998260aa8f3de0a0557b60b44e10b7f9e9e0de5598ee07"
Sep 19 09:26:16.981826 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:16.981796    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:16.981918 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:16.981870    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:16.981918 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:16.981902    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:16.982199 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:16.982182    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" event={"ID":"5fd4e9da-da12-46a7-b66a-5b27f042c08b","Type":"ContainerStarted","Data":"0ff81a97848165047850392f17e2250af451c4ec506ffd826b550304b3358aec"}
Sep 19 09:26:17.585168 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:17.584920    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:26:17.585168 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:17.584989    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 19 09:26:17.585168 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:17.585081    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 19 09:26:18.016441 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:18.016343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" event={"ID":"87ad42c5-4c31-479d-a58a-ef36ca1edbc1","Type":"ContainerStarted","Data":"fa36c6443974a6d7a33bedf4c4ef0aae02bf18936bde13cf212146a3715d8838"}
Sep 19 09:26:18.401121 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:18.400662    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:26:18.401449 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:18.401073    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 19 09:26:18.401639 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:18.401607    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 19 09:26:18.585204 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:18.584720    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 19 09:26:18.585204 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:18.584785    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 19 09:26:19.400898 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:19.400863    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 19 09:26:19.401286 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:19.400922    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 19 09:26:19.584848 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:19.584816    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 19 09:26:19.585064 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:19.584865    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 19 09:26:20.402313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:20.401760    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 19 09:26:20.402313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:20.401856    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 19 09:26:20.583936 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:20.583895    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 19 09:26:20.584127 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:20.583977    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 19 09:26:20.929118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:20.928162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:26:21.400959 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:21.400915    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 19 09:26:21.401161 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:21.400983    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 19 09:26:21.584556 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:21.584516    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 19 09:26:21.584922 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:21.584602    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 19 09:26:22.400968 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.400923    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 19 09:26:22.401203 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.400976    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 19 09:26:22.584780 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.584741    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 19 09:26:22.585188 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.584797    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 19 09:26:22.936473 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.936432    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"]
Sep 19 09:26:22.944109 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.944079    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:26:22.949489 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.949208    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-c18110\""
Sep 19 09:26:22.949489 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.949431    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"]
Sep 19 09:26:22.973208 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.973169    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"]
Sep 19 09:26:22.973678 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.973652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs4dd\" (UniqueName: \"kubernetes.io/projected/39679ffb-7f6e-4eea-a612-d138cab85cd8-kube-api-access-vs4dd\") pod \"payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b\" (UID: \"39679ffb-7f6e-4eea-a612-d138cab85cd8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:26:22.973781 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.973719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39679ffb-7f6e-4eea-a612-d138cab85cd8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b\" (UID: \"39679ffb-7f6e-4eea-a612-d138cab85cd8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:26:22.977255 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.977233    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:26:22.983469 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.983449    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-c18110-dockercfg-49vw6\""
Sep 19 09:26:22.991804 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:22.991776    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"]
Sep 19 09:26:23.074404 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.074365    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs4dd\" (UniqueName: \"kubernetes.io/projected/39679ffb-7f6e-4eea-a612-d138cab85cd8-kube-api-access-vs4dd\") pod \"payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b\" (UID: \"39679ffb-7f6e-4eea-a612-d138cab85cd8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:26:23.074592 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.074410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39679ffb-7f6e-4eea-a612-d138cab85cd8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b\" (UID: \"39679ffb-7f6e-4eea-a612-d138cab85cd8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:26:23.074592 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.074498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be3d2d15-c604-42e2-877b-0a74f31c8843-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf\" (UID: \"be3d2d15-c604-42e2-877b-0a74f31c8843\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:26:23.074592 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.074524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvmrm\" (UniqueName: \"kubernetes.io/projected/be3d2d15-c604-42e2-877b-0a74f31c8843-kube-api-access-lvmrm\") pod \"payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf\" (UID: \"be3d2d15-c604-42e2-877b-0a74f31c8843\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:26:23.075192 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.075171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39679ffb-7f6e-4eea-a612-d138cab85cd8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b\" (UID: \"39679ffb-7f6e-4eea-a612-d138cab85cd8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:26:23.093004 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.092939    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs4dd\" (UniqueName: \"kubernetes.io/projected/39679ffb-7f6e-4eea-a612-d138cab85cd8-kube-api-access-vs4dd\") pod \"payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b\" (UID: \"39679ffb-7f6e-4eea-a612-d138cab85cd8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:26:23.175463 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.175431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be3d2d15-c604-42e2-877b-0a74f31c8843-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf\" (UID: \"be3d2d15-c604-42e2-877b-0a74f31c8843\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:26:23.175624 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.175473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvmrm\" (UniqueName: \"kubernetes.io/projected/be3d2d15-c604-42e2-877b-0a74f31c8843-kube-api-access-lvmrm\") pod \"payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf\" (UID: \"be3d2d15-c604-42e2-877b-0a74f31c8843\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:26:23.176099 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.176081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be3d2d15-c604-42e2-877b-0a74f31c8843-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf\" (UID: \"be3d2d15-c604-42e2-877b-0a74f31c8843\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:26:23.190820 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.190759    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvmrm\" (UniqueName: \"kubernetes.io/projected/be3d2d15-c604-42e2-877b-0a74f31c8843-kube-api-access-lvmrm\") pod \"payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf\" (UID: \"be3d2d15-c604-42e2-877b-0a74f31c8843\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:26:23.259284 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.259242    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:26:23.291293 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.291224    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:26:23.483443 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.483114    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:26:23.483747 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.483723    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:26:23.484721 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.484700    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:26:23.550667 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.550181    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"]
Sep 19 09:26:23.588294 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.588258    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:26:23.588812 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.588781    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:26:23.589666 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.589650    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:26:23.596459 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.596438    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"]
Sep 19 09:26:23.598509 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:26:23.598479    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3d2d15_c604_42e2_877b_0a74f31c8843.slice/crio-cfb5ad8e2908ccaff9effdbb78c374673165d2c57ce2ad5de3d4433296152156 WatchSource:0}: Error finding container cfb5ad8e2908ccaff9effdbb78c374673165d2c57ce2ad5de3d4433296152156: Status 404 returned error can't find the container with id cfb5ad8e2908ccaff9effdbb78c374673165d2c57ce2ad5de3d4433296152156
Sep 19 09:26:23.959895 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:23.959859    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:24.077311 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:24.077272    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf" event={"ID":"be3d2d15-c604-42e2-877b-0a74f31c8843","Type":"ContainerStarted","Data":"2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89"}
Sep 19 09:26:24.077484 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:24.077345    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:26:24.077484 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:24.077371    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf" event={"ID":"be3d2d15-c604-42e2-877b-0a74f31c8843","Type":"ContainerStarted","Data":"cfb5ad8e2908ccaff9effdbb78c374673165d2c57ce2ad5de3d4433296152156"}
Sep 19 09:26:24.078959 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:24.078934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b" event={"ID":"39679ffb-7f6e-4eea-a612-d138cab85cd8","Type":"ContainerStarted","Data":"a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71"}
Sep 19 09:26:24.079090 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:24.078982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b" event={"ID":"39679ffb-7f6e-4eea-a612-d138cab85cd8","Type":"ContainerStarted","Data":"e94ac5ca9582c0e731e8d9696902e40ff0d73585e248c7a01ed43eda9992956c"}
Sep 19 09:26:24.079325 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:24.079300    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:26:24.095871 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:24.095788    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf" podStartSLOduration=2.09577018 podStartE2EDuration="2.09577018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:26:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:26:24.092710008 +0000 UTC m=+1167.259905239" watchObservedRunningTime="2026-09-19 09:26:24.09577018 +0000 UTC m=+1167.262965412"
Sep 19 09:26:24.109892 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:24.109839    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b" podStartSLOduration=2.109821591 podStartE2EDuration="2.109821591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:26:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:26:24.108371 +0000 UTC m=+1167.275566231" watchObservedRunningTime="2026-09-19 09:26:24.109821591 +0000 UTC m=+1167.277016821"
Sep 19 09:26:25.086606 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:25.086574    2579 generic.go:356] "Generic (PLEG): container finished" podID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerID="01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098" exitCode=0
Sep 19 09:26:25.087140 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:25.086648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" event={"ID":"a9c721d5-9132-45b7-bfe3-cf75c699c01c","Type":"ContainerDied","Data":"01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098"}
Sep 19 09:26:25.087522 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:25.087506    2579 scope.go:117] "RemoveContainer" containerID="01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098"
Sep 19 09:26:25.088689 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:25.088665    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:25.088762 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:25.088730    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:25.088798 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:25.088762    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:26:26.095205 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:26.095172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" event={"ID":"a9c721d5-9132-45b7-bfe3-cf75c699c01c","Type":"ContainerStarted","Data":"1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc"}
Sep 19 09:26:26.828580 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:26.828542    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:26.828850 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:26.828821    2579 patch_prober.go:28] interesting pod/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 19 09:26:26.829092 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:26.829062    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 19 09:26:27.828633 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:27.828583    2579 patch_prober.go:28] interesting pod/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 19 09:26:27.829163 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:27.828657    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 19 09:26:28.828819 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:28.828769    2579 patch_prober.go:28] interesting pod/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 19 09:26:28.829331 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:28.828840    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 19 09:26:29.828595 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:29.828548    2579 patch_prober.go:28] interesting pod/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 19 09:26:29.828811 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:29.828624    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 19 09:26:30.828064 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:30.827998    2579 patch_prober.go:28] interesting pod/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 19 09:26:30.828703 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:30.828668    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 19 09:26:31.832455 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:31.832423    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:31.832890 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:31.832721    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:31.833538 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:31.833522    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:26:34.031371 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:34.031335    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"]
Sep 19 09:26:34.031803 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:34.031572    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj" podUID="d74bc323-3808-4621-a16c-53187a4ba45d" containerName="payload-pre-processing" containerID="cri-o://a85e2cd57ae0245d5295ecdb5bb334ae05788383e4a5ec7361b363844fcd19f3" gracePeriod=30
Sep 19 09:26:34.146199 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:34.146171    2579 generic.go:356] "Generic (PLEG): container finished" podID="d74bc323-3808-4621-a16c-53187a4ba45d" containerID="a85e2cd57ae0245d5295ecdb5bb334ae05788383e4a5ec7361b363844fcd19f3" exitCode=0
Sep 19 09:26:34.146309 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:34.146239    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj" event={"ID":"d74bc323-3808-4621-a16c-53187a4ba45d","Type":"ContainerDied","Data":"a85e2cd57ae0245d5295ecdb5bb334ae05788383e4a5ec7361b363844fcd19f3"}
Sep 19 09:26:34.281976 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:34.281911    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:34.403859 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:34.403822    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnvh5\" (UniqueName: \"kubernetes.io/projected/d74bc323-3808-4621-a16c-53187a4ba45d-kube-api-access-cnvh5\") pod \"d74bc323-3808-4621-a16c-53187a4ba45d\" (UID: \"d74bc323-3808-4621-a16c-53187a4ba45d\") "
Sep 19 09:26:34.404095 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:34.403972    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d74bc323-3808-4621-a16c-53187a4ba45d-plugins-config-volume\") pod \"d74bc323-3808-4621-a16c-53187a4ba45d\" (UID: \"d74bc323-3808-4621-a16c-53187a4ba45d\") "
Sep 19 09:26:34.404333 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:34.404309    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74bc323-3808-4621-a16c-53187a4ba45d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d74bc323-3808-4621-a16c-53187a4ba45d" (UID: "d74bc323-3808-4621-a16c-53187a4ba45d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:26:34.406231 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:34.406202    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74bc323-3808-4621-a16c-53187a4ba45d-kube-api-access-cnvh5" (OuterVolumeSpecName: "kube-api-access-cnvh5") pod "d74bc323-3808-4621-a16c-53187a4ba45d" (UID: "d74bc323-3808-4621-a16c-53187a4ba45d"). InnerVolumeSpecName "kube-api-access-cnvh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:26:34.505681 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:34.505645    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d74bc323-3808-4621-a16c-53187a4ba45d-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:26:34.505681 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:34.505676    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnvh5\" (UniqueName: \"kubernetes.io/projected/d74bc323-3808-4621-a16c-53187a4ba45d-kube-api-access-cnvh5\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:26:35.089842 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:35.089812    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:26:35.155837 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:35.155796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj" event={"ID":"d74bc323-3808-4621-a16c-53187a4ba45d","Type":"ContainerDied","Data":"38becb9b93621f101c1d6758dbe8824f18159d4de53d7e7d6e785626446e90bb"}
Sep 19 09:26:35.156035 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:35.155864    2579 scope.go:117] "RemoveContainer" containerID="a85e2cd57ae0245d5295ecdb5bb334ae05788383e4a5ec7361b363844fcd19f3"
Sep 19 09:26:35.156035 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:35.155809    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"
Sep 19 09:26:35.181558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:35.181525    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"]
Sep 19 09:26:35.189254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:35.189221    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b272f719-76fdb86dd6-prfmj"]
Sep 19 09:26:36.098400 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:36.098371    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:26:36.903565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:36.903529    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d74bc323-3808-4621-a16c-53187a4ba45d" path="/var/lib/kubelet/pods/d74bc323-3808-4621-a16c-53187a4ba45d/volumes"
Sep 19 09:26:58.913078 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:58.913048    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:26:58.914774 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:26:58.914755    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:27:08.361388 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.361351    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"]
Sep 19 09:27:08.361843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.361829    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74bc323-3808-4621-a16c-53187a4ba45d" containerName="payload-pre-processing"
Sep 19 09:27:08.361887 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.361844    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74bc323-3808-4621-a16c-53187a4ba45d" containerName="payload-pre-processing"
Sep 19 09:27:08.361931 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.361922    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74bc323-3808-4621-a16c-53187a4ba45d" containerName="payload-pre-processing"
Sep 19 09:27:08.366615 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.366599    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"
Sep 19 09:27:08.369280 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.369252    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:27:08.369924 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.369905    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:27:08.372458 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.372417    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"]
Sep 19 09:27:08.455537 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.455502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd88c39-b2ad-4bd2-9a2e-01ae5581b798-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w\" (UID: \"4bd88c39-b2ad-4bd2-9a2e-01ae5581b798\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"
Sep 19 09:27:08.556677 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.556647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd88c39-b2ad-4bd2-9a2e-01ae5581b798-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w\" (UID: \"4bd88c39-b2ad-4bd2-9a2e-01ae5581b798\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"
Sep 19 09:27:08.557266 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.557247    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd88c39-b2ad-4bd2-9a2e-01ae5581b798-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w\" (UID: \"4bd88c39-b2ad-4bd2-9a2e-01ae5581b798\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"
Sep 19 09:27:08.680042 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.679939    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"
Sep 19 09:27:08.957032 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.956993    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"]
Sep 19 09:27:08.959066 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:27:08.959042    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd88c39_b2ad_4bd2_9a2e_01ae5581b798.slice/crio-2d10440eb2f6884e61552c81edb72c43697bfac8f6e167945570597cb2fe1f13 WatchSource:0}: Error finding container 2d10440eb2f6884e61552c81edb72c43697bfac8f6e167945570597cb2fe1f13: Status 404 returned error can't find the container with id 2d10440eb2f6884e61552c81edb72c43697bfac8f6e167945570597cb2fe1f13
Sep 19 09:27:08.961067 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:08.961050    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 09:27:09.348393 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:09.348352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w" event={"ID":"4bd88c39-b2ad-4bd2-9a2e-01ae5581b798","Type":"ContainerStarted","Data":"2d10440eb2f6884e61552c81edb72c43697bfac8f6e167945570597cb2fe1f13"}
Sep 19 09:27:11.362932 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:11.362900    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w" event={"ID":"4bd88c39-b2ad-4bd2-9a2e-01ae5581b798","Type":"ContainerStarted","Data":"b60098c7f80509df12a0485892086bb90e1e83616aebf491fae91c60fd8bc98e"}
Sep 19 09:27:11.377655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:11.377608    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w" podStartSLOduration=1.382294309 podStartE2EDuration="3.377593354s" totalImagesPullingTime="1.995299045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:27:11.376216266 +0000 UTC m=+1214.543411490" watchObservedRunningTime="2026-09-19 09:27:11.377593354 +0000 UTC m=+1214.544788583"
Sep 19 09:27:12.369799 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:12.369760    2579 generic.go:356] "Generic (PLEG): container finished" podID="4bd88c39-b2ad-4bd2-9a2e-01ae5581b798" containerID="b60098c7f80509df12a0485892086bb90e1e83616aebf491fae91c60fd8bc98e" exitCode=0
Sep 19 09:27:12.370200 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:12.369846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w" event={"ID":"4bd88c39-b2ad-4bd2-9a2e-01ae5581b798","Type":"ContainerDied","Data":"b60098c7f80509df12a0485892086bb90e1e83616aebf491fae91c60fd8bc98e"}
Sep 19 09:27:13.521933 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:13.521902    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"
Sep 19 09:27:13.623332 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:13.623298    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd88c39-b2ad-4bd2-9a2e-01ae5581b798-maas-api-service-ca\") pod \"4bd88c39-b2ad-4bd2-9a2e-01ae5581b798\" (UID: \"4bd88c39-b2ad-4bd2-9a2e-01ae5581b798\") "
Sep 19 09:27:13.623630 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:13.623607    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd88c39-b2ad-4bd2-9a2e-01ae5581b798-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4bd88c39-b2ad-4bd2-9a2e-01ae5581b798" (UID: "4bd88c39-b2ad-4bd2-9a2e-01ae5581b798"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:27:13.724736 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:13.724624    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd88c39-b2ad-4bd2-9a2e-01ae5581b798-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:27:14.381448 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:14.381417    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w" event={"ID":"4bd88c39-b2ad-4bd2-9a2e-01ae5581b798","Type":"ContainerDied","Data":"2d10440eb2f6884e61552c81edb72c43697bfac8f6e167945570597cb2fe1f13"}
Sep 19 09:27:14.381448 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:14.381435    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"
Sep 19 09:27:14.381663 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:14.381466    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d10440eb2f6884e61552c81edb72c43697bfac8f6e167945570597cb2fe1f13"
Sep 19 09:27:20.676226 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:20.676185    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"]
Sep 19 09:27:20.678231 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:20.678210    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d6a0ebf6-kgs2w"]
Sep 19 09:27:20.903643 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:20.903605    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bd88c39-b2ad-4bd2-9a2e-01ae5581b798" path="/var/lib/kubelet/pods/4bd88c39-b2ad-4bd2-9a2e-01ae5581b798/volumes"
Sep 19 09:27:50.375571 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.375528    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"]
Sep 19 09:27:50.376031 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.376001    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd88c39-b2ad-4bd2-9a2e-01ae5581b798" containerName="revoke-keys"
Sep 19 09:27:50.376031 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.376029    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd88c39-b2ad-4bd2-9a2e-01ae5581b798" containerName="revoke-keys"
Sep 19 09:27:50.376118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.376108    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd88c39-b2ad-4bd2-9a2e-01ae5581b798" containerName="revoke-keys"
Sep 19 09:27:50.379286 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.379272    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"
Sep 19 09:27:50.382444 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.382422    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:27:50.382444 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.382433    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:27:50.387865 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.387840    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"]
Sep 19 09:27:50.420404 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.420365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3067e48a-56c4-43db-adbc-18bcbe58d6de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw\" (UID: \"3067e48a-56c4-43db-adbc-18bcbe58d6de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"
Sep 19 09:27:50.521137 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.521106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3067e48a-56c4-43db-adbc-18bcbe58d6de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw\" (UID: \"3067e48a-56c4-43db-adbc-18bcbe58d6de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"
Sep 19 09:27:50.521763 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.521745    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3067e48a-56c4-43db-adbc-18bcbe58d6de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw\" (UID: \"3067e48a-56c4-43db-adbc-18bcbe58d6de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"
Sep 19 09:27:50.690677 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.690642    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"
Sep 19 09:27:50.961903 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:50.961876    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"]
Sep 19 09:27:50.963915 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:27:50.963890    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3067e48a_56c4_43db_adbc_18bcbe58d6de.slice/crio-86d52db56a2ab426f59810162fd46a13a1cb3f8475eb2b7a4d0c112c3b920eb5 WatchSource:0}: Error finding container 86d52db56a2ab426f59810162fd46a13a1cb3f8475eb2b7a4d0c112c3b920eb5: Status 404 returned error can't find the container with id 86d52db56a2ab426f59810162fd46a13a1cb3f8475eb2b7a4d0c112c3b920eb5
Sep 19 09:27:51.606362 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:51.606329    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw" event={"ID":"3067e48a-56c4-43db-adbc-18bcbe58d6de","Type":"ContainerStarted","Data":"3002b04f4581b68defe72cfe37355d4f7d1f6ea3edf09a5257b75a2db9e89987"}
Sep 19 09:27:51.606746 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:51.606390    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw" event={"ID":"3067e48a-56c4-43db-adbc-18bcbe58d6de","Type":"ContainerStarted","Data":"86d52db56a2ab426f59810162fd46a13a1cb3f8475eb2b7a4d0c112c3b920eb5"}
Sep 19 09:27:51.623171 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:51.623121    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw" podStartSLOduration=1.623096845 podStartE2EDuration="1.623096845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:27:51.621659979 +0000 UTC m=+1254.788855209" watchObservedRunningTime="2026-09-19 09:27:51.623096845 +0000 UTC m=+1254.790292076"
Sep 19 09:27:52.613204 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:52.613168    2579 generic.go:356] "Generic (PLEG): container finished" podID="3067e48a-56c4-43db-adbc-18bcbe58d6de" containerID="3002b04f4581b68defe72cfe37355d4f7d1f6ea3edf09a5257b75a2db9e89987" exitCode=0
Sep 19 09:27:52.613636 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:52.613254    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw" event={"ID":"3067e48a-56c4-43db-adbc-18bcbe58d6de","Type":"ContainerDied","Data":"3002b04f4581b68defe72cfe37355d4f7d1f6ea3edf09a5257b75a2db9e89987"}
Sep 19 09:27:53.750262 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:53.750239    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"
Sep 19 09:27:53.855748 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:53.855714    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3067e48a-56c4-43db-adbc-18bcbe58d6de-maas-api-service-ca\") pod \"3067e48a-56c4-43db-adbc-18bcbe58d6de\" (UID: \"3067e48a-56c4-43db-adbc-18bcbe58d6de\") "
Sep 19 09:27:53.856102 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:53.856080    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3067e48a-56c4-43db-adbc-18bcbe58d6de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3067e48a-56c4-43db-adbc-18bcbe58d6de" (UID: "3067e48a-56c4-43db-adbc-18bcbe58d6de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:27:53.956793 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:53.956718    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3067e48a-56c4-43db-adbc-18bcbe58d6de-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:27:54.626537 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:54.626506    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"
Sep 19 09:27:54.626701 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:54.626537    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw" event={"ID":"3067e48a-56c4-43db-adbc-18bcbe58d6de","Type":"ContainerDied","Data":"86d52db56a2ab426f59810162fd46a13a1cb3f8475eb2b7a4d0c112c3b920eb5"}
Sep 19 09:27:54.626701 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:54.626584    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86d52db56a2ab426f59810162fd46a13a1cb3f8475eb2b7a4d0c112c3b920eb5"
Sep 19 09:27:56.444033 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:56.443985    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"]
Sep 19 09:27:56.449514 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:56.449490    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e596ff1-vcxbw"]
Sep 19 09:27:56.904313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:27:56.904279    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3067e48a-56c4-43db-adbc-18bcbe58d6de" path="/var/lib/kubelet/pods/3067e48a-56c4-43db-adbc-18bcbe58d6de/volumes"
Sep 19 09:28:03.896201 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:03.896164    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"]
Sep 19 09:28:03.896667 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:03.896653    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3067e48a-56c4-43db-adbc-18bcbe58d6de" containerName="revoke-keys"
Sep 19 09:28:03.896667 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:03.896668    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3067e48a-56c4-43db-adbc-18bcbe58d6de" containerName="revoke-keys"
Sep 19 09:28:03.896751 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:03.896742    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3067e48a-56c4-43db-adbc-18bcbe58d6de" containerName="revoke-keys"
Sep 19 09:28:03.902288 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:03.902258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:03.905350 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:03.905327    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-61e32580-dockercfg-dzbmj\""
Sep 19 09:28:03.905493 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:03.905334    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-61e32580\""
Sep 19 09:28:03.910719 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:03.910335    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"]
Sep 19 09:28:04.062616 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.062575    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/641b53cc-54a9-444c-83d1-7e1d483e53c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm\" (UID: \"641b53cc-54a9-444c-83d1-7e1d483e53c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:04.062616 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.062622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vgl4\" (UniqueName: \"kubernetes.io/projected/641b53cc-54a9-444c-83d1-7e1d483e53c5-kube-api-access-6vgl4\") pod \"payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm\" (UID: \"641b53cc-54a9-444c-83d1-7e1d483e53c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:04.163798 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.163699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/641b53cc-54a9-444c-83d1-7e1d483e53c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm\" (UID: \"641b53cc-54a9-444c-83d1-7e1d483e53c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:04.163798 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.163752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vgl4\" (UniqueName: \"kubernetes.io/projected/641b53cc-54a9-444c-83d1-7e1d483e53c5-kube-api-access-6vgl4\") pod \"payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm\" (UID: \"641b53cc-54a9-444c-83d1-7e1d483e53c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:04.164428 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.164409    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/641b53cc-54a9-444c-83d1-7e1d483e53c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm\" (UID: \"641b53cc-54a9-444c-83d1-7e1d483e53c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:04.173369 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.173346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vgl4\" (UniqueName: \"kubernetes.io/projected/641b53cc-54a9-444c-83d1-7e1d483e53c5-kube-api-access-6vgl4\") pod \"payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm\" (UID: \"641b53cc-54a9-444c-83d1-7e1d483e53c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:04.214920 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.214880    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:04.491315 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.491288    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"]
Sep 19 09:28:04.493123 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:28:04.493098    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641b53cc_54a9_444c_83d1_7e1d483e53c5.slice/crio-c398c71885e4fa8ee725fec00dfb3f67384af0d9fbce233e2d350584b80a8cef WatchSource:0}: Error finding container c398c71885e4fa8ee725fec00dfb3f67384af0d9fbce233e2d350584b80a8cef: Status 404 returned error can't find the container with id c398c71885e4fa8ee725fec00dfb3f67384af0d9fbce233e2d350584b80a8cef
Sep 19 09:28:04.684671 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.684637    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm" event={"ID":"641b53cc-54a9-444c-83d1-7e1d483e53c5","Type":"ContainerStarted","Data":"4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78"}
Sep 19 09:28:04.684842 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.684693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm" event={"ID":"641b53cc-54a9-444c-83d1-7e1d483e53c5","Type":"ContainerStarted","Data":"c398c71885e4fa8ee725fec00dfb3f67384af0d9fbce233e2d350584b80a8cef"}
Sep 19 09:28:04.684842 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.684715    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:04.705299 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:04.705245    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm" podStartSLOduration=1.705229428 podStartE2EDuration="1.705229428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:28:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:28:04.702427297 +0000 UTC m=+1267.869622527" watchObservedRunningTime="2026-09-19 09:28:04.705229428 +0000 UTC m=+1267.872424657"
Sep 19 09:28:06.947410 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:06.947372    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"]
Sep 19 09:28:06.951619 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:06.951600    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"
Sep 19 09:28:06.953943 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:06.953922    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:28:06.954050 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:06.953925    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:28:06.957888 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:06.957864    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"]
Sep 19 09:28:07.095133 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:07.095097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f933d5e1-1479-4d51-96fd-24727cba5f0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-0ce808-dmqkz\" (UID: \"f933d5e1-1479-4d51-96fd-24727cba5f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"
Sep 19 09:28:07.196631 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:07.196584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f933d5e1-1479-4d51-96fd-24727cba5f0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-0ce808-dmqkz\" (UID: \"f933d5e1-1479-4d51-96fd-24727cba5f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"
Sep 19 09:28:07.197280 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:07.197263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f933d5e1-1479-4d51-96fd-24727cba5f0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-0ce808-dmqkz\" (UID: \"f933d5e1-1479-4d51-96fd-24727cba5f0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"
Sep 19 09:28:07.264403 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:07.264312    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"
Sep 19 09:28:07.548873 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:07.548847    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"]
Sep 19 09:28:07.550819 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:28:07.550794    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf933d5e1_1479_4d51_96fd_24727cba5f0d.slice/crio-c2ae42bf11cb9a9148bb0f9aa2c7d651b69bb86cf6707245b8819bd954e762a1 WatchSource:0}: Error finding container c2ae42bf11cb9a9148bb0f9aa2c7d651b69bb86cf6707245b8819bd954e762a1: Status 404 returned error can't find the container with id c2ae42bf11cb9a9148bb0f9aa2c7d651b69bb86cf6707245b8819bd954e762a1
Sep 19 09:28:07.702387 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:07.702349    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz" event={"ID":"f933d5e1-1479-4d51-96fd-24727cba5f0d","Type":"ContainerStarted","Data":"c2ae42bf11cb9a9148bb0f9aa2c7d651b69bb86cf6707245b8819bd954e762a1"}
Sep 19 09:28:08.709921 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:08.709834    2579 generic.go:356] "Generic (PLEG): container finished" podID="f933d5e1-1479-4d51-96fd-24727cba5f0d" containerID="6e855c1a73faba024adfd9355472ab6ff5f987856814ea9c6e1f223f6d909340" exitCode=0
Sep 19 09:28:08.710301 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:08.709923    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz" event={"ID":"f933d5e1-1479-4d51-96fd-24727cba5f0d","Type":"ContainerDied","Data":"6e855c1a73faba024adfd9355472ab6ff5f987856814ea9c6e1f223f6d909340"}
Sep 19 09:28:09.850305 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:09.850278    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"
Sep 19 09:28:10.026592 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:10.026508    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f933d5e1-1479-4d51-96fd-24727cba5f0d-maas-api-service-ca\") pod \"f933d5e1-1479-4d51-96fd-24727cba5f0d\" (UID: \"f933d5e1-1479-4d51-96fd-24727cba5f0d\") "
Sep 19 09:28:10.026866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:10.026841    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f933d5e1-1479-4d51-96fd-24727cba5f0d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f933d5e1-1479-4d51-96fd-24727cba5f0d" (UID: "f933d5e1-1479-4d51-96fd-24727cba5f0d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:28:10.127991 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:10.127958    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f933d5e1-1479-4d51-96fd-24727cba5f0d-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:28:10.722130 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:10.722100    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"
Sep 19 09:28:10.722299 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:10.722128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz" event={"ID":"f933d5e1-1479-4d51-96fd-24727cba5f0d","Type":"ContainerDied","Data":"c2ae42bf11cb9a9148bb0f9aa2c7d651b69bb86cf6707245b8819bd954e762a1"}
Sep 19 09:28:10.722299 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:10.722176    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2ae42bf11cb9a9148bb0f9aa2c7d651b69bb86cf6707245b8819bd954e762a1"
Sep 19 09:28:15.552463 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.552426    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"]
Sep 19 09:28:15.552899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.552886    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f933d5e1-1479-4d51-96fd-24727cba5f0d" containerName="revoke-keys"
Sep 19 09:28:15.552899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.552900    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f933d5e1-1479-4d51-96fd-24727cba5f0d" containerName="revoke-keys"
Sep 19 09:28:15.552983 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.552973    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f933d5e1-1479-4d51-96fd-24727cba5f0d" containerName="revoke-keys"
Sep 19 09:28:15.556310 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.556294    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"
Sep 19 09:28:15.558727 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.558709    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:28:15.560366 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.560350    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:28:15.570895 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.570871    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"]
Sep 19 09:28:15.582470 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.582446    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a94e3ed4-0933-4210-8da7-fd41c7473375-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-61e32580-5jvt6\" (UID: \"a94e3ed4-0933-4210-8da7-fd41c7473375\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"
Sep 19 09:28:15.683671 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.683634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a94e3ed4-0933-4210-8da7-fd41c7473375-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-61e32580-5jvt6\" (UID: \"a94e3ed4-0933-4210-8da7-fd41c7473375\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"
Sep 19 09:28:15.684321 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.684299    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a94e3ed4-0933-4210-8da7-fd41c7473375-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-61e32580-5jvt6\" (UID: \"a94e3ed4-0933-4210-8da7-fd41c7473375\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"
Sep 19 09:28:15.692042 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.691997    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:15.866811 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:15.866725    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"
Sep 19 09:28:16.143492 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:16.143408    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"]
Sep 19 09:28:16.146842 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:28:16.146813    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94e3ed4_0933_4210_8da7_fd41c7473375.slice/crio-1d377a85eed9d589e69eb72e7343c3cd04cc5e55319deffb9380aab738aa5eb2 WatchSource:0}: Error finding container 1d377a85eed9d589e69eb72e7343c3cd04cc5e55319deffb9380aab738aa5eb2: Status 404 returned error can't find the container with id 1d377a85eed9d589e69eb72e7343c3cd04cc5e55319deffb9380aab738aa5eb2
Sep 19 09:28:16.757278 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:16.757174    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6" event={"ID":"a94e3ed4-0933-4210-8da7-fd41c7473375","Type":"ContainerStarted","Data":"98f4e478ed9d42c904a343dc6cca199389d85c643fd802bf748e6d4a8c5a9097"}
Sep 19 09:28:16.757278 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:16.757240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6" event={"ID":"a94e3ed4-0933-4210-8da7-fd41c7473375","Type":"ContainerStarted","Data":"1d377a85eed9d589e69eb72e7343c3cd04cc5e55319deffb9380aab738aa5eb2"}
Sep 19 09:28:16.782800 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:16.782747    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6" podStartSLOduration=1.7827302820000002 podStartE2EDuration="1.782730282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:28:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:28:16.781583445 +0000 UTC m=+1279.948778702" watchObservedRunningTime="2026-09-19 09:28:16.782730282 +0000 UTC m=+1279.949925512"
Sep 19 09:28:17.337493 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.337456    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"]
Sep 19 09:28:17.337715 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.337673    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5" podUID="c1e586dc-6e8e-4322-9d95-44d3c7e27397" containerName="payload-processing" containerID="cri-o://0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387" gracePeriod=30
Sep 19 09:28:17.614733 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.614708    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:28:17.704808 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.704775    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nprks\" (UniqueName: \"kubernetes.io/projected/c1e586dc-6e8e-4322-9d95-44d3c7e27397-kube-api-access-nprks\") pod \"c1e586dc-6e8e-4322-9d95-44d3c7e27397\" (UID: \"c1e586dc-6e8e-4322-9d95-44d3c7e27397\") "
Sep 19 09:28:17.704957 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.704940    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1e586dc-6e8e-4322-9d95-44d3c7e27397-plugins-config-volume\") pod \"c1e586dc-6e8e-4322-9d95-44d3c7e27397\" (UID: \"c1e586dc-6e8e-4322-9d95-44d3c7e27397\") "
Sep 19 09:28:17.705373 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.705340    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1e586dc-6e8e-4322-9d95-44d3c7e27397-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c1e586dc-6e8e-4322-9d95-44d3c7e27397" (UID: "c1e586dc-6e8e-4322-9d95-44d3c7e27397"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:28:17.706924 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.706901    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e586dc-6e8e-4322-9d95-44d3c7e27397-kube-api-access-nprks" (OuterVolumeSpecName: "kube-api-access-nprks") pod "c1e586dc-6e8e-4322-9d95-44d3c7e27397" (UID: "c1e586dc-6e8e-4322-9d95-44d3c7e27397"). InnerVolumeSpecName "kube-api-access-nprks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:28:17.756116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.756078    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"]
Sep 19 09:28:17.758678 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.758636    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ce808-dmqkz"]
Sep 19 09:28:17.766978 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.766948    2579 generic.go:356] "Generic (PLEG): container finished" podID="c1e586dc-6e8e-4322-9d95-44d3c7e27397" containerID="0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387" exitCode=0
Sep 19 09:28:17.767154 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.766989    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"
Sep 19 09:28:17.767154 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.767033    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5" event={"ID":"c1e586dc-6e8e-4322-9d95-44d3c7e27397","Type":"ContainerDied","Data":"0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387"}
Sep 19 09:28:17.767154 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.767092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5" event={"ID":"c1e586dc-6e8e-4322-9d95-44d3c7e27397","Type":"ContainerDied","Data":"fdde6f10b0a8c88e4c0348df35c14031fc8fcb33578905da401d660bdf0e4fcc"}
Sep 19 09:28:17.767154 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.767118    2579 scope.go:117] "RemoveContainer" containerID="0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387"
Sep 19 09:28:17.768735 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.768712    2579 generic.go:356] "Generic (PLEG): container finished" podID="a94e3ed4-0933-4210-8da7-fd41c7473375" containerID="98f4e478ed9d42c904a343dc6cca199389d85c643fd802bf748e6d4a8c5a9097" exitCode=0
Sep 19 09:28:17.768831 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.768747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6" event={"ID":"a94e3ed4-0933-4210-8da7-fd41c7473375","Type":"ContainerDied","Data":"98f4e478ed9d42c904a343dc6cca199389d85c643fd802bf748e6d4a8c5a9097"}
Sep 19 09:28:17.776427 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.776411    2579 scope.go:117] "RemoveContainer" containerID="0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387"
Sep 19 09:28:17.776750 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:28:17.776721    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387\": container with ID starting with 0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387 not found: ID does not exist" containerID="0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387"
Sep 19 09:28:17.776802 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.776753    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387"} err="failed to get container status \"0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387\": rpc error: code = NotFound desc = could not find container \"0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387\": container with ID starting with 0c8149d5f6025bc7403734791c5cd33eaaa92d9d0ad02f24c08ea8cd5a094387 not found: ID does not exist"
Sep 19 09:28:17.804933 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.804904    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"]
Sep 19 09:28:17.805978 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.805956    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nprks\" (UniqueName: \"kubernetes.io/projected/c1e586dc-6e8e-4322-9d95-44d3c7e27397-kube-api-access-nprks\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:28:17.806097 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.805981    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1e586dc-6e8e-4322-9d95-44d3c7e27397-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:28:17.811442 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:17.811418    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ce808-7f4ccb5d49-wd9n5"]
Sep 19 09:28:18.904549 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:18.904518    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1e586dc-6e8e-4322-9d95-44d3c7e27397" path="/var/lib/kubelet/pods/c1e586dc-6e8e-4322-9d95-44d3c7e27397/volumes"
Sep 19 09:28:18.905072 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:18.905053    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f933d5e1-1479-4d51-96fd-24727cba5f0d" path="/var/lib/kubelet/pods/f933d5e1-1479-4d51-96fd-24727cba5f0d/volumes"
Sep 19 09:28:18.919003 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:18.918982    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"
Sep 19 09:28:19.017539 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:19.017501    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a94e3ed4-0933-4210-8da7-fd41c7473375-maas-api-service-ca\") pod \"a94e3ed4-0933-4210-8da7-fd41c7473375\" (UID: \"a94e3ed4-0933-4210-8da7-fd41c7473375\") "
Sep 19 09:28:19.017870 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:19.017846    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a94e3ed4-0933-4210-8da7-fd41c7473375-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a94e3ed4-0933-4210-8da7-fd41c7473375" (UID: "a94e3ed4-0933-4210-8da7-fd41c7473375"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:28:19.118781 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:19.118739    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a94e3ed4-0933-4210-8da7-fd41c7473375-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:28:19.782869 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:19.782837    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"
Sep 19 09:28:19.783063 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:19.782875    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6" event={"ID":"a94e3ed4-0933-4210-8da7-fd41c7473375","Type":"ContainerDied","Data":"1d377a85eed9d589e69eb72e7343c3cd04cc5e55319deffb9380aab738aa5eb2"}
Sep 19 09:28:19.783063 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:19.782952    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d377a85eed9d589e69eb72e7343c3cd04cc5e55319deffb9380aab738aa5eb2"
Sep 19 09:28:26.115565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.115532    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"]
Sep 19 09:28:26.115998 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.115772    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm" podUID="641b53cc-54a9-444c-83d1-7e1d483e53c5" containerName="payload-pre-processing" containerID="cri-o://4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78" gracePeriod=30
Sep 19 09:28:26.288805 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.288776    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"]
Sep 19 09:28:26.293293 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.293261    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61e32580-5jvt6"]
Sep 19 09:28:26.391137 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.390994    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:26.507510 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.507479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/641b53cc-54a9-444c-83d1-7e1d483e53c5-plugins-config-volume\") pod \"641b53cc-54a9-444c-83d1-7e1d483e53c5\" (UID: \"641b53cc-54a9-444c-83d1-7e1d483e53c5\") "
Sep 19 09:28:26.507675 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.507518    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vgl4\" (UniqueName: \"kubernetes.io/projected/641b53cc-54a9-444c-83d1-7e1d483e53c5-kube-api-access-6vgl4\") pod \"641b53cc-54a9-444c-83d1-7e1d483e53c5\" (UID: \"641b53cc-54a9-444c-83d1-7e1d483e53c5\") "
Sep 19 09:28:26.507955 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.507926    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/641b53cc-54a9-444c-83d1-7e1d483e53c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "641b53cc-54a9-444c-83d1-7e1d483e53c5" (UID: "641b53cc-54a9-444c-83d1-7e1d483e53c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:28:26.509736 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.509713    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641b53cc-54a9-444c-83d1-7e1d483e53c5-kube-api-access-6vgl4" (OuterVolumeSpecName: "kube-api-access-6vgl4") pod "641b53cc-54a9-444c-83d1-7e1d483e53c5" (UID: "641b53cc-54a9-444c-83d1-7e1d483e53c5"). InnerVolumeSpecName "kube-api-access-6vgl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:28:26.608749 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.608708    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/641b53cc-54a9-444c-83d1-7e1d483e53c5-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:28:26.608749 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.608742    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vgl4\" (UniqueName: \"kubernetes.io/projected/641b53cc-54a9-444c-83d1-7e1d483e53c5-kube-api-access-6vgl4\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:28:26.824688 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.824647    2579 generic.go:356] "Generic (PLEG): container finished" podID="641b53cc-54a9-444c-83d1-7e1d483e53c5" containerID="4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78" exitCode=0
Sep 19 09:28:26.824688 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.824686    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"
Sep 19 09:28:26.824896 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.824734    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm" event={"ID":"641b53cc-54a9-444c-83d1-7e1d483e53c5","Type":"ContainerDied","Data":"4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78"}
Sep 19 09:28:26.824896 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.824785    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm" event={"ID":"641b53cc-54a9-444c-83d1-7e1d483e53c5","Type":"ContainerDied","Data":"c398c71885e4fa8ee725fec00dfb3f67384af0d9fbce233e2d350584b80a8cef"}
Sep 19 09:28:26.824896 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.824811    2579 scope.go:117] "RemoveContainer" containerID="4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78"
Sep 19 09:28:26.833962 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.833945    2579 scope.go:117] "RemoveContainer" containerID="4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78"
Sep 19 09:28:26.834232 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:28:26.834214    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78\": container with ID starting with 4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78 not found: ID does not exist" containerID="4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78"
Sep 19 09:28:26.834289 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.834243    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78"} err="failed to get container status \"4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78\": rpc error: code = NotFound desc = could not find container \"4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78\": container with ID starting with 4f40febea30f232ca8be53ea4598a16e66d88e16b5ca15b62af8f7eda9b0cb78 not found: ID does not exist"
Sep 19 09:28:26.861357 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.861327    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"]
Sep 19 09:28:26.877007 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.876977    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-61e32580-795db898f8-pvzsm"]
Sep 19 09:28:26.903905 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.903878    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="641b53cc-54a9-444c-83d1-7e1d483e53c5" path="/var/lib/kubelet/pods/641b53cc-54a9-444c-83d1-7e1d483e53c5/volumes"
Sep 19 09:28:26.904296 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:28:26.904282    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a94e3ed4-0933-4210-8da7-fd41c7473375" path="/var/lib/kubelet/pods/a94e3ed4-0933-4210-8da7-fd41c7473375/volumes"
Sep 19 09:29:23.626598 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:23.626522    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"]
Sep 19 09:29:23.627094 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:23.626741    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy" containerID="cri-o://1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc" gracePeriod=30
Sep 19 09:29:28.871309 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.871283    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:29:28.943356 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943274    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-credential-socket\") pod \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") "
Sep 19 09:29:28.943522 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943367    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f76hh\" (UniqueName: \"kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-kube-api-access-f76hh\") pod \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") "
Sep 19 09:29:28.943522 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943398    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-podinfo\") pod \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") "
Sep 19 09:29:28.943654 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943554    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a9c721d5-9132-45b7-bfe3-cf75c699c01c" (UID: "a9c721d5-9132-45b7-bfe3-cf75c699c01c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:29:28.943654 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943569    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-socket\") pod \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") "
Sep 19 09:29:28.943654 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943607    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-data\") pod \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") "
Sep 19 09:29:28.943654 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943639    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-certs\") pod \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") "
Sep 19 09:29:28.943856 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943668    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istiod-ca-cert\") pod \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") "
Sep 19 09:29:28.943856 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943701    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-token\") pod \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") "
Sep 19 09:29:28.943856 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943820    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a9c721d5-9132-45b7-bfe3-cf75c699c01c" (UID: "a9c721d5-9132-45b7-bfe3-cf75c699c01c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:29:28.943856 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943842    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a9c721d5-9132-45b7-bfe3-cf75c699c01c" (UID: "a9c721d5-9132-45b7-bfe3-cf75c699c01c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:29:28.944080 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943855    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-envoy\") pod \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\" (UID: \"a9c721d5-9132-45b7-bfe3-cf75c699c01c\") "
Sep 19 09:29:28.944080 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.943905    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a9c721d5-9132-45b7-bfe3-cf75c699c01c" (UID: "a9c721d5-9132-45b7-bfe3-cf75c699c01c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:29:28.944318 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.944206    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a9c721d5-9132-45b7-bfe3-cf75c699c01c" (UID: "a9c721d5-9132-45b7-bfe3-cf75c699c01c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:29:28.944814 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.944492    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-socket\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:28.944814 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.944517    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-data\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:28.944814 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.944533    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-workload-certs\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:28.944814 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.944545    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istiod-ca-cert\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:28.944814 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.944569    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-credential-socket\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:28.945987 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.945964    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a9c721d5-9132-45b7-bfe3-cf75c699c01c" (UID: "a9c721d5-9132-45b7-bfe3-cf75c699c01c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:29:28.946091 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.945969    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-kube-api-access-f76hh" (OuterVolumeSpecName: "kube-api-access-f76hh") pod "a9c721d5-9132-45b7-bfe3-cf75c699c01c" (UID: "a9c721d5-9132-45b7-bfe3-cf75c699c01c"). InnerVolumeSpecName "kube-api-access-f76hh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:29:28.946230 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.946211    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a9c721d5-9132-45b7-bfe3-cf75c699c01c" (UID: "a9c721d5-9132-45b7-bfe3-cf75c699c01c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 09:29:28.946381 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:28.946365    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a9c721d5-9132-45b7-bfe3-cf75c699c01c" (UID: "a9c721d5-9132-45b7-bfe3-cf75c699c01c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:29:29.046150 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.046114    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-envoy\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:29.046150 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.046144    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f76hh\" (UniqueName: \"kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-kube-api-access-f76hh\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:29.046150 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.046153    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-podinfo\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:29.046409 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.046161    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9c721d5-9132-45b7-bfe3-cf75c699c01c-istio-token\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:29.171897 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.171866    2579 generic.go:356] "Generic (PLEG): container finished" podID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerID="1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc" exitCode=0
Sep 19 09:29:29.172084 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.171914    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"
Sep 19 09:29:29.172084 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.171944    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" event={"ID":"a9c721d5-9132-45b7-bfe3-cf75c699c01c","Type":"ContainerDied","Data":"1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc"}
Sep 19 09:29:29.172084 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.171996    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv" event={"ID":"a9c721d5-9132-45b7-bfe3-cf75c699c01c","Type":"ContainerDied","Data":"9385ff88146a80c9d1dc6a105116a1b5605a782f3290566de0b8ef467f121c5c"}
Sep 19 09:29:29.172084 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.172040    2579 scope.go:117] "RemoveContainer" containerID="1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc"
Sep 19 09:29:29.183836 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.183815    2579 scope.go:117] "RemoveContainer" containerID="01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098"
Sep 19 09:29:29.192319 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.192303    2579 scope.go:117] "RemoveContainer" containerID="1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc"
Sep 19 09:29:29.192578 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:29:29.192563    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc\": container with ID starting with 1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc not found: ID does not exist" containerID="1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc"
Sep 19 09:29:29.192626 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.192586    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc"} err="failed to get container status \"1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc\": rpc error: code = NotFound desc = could not find container \"1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc\": container with ID starting with 1e78c6bb2c29a910f28bcc0e2149610be3276b248348deac975aa8e3820ae6fc not found: ID does not exist"
Sep 19 09:29:29.192626 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.192600    2579 scope.go:117] "RemoveContainer" containerID="01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098"
Sep 19 09:29:29.192837 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:29:29.192820    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098\": container with ID starting with 01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098 not found: ID does not exist" containerID="01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098"
Sep 19 09:29:29.192873 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.192840    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098"} err="failed to get container status \"01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098\": rpc error: code = NotFound desc = could not find container \"01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098\": container with ID starting with 01bf62b41c9bf068063d64a670ce6f1e5ce4c040ce0ac55e989e377b82221098 not found: ID does not exist"
Sep 19 09:29:29.200440 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.200388    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"]
Sep 19 09:29:29.205692 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:29.205671    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-0ce808-openshift-default-5574f6ccbb-6pzhv"]
Sep 19 09:29:30.903753 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:30.903717    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" path="/var/lib/kubelet/pods/a9c721d5-9132-45b7-bfe3-cf75c699c01c/volumes"
Sep 19 09:29:31.919300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919266    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"]
Sep 19 09:29:31.919709 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919697    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy"
Sep 19 09:29:31.919755 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919710    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy"
Sep 19 09:29:31.919755 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919725    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e586dc-6e8e-4322-9d95-44d3c7e27397" containerName="payload-processing"
Sep 19 09:29:31.919755 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919732    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e586dc-6e8e-4322-9d95-44d3c7e27397" containerName="payload-processing"
Sep 19 09:29:31.919755 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919741    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="641b53cc-54a9-444c-83d1-7e1d483e53c5" containerName="payload-pre-processing"
Sep 19 09:29:31.919755 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919746    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="641b53cc-54a9-444c-83d1-7e1d483e53c5" containerName="payload-pre-processing"
Sep 19 09:29:31.919755 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919755    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a94e3ed4-0933-4210-8da7-fd41c7473375" containerName="revoke-keys"
Sep 19 09:29:31.919947 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919760    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a94e3ed4-0933-4210-8da7-fd41c7473375" containerName="revoke-keys"
Sep 19 09:29:31.919947 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919771    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy"
Sep 19 09:29:31.919947 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919777    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy"
Sep 19 09:29:31.919947 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919856    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e586dc-6e8e-4322-9d95-44d3c7e27397" containerName="payload-processing"
Sep 19 09:29:31.919947 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919862    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="641b53cc-54a9-444c-83d1-7e1d483e53c5" containerName="payload-pre-processing"
Sep 19 09:29:31.919947 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919867    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a94e3ed4-0933-4210-8da7-fd41c7473375" containerName="revoke-keys"
Sep 19 09:29:31.919947 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919873    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy"
Sep 19 09:29:31.919947 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.919880    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9c721d5-9132-45b7-bfe3-cf75c699c01c" containerName="istio-proxy"
Sep 19 09:29:31.924575 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.924555    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:29:31.927168 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.927149    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-ac387c-dockercfg-d94q5\""
Sep 19 09:29:31.927338 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.927317    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-ac387c\""
Sep 19 09:29:31.938296 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.938267    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"]
Sep 19 09:29:31.977119 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.977091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a869b29-6811-4468-abef-f6a23c67a462-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp\" (UID: \"6a869b29-6811-4468-abef-f6a23c67a462\") " pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:29:31.977279 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:31.977200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkttf\" (UniqueName: \"kubernetes.io/projected/6a869b29-6811-4468-abef-f6a23c67a462-kube-api-access-pkttf\") pod \"payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp\" (UID: \"6a869b29-6811-4468-abef-f6a23c67a462\") " pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:29:32.078699 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.078662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkttf\" (UniqueName: \"kubernetes.io/projected/6a869b29-6811-4468-abef-f6a23c67a462-kube-api-access-pkttf\") pod \"payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp\" (UID: \"6a869b29-6811-4468-abef-f6a23c67a462\") " pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:29:32.078872 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.078726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a869b29-6811-4468-abef-f6a23c67a462-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp\" (UID: \"6a869b29-6811-4468-abef-f6a23c67a462\") " pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:29:32.079407 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.079389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a869b29-6811-4468-abef-f6a23c67a462-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp\" (UID: \"6a869b29-6811-4468-abef-f6a23c67a462\") " pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:29:32.093941 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.093919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkttf\" (UniqueName: \"kubernetes.io/projected/6a869b29-6811-4468-abef-f6a23c67a462-kube-api-access-pkttf\") pod \"payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp\" (UID: \"6a869b29-6811-4468-abef-f6a23c67a462\") " pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:29:32.237177 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.237097    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:29:32.372180 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.372147    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"]
Sep 19 09:29:32.372451 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.372404    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5" podUID="b409cdbb-0a61-4e3c-b81d-9752e9b57f03" containerName="payload-pre-processing" containerID="cri-o://1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3" gracePeriod=30
Sep 19 09:29:32.523420 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.523380    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"]
Sep 19 09:29:32.628963 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.628939    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:29:32.685036 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.684481    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25lp8\" (UniqueName: \"kubernetes.io/projected/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-kube-api-access-25lp8\") pod \"b409cdbb-0a61-4e3c-b81d-9752e9b57f03\" (UID: \"b409cdbb-0a61-4e3c-b81d-9752e9b57f03\") "
Sep 19 09:29:32.685036 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.684543    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-plugins-config-volume\") pod \"b409cdbb-0a61-4e3c-b81d-9752e9b57f03\" (UID: \"b409cdbb-0a61-4e3c-b81d-9752e9b57f03\") "
Sep 19 09:29:32.686258 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.685378    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b409cdbb-0a61-4e3c-b81d-9752e9b57f03" (UID: "b409cdbb-0a61-4e3c-b81d-9752e9b57f03"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:29:32.690110 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.690066    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-kube-api-access-25lp8" (OuterVolumeSpecName: "kube-api-access-25lp8") pod "b409cdbb-0a61-4e3c-b81d-9752e9b57f03" (UID: "b409cdbb-0a61-4e3c-b81d-9752e9b57f03"). InnerVolumeSpecName "kube-api-access-25lp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:29:32.786507 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.786418    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25lp8\" (UniqueName: \"kubernetes.io/projected/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-kube-api-access-25lp8\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:32.786507 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:32.786450    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b409cdbb-0a61-4e3c-b81d-9752e9b57f03-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:33.196987 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.196953    2579 generic.go:356] "Generic (PLEG): container finished" podID="b409cdbb-0a61-4e3c-b81d-9752e9b57f03" containerID="1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3" exitCode=0
Sep 19 09:29:33.197442 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.197031    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"
Sep 19 09:29:33.197442 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.197052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5" event={"ID":"b409cdbb-0a61-4e3c-b81d-9752e9b57f03","Type":"ContainerDied","Data":"1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3"}
Sep 19 09:29:33.197442 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.197114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5" event={"ID":"b409cdbb-0a61-4e3c-b81d-9752e9b57f03","Type":"ContainerDied","Data":"cc4c191044a6a1f38386bea67f5c4484f449c1da874c10a09454e76bb3104feb"}
Sep 19 09:29:33.197442 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.197147    2579 scope.go:117] "RemoveContainer" containerID="1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3"
Sep 19 09:29:33.198990 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.198957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp" event={"ID":"6a869b29-6811-4468-abef-f6a23c67a462","Type":"ContainerStarted","Data":"454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249"}
Sep 19 09:29:33.199107 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.199003    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp" event={"ID":"6a869b29-6811-4468-abef-f6a23c67a462","Type":"ContainerStarted","Data":"fa8b6e057e51888a1f185a4e5e056dceff0c5c1af76ddc920a20bb044ba390ab"}
Sep 19 09:29:33.199180 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.199130    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:29:33.206920 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.206897    2579 scope.go:117] "RemoveContainer" containerID="1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3"
Sep 19 09:29:33.207197 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:29:33.207180    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3\": container with ID starting with 1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3 not found: ID does not exist" containerID="1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3"
Sep 19 09:29:33.207264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.207213    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3"} err="failed to get container status \"1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3\": rpc error: code = NotFound desc = could not find container \"1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3\": container with ID starting with 1e494c59712899162119a7cf01a7303c7bf78c421cbc1657905548c9bf6a64f3 not found: ID does not exist"
Sep 19 09:29:33.212843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.212822    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"]
Sep 19 09:29:33.217505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.217485    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-acc640-b99578578-qnfj5"]
Sep 19 09:29:33.232904 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:33.232862    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp" podStartSLOduration=2.232850167 podStartE2EDuration="2.232850167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:29:33.230979365 +0000 UTC m=+1356.398174594" watchObservedRunningTime="2026-09-19 09:29:33.232850167 +0000 UTC m=+1356.400045397"
Sep 19 09:29:34.903370 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:34.903336    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b409cdbb-0a61-4e3c-b81d-9752e9b57f03" path="/var/lib/kubelet/pods/b409cdbb-0a61-4e3c-b81d-9752e9b57f03/volumes"
Sep 19 09:29:39.092521 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:39.092488    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"]
Sep 19 09:29:39.092994 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:39.092759    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy" containerID="cri-o://0ff81a97848165047850392f17e2250af451c4ec506ffd826b550304b3358aec" gracePeriod=30
Sep 19 09:29:44.208833 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.208802    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:29:44.267932 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.267894    2579 generic.go:356] "Generic (PLEG): container finished" podID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerID="0ff81a97848165047850392f17e2250af451c4ec506ffd826b550304b3358aec" exitCode=0
Sep 19 09:29:44.268076 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.267984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" event={"ID":"5fd4e9da-da12-46a7-b66a-5b27f042c08b","Type":"ContainerDied","Data":"0ff81a97848165047850392f17e2250af451c4ec506ffd826b550304b3358aec"}
Sep 19 09:29:44.268076 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.268061    2579 scope.go:117] "RemoveContainer" containerID="cad90ff321f8e2873f6ea6172cfcdb96a076749634244585d84ed01d29d99e05"
Sep 19 09:29:44.348082 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.348046    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:29:44.501553 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501454    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l89rd\" (UniqueName: \"kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-kube-api-access-l89rd\") pod \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") "
Sep 19 09:29:44.501553 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501521    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-socket\") pod \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") "
Sep 19 09:29:44.501553 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501555    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istiod-ca-cert\") pod \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") "
Sep 19 09:29:44.501826 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501635    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-credential-socket\") pod \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") "
Sep 19 09:29:44.501826 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501663    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-envoy\") pod \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") "
Sep 19 09:29:44.501826 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501693    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-token\") pod \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") "
Sep 19 09:29:44.501826 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501753    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-podinfo\") pod \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") "
Sep 19 09:29:44.501826 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501797    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-certs\") pod \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") "
Sep 19 09:29:44.501826 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501825    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-data\") pod \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\" (UID: \"5fd4e9da-da12-46a7-b66a-5b27f042c08b\") "
Sep 19 09:29:44.502163 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501857    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5fd4e9da-da12-46a7-b66a-5b27f042c08b" (UID: "5fd4e9da-da12-46a7-b66a-5b27f042c08b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:29:44.502163 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501931    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5fd4e9da-da12-46a7-b66a-5b27f042c08b" (UID: "5fd4e9da-da12-46a7-b66a-5b27f042c08b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:29:44.502163 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.501982    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5fd4e9da-da12-46a7-b66a-5b27f042c08b" (UID: "5fd4e9da-da12-46a7-b66a-5b27f042c08b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:29:44.502311 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.502186    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-data" (OuterVolumeSpecName: "istio-data") pod "5fd4e9da-da12-46a7-b66a-5b27f042c08b" (UID: "5fd4e9da-da12-46a7-b66a-5b27f042c08b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:29:44.502367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.502318    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5fd4e9da-da12-46a7-b66a-5b27f042c08b" (UID: "5fd4e9da-da12-46a7-b66a-5b27f042c08b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:29:44.502472 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.502450    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-certs\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:44.502530 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.502477    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-data\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:44.502530 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.502492    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-workload-socket\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:44.502530 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.502506    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istiod-ca-cert\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:44.502530 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.502519    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-credential-socket\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:44.503823 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.503798    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-kube-api-access-l89rd" (OuterVolumeSpecName: "kube-api-access-l89rd") pod "5fd4e9da-da12-46a7-b66a-5b27f042c08b" (UID: "5fd4e9da-da12-46a7-b66a-5b27f042c08b"). InnerVolumeSpecName "kube-api-access-l89rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:29:44.504004 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.503986    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5fd4e9da-da12-46a7-b66a-5b27f042c08b" (UID: "5fd4e9da-da12-46a7-b66a-5b27f042c08b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 09:29:44.504434 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.504415    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-token" (OuterVolumeSpecName: "istio-token") pod "5fd4e9da-da12-46a7-b66a-5b27f042c08b" (UID: "5fd4e9da-da12-46a7-b66a-5b27f042c08b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:29:44.504434 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.504421    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5fd4e9da-da12-46a7-b66a-5b27f042c08b" (UID: "5fd4e9da-da12-46a7-b66a-5b27f042c08b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:29:44.603724 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.603689    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l89rd\" (UniqueName: \"kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-kube-api-access-l89rd\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:44.603724 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.603720    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-envoy\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:44.603724 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.603729    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-token\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:44.603956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:44.603737    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd4e9da-da12-46a7-b66a-5b27f042c08b-istio-podinfo\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:29:45.274776 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:45.274687    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"
Sep 19 09:29:45.274776 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:45.274729    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz" event={"ID":"5fd4e9da-da12-46a7-b66a-5b27f042c08b","Type":"ContainerDied","Data":"2886dcabcbb40d27ce9f6716bff4837315989ab91ff0ce658601ebb65c0a59b6"}
Sep 19 09:29:45.275254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:45.274783    2579 scope.go:117] "RemoveContainer" containerID="0ff81a97848165047850392f17e2250af451c4ec506ffd826b550304b3358aec"
Sep 19 09:29:45.291814 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:45.291791    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"]
Sep 19 09:29:45.295693 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:45.295669    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-acc640-openshift-default-6779b85d86-tqhqz"]
Sep 19 09:29:46.903369 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:29:46.903335    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" path="/var/lib/kubelet/pods/5fd4e9da-da12-46a7-b66a-5b27f042c08b/volumes"
Sep 19 09:30:00.178516 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.178478    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf"]
Sep 19 09:30:00.179181 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.179161    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy"
Sep 19 09:30:00.179264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.179184    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy"
Sep 19 09:30:00.179264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.179208    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy"
Sep 19 09:30:00.179264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.179216    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy"
Sep 19 09:30:00.179264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.179238    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b409cdbb-0a61-4e3c-b81d-9752e9b57f03" containerName="payload-pre-processing"
Sep 19 09:30:00.179264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.179246    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b409cdbb-0a61-4e3c-b81d-9752e9b57f03" containerName="payload-pre-processing"
Sep 19 09:30:00.179448 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.179342    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy"
Sep 19 09:30:00.179448 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.179353    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b409cdbb-0a61-4e3c-b81d-9752e9b57f03" containerName="payload-pre-processing"
Sep 19 09:30:00.186097 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.184849    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh"]
Sep 19 09:30:00.188409 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.186353    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd4e9da-da12-46a7-b66a-5b27f042c08b" containerName="istio-proxy"
Sep 19 09:30:00.189766 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.189744    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf"
Sep 19 09:30:00.191033 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.190990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh"
Sep 19 09:30:00.200467 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.200438    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:30:00.203561 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.203536    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf"]
Sep 19 09:30:00.205784 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.205766    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf"
Sep 19 09:30:00.212122 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.212100    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh"
Sep 19 09:30:00.225519 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.225490    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh"]
Sep 19 09:30:00.497499 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.497463    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf"]
Sep 19 09:30:00.498702 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:30:00.498677    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1b94b3_dd11_4828_952a_8856e080e2ab.slice/crio-d07035e83548b620c9ff01f445107830a0fb0eafbc7a695f3d160b18c869f967 WatchSource:0}: Error finding container d07035e83548b620c9ff01f445107830a0fb0eafbc7a695f3d160b18c869f967: Status 404 returned error can't find the container with id d07035e83548b620c9ff01f445107830a0fb0eafbc7a695f3d160b18c869f967
Sep 19 09:30:00.507550 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:00.507527    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh"]
Sep 19 09:30:00.509906 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:30:00.509868    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a42228c_144f_4271_82a2_48fe62c07205.slice/crio-146c098ea7e4f165bf2f6aa74fa71974104c164bd527f4bc40719e9abd1b1967 WatchSource:0}: Error finding container 146c098ea7e4f165bf2f6aa74fa71974104c164bd527f4bc40719e9abd1b1967: Status 404 returned error can't find the container with id 146c098ea7e4f165bf2f6aa74fa71974104c164bd527f4bc40719e9abd1b1967
Sep 19 09:30:01.370895 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:01.370856    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh" event={"ID":"0a42228c-144f-4271-82a2-48fe62c07205","Type":"ContainerStarted","Data":"5db8f5f4519df8da44d0161382c22a9cdd777ae754bde9a45b5838d48b8f42b0"}
Sep 19 09:30:01.371359 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:01.370916    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh" event={"ID":"0a42228c-144f-4271-82a2-48fe62c07205","Type":"ContainerStarted","Data":"146c098ea7e4f165bf2f6aa74fa71974104c164bd527f4bc40719e9abd1b1967"}
Sep 19 09:30:01.372567 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:01.372545    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf" event={"ID":"db1b94b3-dd11-4828-952a-8856e080e2ab","Type":"ContainerStarted","Data":"8ca533495e5215621c10ab3b9856e37f5bd62b05fbb3906d77ad14f8d5104ef5"}
Sep 19 09:30:01.372669 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:01.372585    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf" event={"ID":"db1b94b3-dd11-4828-952a-8856e080e2ab","Type":"ContainerStarted","Data":"d07035e83548b620c9ff01f445107830a0fb0eafbc7a695f3d160b18c869f967"}
Sep 19 09:30:01.387728 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:01.387688    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh" podStartSLOduration=1.387675484 podStartE2EDuration="1.387675484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:30:01.385322744 +0000 UTC m=+1384.552517986" watchObservedRunningTime="2026-09-19 09:30:01.387675484 +0000 UTC m=+1384.554870714"
Sep 19 09:30:01.411454 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:01.411410    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf" podStartSLOduration=1.411396113 podStartE2EDuration="1.411396113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:30:01.41052455 +0000 UTC m=+1384.577719779" watchObservedRunningTime="2026-09-19 09:30:01.411396113 +0000 UTC m=+1384.578591345"
Sep 19 09:30:02.380425 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:02.380387    2579 generic.go:356] "Generic (PLEG): container finished" podID="0a42228c-144f-4271-82a2-48fe62c07205" containerID="5db8f5f4519df8da44d0161382c22a9cdd777ae754bde9a45b5838d48b8f42b0" exitCode=0
Sep 19 09:30:02.380938 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:02.380488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh" event={"ID":"0a42228c-144f-4271-82a2-48fe62c07205","Type":"ContainerDied","Data":"5db8f5f4519df8da44d0161382c22a9cdd777ae754bde9a45b5838d48b8f42b0"}
Sep 19 09:30:02.382418 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:02.382388    2579 generic.go:356] "Generic (PLEG): container finished" podID="db1b94b3-dd11-4828-952a-8856e080e2ab" containerID="8ca533495e5215621c10ab3b9856e37f5bd62b05fbb3906d77ad14f8d5104ef5" exitCode=0
Sep 19 09:30:02.382509 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:02.382426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf" event={"ID":"db1b94b3-dd11-4828-952a-8856e080e2ab","Type":"ContainerDied","Data":"8ca533495e5215621c10ab3b9856e37f5bd62b05fbb3906d77ad14f8d5104ef5"}
Sep 19 09:30:03.518493 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:03.518469    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh"
Sep 19 09:30:03.553010 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:03.552983    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf"
Sep 19 09:30:04.395410 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:04.395381    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh"
Sep 19 09:30:04.395596 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:04.395383    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh" event={"ID":"0a42228c-144f-4271-82a2-48fe62c07205","Type":"ContainerDied","Data":"146c098ea7e4f165bf2f6aa74fa71974104c164bd527f4bc40719e9abd1b1967"}
Sep 19 09:30:04.395596 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:04.395498    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="146c098ea7e4f165bf2f6aa74fa71974104c164bd527f4bc40719e9abd1b1967"
Sep 19 09:30:04.396655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:04.396639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf" event={"ID":"db1b94b3-dd11-4828-952a-8856e080e2ab","Type":"ContainerDied","Data":"d07035e83548b620c9ff01f445107830a0fb0eafbc7a695f3d160b18c869f967"}
Sep 19 09:30:04.396717 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:04.396659    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830170-sb8xf"
Sep 19 09:30:04.396717 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:04.396670    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d07035e83548b620c9ff01f445107830a0fb0eafbc7a695f3d160b18c869f967"
Sep 19 09:30:16.157066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.156993    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"]
Sep 19 09:30:16.157562 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.157546    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db1b94b3-dd11-4828-952a-8856e080e2ab" containerName="cleanup"
Sep 19 09:30:16.157609 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.157564    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="db1b94b3-dd11-4828-952a-8856e080e2ab" containerName="cleanup"
Sep 19 09:30:16.157609 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.157582    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a42228c-144f-4271-82a2-48fe62c07205" containerName="cleanup"
Sep 19 09:30:16.157609 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.157587    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a42228c-144f-4271-82a2-48fe62c07205" containerName="cleanup"
Sep 19 09:30:16.157693 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.157646    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a42228c-144f-4271-82a2-48fe62c07205" containerName="cleanup"
Sep 19 09:30:16.157693 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.157659    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="db1b94b3-dd11-4828-952a-8856e080e2ab" containerName="cleanup"
Sep 19 09:30:16.161064 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.161010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:30:16.163169 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.163147    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0e698776\""
Sep 19 09:30:16.170181 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.170157    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"]
Sep 19 09:30:16.212455 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.212421    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n9sd\" (UniqueName: \"kubernetes.io/projected/cb4634e2-7cce-488f-a29b-681de8c4c676-kube-api-access-4n9sd\") pod \"payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j\" (UID: \"cb4634e2-7cce-488f-a29b-681de8c4c676\") " pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:30:16.212640 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.212500    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4634e2-7cce-488f-a29b-681de8c4c676-plugins-config-volume\") pod \"payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j\" (UID: \"cb4634e2-7cce-488f-a29b-681de8c4c676\") " pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:30:16.217320 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.217289    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"]
Sep 19 09:30:16.221193 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.221173    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:30:16.223588 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.223562    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0e698776-dockercfg-tf65c\""
Sep 19 09:30:16.232834 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.232805    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"]
Sep 19 09:30:16.313320 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.313283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4634e2-7cce-488f-a29b-681de8c4c676-plugins-config-volume\") pod \"payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j\" (UID: \"cb4634e2-7cce-488f-a29b-681de8c4c676\") " pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:30:16.313503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.313332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1650b53b-40b9-4cc0-ae63-10dab42f3a02-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj\" (UID: \"1650b53b-40b9-4cc0-ae63-10dab42f3a02\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:30:16.313503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.313380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-749gg\" (UniqueName: \"kubernetes.io/projected/1650b53b-40b9-4cc0-ae63-10dab42f3a02-kube-api-access-749gg\") pod \"payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj\" (UID: \"1650b53b-40b9-4cc0-ae63-10dab42f3a02\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:30:16.313503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.313426    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n9sd\" (UniqueName: \"kubernetes.io/projected/cb4634e2-7cce-488f-a29b-681de8c4c676-kube-api-access-4n9sd\") pod \"payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j\" (UID: \"cb4634e2-7cce-488f-a29b-681de8c4c676\") " pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:30:16.314195 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.314174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4634e2-7cce-488f-a29b-681de8c4c676-plugins-config-volume\") pod \"payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j\" (UID: \"cb4634e2-7cce-488f-a29b-681de8c4c676\") " pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:30:16.323564 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.323538    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n9sd\" (UniqueName: \"kubernetes.io/projected/cb4634e2-7cce-488f-a29b-681de8c4c676-kube-api-access-4n9sd\") pod \"payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j\" (UID: \"cb4634e2-7cce-488f-a29b-681de8c4c676\") " pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:30:16.414706 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.414610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1650b53b-40b9-4cc0-ae63-10dab42f3a02-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj\" (UID: \"1650b53b-40b9-4cc0-ae63-10dab42f3a02\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:30:16.414706 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.414678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-749gg\" (UniqueName: \"kubernetes.io/projected/1650b53b-40b9-4cc0-ae63-10dab42f3a02-kube-api-access-749gg\") pod \"payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj\" (UID: \"1650b53b-40b9-4cc0-ae63-10dab42f3a02\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:30:16.415336 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.415317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1650b53b-40b9-4cc0-ae63-10dab42f3a02-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj\" (UID: \"1650b53b-40b9-4cc0-ae63-10dab42f3a02\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:30:16.423573 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.423547    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-749gg\" (UniqueName: \"kubernetes.io/projected/1650b53b-40b9-4cc0-ae63-10dab42f3a02-kube-api-access-749gg\") pod \"payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj\" (UID: \"1650b53b-40b9-4cc0-ae63-10dab42f3a02\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:30:16.472501 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.472464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:30:16.533478 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.533447    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:30:16.756694 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.756608    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"]
Sep 19 09:30:16.759468 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:30:16.759437    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4634e2_7cce_488f_a29b_681de8c4c676.slice/crio-547ef35292f6327eae8991f02e8e70bb57f515d39a691d4d7d15210c89ea5fdb WatchSource:0}: Error finding container 547ef35292f6327eae8991f02e8e70bb57f515d39a691d4d7d15210c89ea5fdb: Status 404 returned error can't find the container with id 547ef35292f6327eae8991f02e8e70bb57f515d39a691d4d7d15210c89ea5fdb
Sep 19 09:30:16.815549 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:16.815524    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"]
Sep 19 09:30:16.823108 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:30:16.823086    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1650b53b_40b9_4cc0_ae63_10dab42f3a02.slice/crio-bf28d266e32a785de7b7e6229d4fcca73f506cc62e2f90f2589542a51d9a23c3 WatchSource:0}: Error finding container bf28d266e32a785de7b7e6229d4fcca73f506cc62e2f90f2589542a51d9a23c3: Status 404 returned error can't find the container with id bf28d266e32a785de7b7e6229d4fcca73f506cc62e2f90f2589542a51d9a23c3
Sep 19 09:30:17.472499 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:17.472460    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j" event={"ID":"cb4634e2-7cce-488f-a29b-681de8c4c676","Type":"ContainerStarted","Data":"2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd"}
Sep 19 09:30:17.472988 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:17.472525    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j" event={"ID":"cb4634e2-7cce-488f-a29b-681de8c4c676","Type":"ContainerStarted","Data":"547ef35292f6327eae8991f02e8e70bb57f515d39a691d4d7d15210c89ea5fdb"}
Sep 19 09:30:17.472988 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:17.472588    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:30:17.474272 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:17.474242    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj" event={"ID":"1650b53b-40b9-4cc0-ae63-10dab42f3a02","Type":"ContainerStarted","Data":"4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278"}
Sep 19 09:30:17.474389 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:17.474289    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj" event={"ID":"1650b53b-40b9-4cc0-ae63-10dab42f3a02","Type":"ContainerStarted","Data":"bf28d266e32a785de7b7e6229d4fcca73f506cc62e2f90f2589542a51d9a23c3"}
Sep 19 09:30:17.474389 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:17.474314    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:30:17.491378 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:17.491329    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j" podStartSLOduration=1.491311445 podStartE2EDuration="1.491311445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:30:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:30:17.48926885 +0000 UTC m=+1400.656464081" watchObservedRunningTime="2026-09-19 09:30:17.491311445 +0000 UTC m=+1400.658506674"
Sep 19 09:30:17.509136 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:17.509072    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj" podStartSLOduration=1.509049513 podStartE2EDuration="1.509049513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:30:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:30:17.507048673 +0000 UTC m=+1400.674243902" watchObservedRunningTime="2026-09-19 09:30:17.509049513 +0000 UTC m=+1400.676244741"
Sep 19 09:30:28.481361 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:28.481330    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:30:28.481719 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:28.481543    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:30:49.767008 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:49.766926    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"]
Sep 19 09:30:49.770639 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:49.770623    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"
Sep 19 09:30:49.773710 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:49.773692    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:30:49.773854 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:49.773833    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:30:49.787244 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:49.787220    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"]
Sep 19 09:30:49.862673 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:49.862640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d0fd52d-dd2f-490e-8e38-72c6a096cbc6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0e698776-wclp7\" (UID: \"5d0fd52d-dd2f-490e-8e38-72c6a096cbc6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"
Sep 19 09:30:49.963296 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:49.963262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d0fd52d-dd2f-490e-8e38-72c6a096cbc6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0e698776-wclp7\" (UID: \"5d0fd52d-dd2f-490e-8e38-72c6a096cbc6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"
Sep 19 09:30:49.963917 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:49.963899    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d0fd52d-dd2f-490e-8e38-72c6a096cbc6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0e698776-wclp7\" (UID: \"5d0fd52d-dd2f-490e-8e38-72c6a096cbc6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"
Sep 19 09:30:50.081238 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:50.081207    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"
Sep 19 09:30:50.354082 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:50.354050    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"]
Sep 19 09:30:50.355299 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:30:50.355277    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0fd52d_dd2f_490e_8e38_72c6a096cbc6.slice/crio-a8ba83b5a913c6adaccf55b1f27ea11f4eea9b2544e105602c7283ccbdb41a78 WatchSource:0}: Error finding container a8ba83b5a913c6adaccf55b1f27ea11f4eea9b2544e105602c7283ccbdb41a78: Status 404 returned error can't find the container with id a8ba83b5a913c6adaccf55b1f27ea11f4eea9b2544e105602c7283ccbdb41a78
Sep 19 09:30:50.671713 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:50.671669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7" event={"ID":"5d0fd52d-dd2f-490e-8e38-72c6a096cbc6","Type":"ContainerStarted","Data":"7377b5741335e9896a75f70923fb2dbb8ef8c6105dac6c0aa9300875429c128d"}
Sep 19 09:30:50.671907 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:50.671743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7" event={"ID":"5d0fd52d-dd2f-490e-8e38-72c6a096cbc6","Type":"ContainerStarted","Data":"a8ba83b5a913c6adaccf55b1f27ea11f4eea9b2544e105602c7283ccbdb41a78"}
Sep 19 09:30:51.679099 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:51.679067    2579 generic.go:356] "Generic (PLEG): container finished" podID="5d0fd52d-dd2f-490e-8e38-72c6a096cbc6" containerID="7377b5741335e9896a75f70923fb2dbb8ef8c6105dac6c0aa9300875429c128d" exitCode=0
Sep 19 09:30:51.679492 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:51.679156    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7" event={"ID":"5d0fd52d-dd2f-490e-8e38-72c6a096cbc6","Type":"ContainerDied","Data":"7377b5741335e9896a75f70923fb2dbb8ef8c6105dac6c0aa9300875429c128d"}
Sep 19 09:30:52.820575 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:52.820554    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"
Sep 19 09:30:52.892496 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:52.892466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d0fd52d-dd2f-490e-8e38-72c6a096cbc6-maas-api-service-ca\") pod \"5d0fd52d-dd2f-490e-8e38-72c6a096cbc6\" (UID: \"5d0fd52d-dd2f-490e-8e38-72c6a096cbc6\") "
Sep 19 09:30:52.892799 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:52.892778    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d0fd52d-dd2f-490e-8e38-72c6a096cbc6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d0fd52d-dd2f-490e-8e38-72c6a096cbc6" (UID: "5d0fd52d-dd2f-490e-8e38-72c6a096cbc6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:30:52.993749 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:52.993648    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d0fd52d-dd2f-490e-8e38-72c6a096cbc6-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:30:53.691933 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:53.691902    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"
Sep 19 09:30:53.692154 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:53.691943    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7" event={"ID":"5d0fd52d-dd2f-490e-8e38-72c6a096cbc6","Type":"ContainerDied","Data":"a8ba83b5a913c6adaccf55b1f27ea11f4eea9b2544e105602c7283ccbdb41a78"}
Sep 19 09:30:53.692154 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:30:53.691992    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8ba83b5a913c6adaccf55b1f27ea11f4eea9b2544e105602c7283ccbdb41a78"
Sep 19 09:31:00.356045 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.355993    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"]
Sep 19 09:31:00.356567 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.356228    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j" podUID="cb4634e2-7cce-488f-a29b-681de8c4c676" containerName="payload-processing" containerID="cri-o://2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd" gracePeriod=30
Sep 19 09:31:00.363634 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.363610    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"]
Sep 19 09:31:00.363831 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.363810    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj" podUID="1650b53b-40b9-4cc0-ae63-10dab42f3a02" containerName="payload-pre-processing" containerID="cri-o://4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278" gracePeriod=30
Sep 19 09:31:00.548351 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.548314    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"]
Sep 19 09:31:00.552246 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.552220    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0e698776-wclp7"]
Sep 19 09:31:00.609857 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.609800    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:31:00.638734 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.638711    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:31:00.732689 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.732651    2579 generic.go:356] "Generic (PLEG): container finished" podID="cb4634e2-7cce-488f-a29b-681de8c4c676" containerID="2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd" exitCode=0
Sep 19 09:31:00.732864 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.732698    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"
Sep 19 09:31:00.732864 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.732729    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j" event={"ID":"cb4634e2-7cce-488f-a29b-681de8c4c676","Type":"ContainerDied","Data":"2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd"}
Sep 19 09:31:00.732864 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.732796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j" event={"ID":"cb4634e2-7cce-488f-a29b-681de8c4c676","Type":"ContainerDied","Data":"547ef35292f6327eae8991f02e8e70bb57f515d39a691d4d7d15210c89ea5fdb"}
Sep 19 09:31:00.732864 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.732822    2579 scope.go:117] "RemoveContainer" containerID="2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd"
Sep 19 09:31:00.734011 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.733991    2579 generic.go:356] "Generic (PLEG): container finished" podID="1650b53b-40b9-4cc0-ae63-10dab42f3a02" containerID="4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278" exitCode=0
Sep 19 09:31:00.734120 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.734036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj" event={"ID":"1650b53b-40b9-4cc0-ae63-10dab42f3a02","Type":"ContainerDied","Data":"4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278"}
Sep 19 09:31:00.734120 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.734089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj" event={"ID":"1650b53b-40b9-4cc0-ae63-10dab42f3a02","Type":"ContainerDied","Data":"bf28d266e32a785de7b7e6229d4fcca73f506cc62e2f90f2589542a51d9a23c3"}
Sep 19 09:31:00.734120 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.734044    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"
Sep 19 09:31:00.741956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.741941    2579 scope.go:117] "RemoveContainer" containerID="2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd"
Sep 19 09:31:00.742268 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:31:00.742252    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd\": container with ID starting with 2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd not found: ID does not exist" containerID="2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd"
Sep 19 09:31:00.742322 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.742276    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd"} err="failed to get container status \"2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd\": rpc error: code = NotFound desc = could not find container \"2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd\": container with ID starting with 2e034689ff602abc25cc35ea8eefae5c1b4f1cd950e7f53b0afaeb8e567cb5cd not found: ID does not exist"
Sep 19 09:31:00.742322 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.742295    2579 scope.go:117] "RemoveContainer" containerID="4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278"
Sep 19 09:31:00.750544 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.750530    2579 scope.go:117] "RemoveContainer" containerID="4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278"
Sep 19 09:31:00.750784 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:31:00.750769    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278\": container with ID starting with 4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278 not found: ID does not exist" containerID="4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278"
Sep 19 09:31:00.750827 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.750791    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278"} err="failed to get container status \"4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278\": rpc error: code = NotFound desc = could not find container \"4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278\": container with ID starting with 4342b1352cea8b0047cf45ea5d0a56f95c9a8c8285cd690ae34f6d1ba2bc6278 not found: ID does not exist"
Sep 19 09:31:00.773705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.773672    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n9sd\" (UniqueName: \"kubernetes.io/projected/cb4634e2-7cce-488f-a29b-681de8c4c676-kube-api-access-4n9sd\") pod \"cb4634e2-7cce-488f-a29b-681de8c4c676\" (UID: \"cb4634e2-7cce-488f-a29b-681de8c4c676\") "
Sep 19 09:31:00.773839 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.773749    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-749gg\" (UniqueName: \"kubernetes.io/projected/1650b53b-40b9-4cc0-ae63-10dab42f3a02-kube-api-access-749gg\") pod \"1650b53b-40b9-4cc0-ae63-10dab42f3a02\" (UID: \"1650b53b-40b9-4cc0-ae63-10dab42f3a02\") "
Sep 19 09:31:00.773885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.773841    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1650b53b-40b9-4cc0-ae63-10dab42f3a02-plugins-config-volume\") pod \"1650b53b-40b9-4cc0-ae63-10dab42f3a02\" (UID: \"1650b53b-40b9-4cc0-ae63-10dab42f3a02\") "
Sep 19 09:31:00.773885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.773861    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4634e2-7cce-488f-a29b-681de8c4c676-plugins-config-volume\") pod \"cb4634e2-7cce-488f-a29b-681de8c4c676\" (UID: \"cb4634e2-7cce-488f-a29b-681de8c4c676\") "
Sep 19 09:31:00.774252 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.774230    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1650b53b-40b9-4cc0-ae63-10dab42f3a02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1650b53b-40b9-4cc0-ae63-10dab42f3a02" (UID: "1650b53b-40b9-4cc0-ae63-10dab42f3a02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:31:00.774350 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.774283    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb4634e2-7cce-488f-a29b-681de8c4c676-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb4634e2-7cce-488f-a29b-681de8c4c676" (UID: "cb4634e2-7cce-488f-a29b-681de8c4c676"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:31:00.775880 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.775864    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1650b53b-40b9-4cc0-ae63-10dab42f3a02-kube-api-access-749gg" (OuterVolumeSpecName: "kube-api-access-749gg") pod "1650b53b-40b9-4cc0-ae63-10dab42f3a02" (UID: "1650b53b-40b9-4cc0-ae63-10dab42f3a02"). InnerVolumeSpecName "kube-api-access-749gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:31:00.775935 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.775890    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb4634e2-7cce-488f-a29b-681de8c4c676-kube-api-access-4n9sd" (OuterVolumeSpecName: "kube-api-access-4n9sd") pod "cb4634e2-7cce-488f-a29b-681de8c4c676" (UID: "cb4634e2-7cce-488f-a29b-681de8c4c676"). InnerVolumeSpecName "kube-api-access-4n9sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:31:00.875430 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.875350    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-749gg\" (UniqueName: \"kubernetes.io/projected/1650b53b-40b9-4cc0-ae63-10dab42f3a02-kube-api-access-749gg\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:31:00.875430 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.875379    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1650b53b-40b9-4cc0-ae63-10dab42f3a02-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:31:00.875430 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.875390    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4634e2-7cce-488f-a29b-681de8c4c676-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:31:00.875430 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.875398    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n9sd\" (UniqueName: \"kubernetes.io/projected/cb4634e2-7cce-488f-a29b-681de8c4c676-kube-api-access-4n9sd\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:31:00.903690 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:00.903662    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d0fd52d-dd2f-490e-8e38-72c6a096cbc6" path="/var/lib/kubelet/pods/5d0fd52d-dd2f-490e-8e38-72c6a096cbc6/volumes"
Sep 19 09:31:01.050801 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:01.050769    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"]
Sep 19 09:31:01.056192 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:01.056169    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e698776-79c8f8d5d6-wlsfj"]
Sep 19 09:31:01.065902 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:01.065879    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"]
Sep 19 09:31:01.068625 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:01.068603    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e698776-c86bd78d9-fjk9j"]
Sep 19 09:31:02.904381 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:02.904348    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1650b53b-40b9-4cc0-ae63-10dab42f3a02" path="/var/lib/kubelet/pods/1650b53b-40b9-4cc0-ae63-10dab42f3a02/volumes"
Sep 19 09:31:02.904775 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:02.904731    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb4634e2-7cce-488f-a29b-681de8c4c676" path="/var/lib/kubelet/pods/cb4634e2-7cce-488f-a29b-681de8c4c676/volumes"
Sep 19 09:31:25.486875 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.486843    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"]
Sep 19 09:31:25.489356 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.487290    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4634e2-7cce-488f-a29b-681de8c4c676" containerName="payload-processing"
Sep 19 09:31:25.489356 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.487303    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4634e2-7cce-488f-a29b-681de8c4c676" containerName="payload-processing"
Sep 19 09:31:25.489356 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.487316    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1650b53b-40b9-4cc0-ae63-10dab42f3a02" containerName="payload-pre-processing"
Sep 19 09:31:25.489356 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.487321    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1650b53b-40b9-4cc0-ae63-10dab42f3a02" containerName="payload-pre-processing"
Sep 19 09:31:25.489356 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.487332    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d0fd52d-dd2f-490e-8e38-72c6a096cbc6" containerName="revoke-keys"
Sep 19 09:31:25.489356 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.487338    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d0fd52d-dd2f-490e-8e38-72c6a096cbc6" containerName="revoke-keys"
Sep 19 09:31:25.489356 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.487419    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1650b53b-40b9-4cc0-ae63-10dab42f3a02" containerName="payload-pre-processing"
Sep 19 09:31:25.489356 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.487428    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb4634e2-7cce-488f-a29b-681de8c4c676" containerName="payload-processing"
Sep 19 09:31:25.489356 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.487437    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d0fd52d-dd2f-490e-8e38-72c6a096cbc6" containerName="revoke-keys"
Sep 19 09:31:25.490408 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.490392    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"
Sep 19 09:31:25.492562 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.492542    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:31:25.492766 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.492753    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:31:25.501740 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.501715    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"]
Sep 19 09:31:25.612779 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.612738    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbcbc92-b291-4ae9-bb76-a6b54d4006bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ac387c-jth5d\" (UID: \"ecbcbc92-b291-4ae9-bb76-a6b54d4006bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"
Sep 19 09:31:25.714118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.714074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbcbc92-b291-4ae9-bb76-a6b54d4006bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ac387c-jth5d\" (UID: \"ecbcbc92-b291-4ae9-bb76-a6b54d4006bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"
Sep 19 09:31:25.714724 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.714706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbcbc92-b291-4ae9-bb76-a6b54d4006bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ac387c-jth5d\" (UID: \"ecbcbc92-b291-4ae9-bb76-a6b54d4006bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"
Sep 19 09:31:25.801514 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:25.801479    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"
Sep 19 09:31:26.070399 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:26.070371    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"]
Sep 19 09:31:26.073212 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:31:26.073189    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbcbc92_b291_4ae9_bb76_a6b54d4006bc.slice/crio-1416a50a40f83ef4060e6dcf9b6e93435db89285dc080202af9d0edaad6a3464 WatchSource:0}: Error finding container 1416a50a40f83ef4060e6dcf9b6e93435db89285dc080202af9d0edaad6a3464: Status 404 returned error can't find the container with id 1416a50a40f83ef4060e6dcf9b6e93435db89285dc080202af9d0edaad6a3464
Sep 19 09:31:26.885796 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:26.885764    2579 generic.go:356] "Generic (PLEG): container finished" podID="ecbcbc92-b291-4ae9-bb76-a6b54d4006bc" containerID="5e660396762254ada38314bc0cd2fa5ac9c874a9c8036d8719979da336206590" exitCode=0
Sep 19 09:31:26.886184 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:26.885812    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d" event={"ID":"ecbcbc92-b291-4ae9-bb76-a6b54d4006bc","Type":"ContainerDied","Data":"5e660396762254ada38314bc0cd2fa5ac9c874a9c8036d8719979da336206590"}
Sep 19 09:31:26.886184 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:26.885874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d" event={"ID":"ecbcbc92-b291-4ae9-bb76-a6b54d4006bc","Type":"ContainerStarted","Data":"1416a50a40f83ef4060e6dcf9b6e93435db89285dc080202af9d0edaad6a3464"}
Sep 19 09:31:28.034193 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:28.034164    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"
Sep 19 09:31:28.140342 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:28.140309    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbcbc92-b291-4ae9-bb76-a6b54d4006bc-maas-api-service-ca\") pod \"ecbcbc92-b291-4ae9-bb76-a6b54d4006bc\" (UID: \"ecbcbc92-b291-4ae9-bb76-a6b54d4006bc\") "
Sep 19 09:31:28.140668 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:28.140644    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecbcbc92-b291-4ae9-bb76-a6b54d4006bc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ecbcbc92-b291-4ae9-bb76-a6b54d4006bc" (UID: "ecbcbc92-b291-4ae9-bb76-a6b54d4006bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:31:28.242056 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:28.241963    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbcbc92-b291-4ae9-bb76-a6b54d4006bc-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:31:28.904398 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:28.904368    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"
Sep 19 09:31:28.908685 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:28.908652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d" event={"ID":"ecbcbc92-b291-4ae9-bb76-a6b54d4006bc","Type":"ContainerDied","Data":"1416a50a40f83ef4060e6dcf9b6e93435db89285dc080202af9d0edaad6a3464"}
Sep 19 09:31:28.908898 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:28.908882    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1416a50a40f83ef4060e6dcf9b6e93435db89285dc080202af9d0edaad6a3464"
Sep 19 09:31:29.304045 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.304001    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"]
Sep 19 09:31:29.304502 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.304488    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbcbc92-b291-4ae9-bb76-a6b54d4006bc" containerName="revoke-keys"
Sep 19 09:31:29.304551 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.304504    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbcbc92-b291-4ae9-bb76-a6b54d4006bc" containerName="revoke-keys"
Sep 19 09:31:29.304626 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.304616    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbcbc92-b291-4ae9-bb76-a6b54d4006bc" containerName="revoke-keys"
Sep 19 09:31:29.307903 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.307870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:31:29.311456 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.311432    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-261ce4\""
Sep 19 09:31:29.328446 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.328408    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"]
Sep 19 09:31:29.328770 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.328749    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"]
Sep 19 09:31:29.334569 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.334539    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:31:29.337299 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.337276    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-261ce4-dockercfg-s8x5l\""
Sep 19 09:31:29.343567 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.343539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"]
Sep 19 09:31:29.456101 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.456069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq\" (UID: \"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:31:29.456286 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.456159    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqsks\" (UniqueName: \"kubernetes.io/projected/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-kube-api-access-jqsks\") pod \"payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq\" (UID: \"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:31:29.456286 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.456205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5100055-8353-4811-ac93-66d63089163e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb\" (UID: \"f5100055-8353-4811-ac93-66d63089163e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:31:29.456286 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.456222    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lzl9\" (UniqueName: \"kubernetes.io/projected/f5100055-8353-4811-ac93-66d63089163e-kube-api-access-5lzl9\") pod \"payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb\" (UID: \"f5100055-8353-4811-ac93-66d63089163e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:31:29.557330 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.557212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5100055-8353-4811-ac93-66d63089163e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb\" (UID: \"f5100055-8353-4811-ac93-66d63089163e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:31:29.557330 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.557270    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lzl9\" (UniqueName: \"kubernetes.io/projected/f5100055-8353-4811-ac93-66d63089163e-kube-api-access-5lzl9\") pod \"payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb\" (UID: \"f5100055-8353-4811-ac93-66d63089163e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:31:29.557330 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.557303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq\" (UID: \"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:31:29.557646 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.557372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqsks\" (UniqueName: \"kubernetes.io/projected/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-kube-api-access-jqsks\") pod \"payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq\" (UID: \"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:31:29.558052 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.557995    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq\" (UID: \"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:31:29.558136 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.558005    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5100055-8353-4811-ac93-66d63089163e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb\" (UID: \"f5100055-8353-4811-ac93-66d63089163e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:31:29.567056 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.567001    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqsks\" (UniqueName: \"kubernetes.io/projected/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-kube-api-access-jqsks\") pod \"payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq\" (UID: \"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:31:29.568343 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.568324    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lzl9\" (UniqueName: \"kubernetes.io/projected/f5100055-8353-4811-ac93-66d63089163e-kube-api-access-5lzl9\") pod \"payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb\" (UID: \"f5100055-8353-4811-ac93-66d63089163e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:31:29.618515 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.618480    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:31:29.647085 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.647039    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:31:29.898969 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.898939    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"]
Sep 19 09:31:29.900633 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:31:29.900610    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba16b663_8b29_4094_ad5a_a1eb28ba4f6a.slice/crio-3c7cdf59a9cddbd9b8c3f5b6ef69a948d0bce0bfb058b87e45612fef035ce374 WatchSource:0}: Error finding container 3c7cdf59a9cddbd9b8c3f5b6ef69a948d0bce0bfb058b87e45612fef035ce374: Status 404 returned error can't find the container with id 3c7cdf59a9cddbd9b8c3f5b6ef69a948d0bce0bfb058b87e45612fef035ce374
Sep 19 09:31:29.910543 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.910517    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq" event={"ID":"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a","Type":"ContainerStarted","Data":"3c7cdf59a9cddbd9b8c3f5b6ef69a948d0bce0bfb058b87e45612fef035ce374"}
Sep 19 09:31:29.935489 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:29.935459    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"]
Sep 19 09:31:29.940173 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:31:29.940152    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5100055_8353_4811_ac93_66d63089163e.slice/crio-67c0057bf73a55a4c770c61bb85599ddac373e7c903be5a857b099e85799adb8 WatchSource:0}: Error finding container 67c0057bf73a55a4c770c61bb85599ddac373e7c903be5a857b099e85799adb8: Status 404 returned error can't find the container with id 67c0057bf73a55a4c770c61bb85599ddac373e7c903be5a857b099e85799adb8
Sep 19 09:31:30.916826 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:30.916789    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq" event={"ID":"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a","Type":"ContainerStarted","Data":"1d9c61b86643ac47312a6e8f55e3f24b0f90758c43a92be1deb7a441dff0f141"}
Sep 19 09:31:30.917352 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:30.916872    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:31:30.918644 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:30.918615    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb" event={"ID":"f5100055-8353-4811-ac93-66d63089163e","Type":"ContainerStarted","Data":"d796f02f24861f8b0be0488c175d3fa5ddfa3292aafee82db2e289deb2d7ee22"}
Sep 19 09:31:30.918751 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:30.918668    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb" event={"ID":"f5100055-8353-4811-ac93-66d63089163e","Type":"ContainerStarted","Data":"67c0057bf73a55a4c770c61bb85599ddac373e7c903be5a857b099e85799adb8"}
Sep 19 09:31:30.918751 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:30.918697    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:31:30.936595 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:30.936545    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq" podStartSLOduration=1.9365268580000001 podStartE2EDuration="1.936526858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:31:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:31:30.933598733 +0000 UTC m=+1474.100793977" watchObservedRunningTime="2026-09-19 09:31:30.936526858 +0000 UTC m=+1474.103722089"
Sep 19 09:31:30.951250 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:30.951200    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb" podStartSLOduration=1.951187817 podStartE2EDuration="1.951187817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:31:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:31:30.950130301 +0000 UTC m=+1474.117325530" watchObservedRunningTime="2026-09-19 09:31:30.951187817 +0000 UTC m=+1474.118383052"
Sep 19 09:31:36.443324 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.443283    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"]
Sep 19 09:31:36.443915 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.443545    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp" podUID="6a869b29-6811-4468-abef-f6a23c67a462" containerName="payload-processing" containerID="cri-o://454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249" gracePeriod=30
Sep 19 09:31:36.653998 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.653964    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"]
Sep 19 09:31:36.658537 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.658510    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ac387c-jth5d"]
Sep 19 09:31:36.702127 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.702059    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:31:36.836899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.836865    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a869b29-6811-4468-abef-f6a23c67a462-plugins-config-volume\") pod \"6a869b29-6811-4468-abef-f6a23c67a462\" (UID: \"6a869b29-6811-4468-abef-f6a23c67a462\") "
Sep 19 09:31:36.837086 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.836964    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkttf\" (UniqueName: \"kubernetes.io/projected/6a869b29-6811-4468-abef-f6a23c67a462-kube-api-access-pkttf\") pod \"6a869b29-6811-4468-abef-f6a23c67a462\" (UID: \"6a869b29-6811-4468-abef-f6a23c67a462\") "
Sep 19 09:31:36.837343 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.837316    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a869b29-6811-4468-abef-f6a23c67a462-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a869b29-6811-4468-abef-f6a23c67a462" (UID: "6a869b29-6811-4468-abef-f6a23c67a462"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:31:36.839153 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.839131    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a869b29-6811-4468-abef-f6a23c67a462-kube-api-access-pkttf" (OuterVolumeSpecName: "kube-api-access-pkttf") pod "6a869b29-6811-4468-abef-f6a23c67a462" (UID: "6a869b29-6811-4468-abef-f6a23c67a462"). InnerVolumeSpecName "kube-api-access-pkttf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:31:36.904787 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.904757    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecbcbc92-b291-4ae9-bb76-a6b54d4006bc" path="/var/lib/kubelet/pods/ecbcbc92-b291-4ae9-bb76-a6b54d4006bc/volumes"
Sep 19 09:31:36.938564 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.938537    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a869b29-6811-4468-abef-f6a23c67a462-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:31:36.938564 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.938560    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkttf\" (UniqueName: \"kubernetes.io/projected/6a869b29-6811-4468-abef-f6a23c67a462-kube-api-access-pkttf\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:31:36.955169 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.955094    2579 generic.go:356] "Generic (PLEG): container finished" podID="6a869b29-6811-4468-abef-f6a23c67a462" containerID="454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249" exitCode=0
Sep 19 09:31:36.955169 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.955139    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"
Sep 19 09:31:36.955425 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.955189    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp" event={"ID":"6a869b29-6811-4468-abef-f6a23c67a462","Type":"ContainerDied","Data":"454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249"}
Sep 19 09:31:36.955425 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.955245    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp" event={"ID":"6a869b29-6811-4468-abef-f6a23c67a462","Type":"ContainerDied","Data":"fa8b6e057e51888a1f185a4e5e056dceff0c5c1af76ddc920a20bb044ba390ab"}
Sep 19 09:31:36.955425 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.955276    2579 scope.go:117] "RemoveContainer" containerID="454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249"
Sep 19 09:31:36.964681 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.964660    2579 scope.go:117] "RemoveContainer" containerID="454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249"
Sep 19 09:31:36.964945 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:31:36.964925    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249\": container with ID starting with 454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249 not found: ID does not exist" containerID="454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249"
Sep 19 09:31:36.964994 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.964954    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249"} err="failed to get container status \"454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249\": rpc error: code = NotFound desc = could not find container \"454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249\": container with ID starting with 454eac9b553b7221b22ecbe451f5bca452bfff7cb4ac92b66f488cdaa5a08249 not found: ID does not exist"
Sep 19 09:31:36.976215 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.976167    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"]
Sep 19 09:31:36.979066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:36.979041    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ac387c-84744fd5fc-rdxnp"]
Sep 19 09:31:38.904109 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:38.904076    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a869b29-6811-4468-abef-f6a23c67a462" path="/var/lib/kubelet/pods/6a869b29-6811-4468-abef-f6a23c67a462/volumes"
Sep 19 09:31:41.926319 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:41.926279    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:31:41.926688 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:41.926371    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:31:53.568994 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.568959    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"]
Sep 19 09:31:53.569412 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.569399    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a869b29-6811-4468-abef-f6a23c67a462" containerName="payload-processing"
Sep 19 09:31:53.569461 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.569413    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a869b29-6811-4468-abef-f6a23c67a462" containerName="payload-processing"
Sep 19 09:31:53.569510 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.569501    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a869b29-6811-4468-abef-f6a23c67a462" containerName="payload-processing"
Sep 19 09:31:53.572564 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.572549    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:31:53.576011 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.575986    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-66c0fb\""
Sep 19 09:31:53.579538 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.579520    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-66c0fb-dockercfg-cnw7h\""
Sep 19 09:31:53.593161 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.593141    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"]
Sep 19 09:31:53.646760 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.646725    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"]
Sep 19 09:31:53.650835 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.650805    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:31:53.661948 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.661916    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"]
Sep 19 09:31:53.709557 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.709519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gpbc\" (UniqueName: \"kubernetes.io/projected/2f400e83-5689-4cbb-a790-8c3ed6b4f755-kube-api-access-7gpbc\") pod \"payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw\" (UID: \"2f400e83-5689-4cbb-a790-8c3ed6b4f755\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:31:53.709557 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.709565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f400e83-5689-4cbb-a790-8c3ed6b4f755-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw\" (UID: \"2f400e83-5689-4cbb-a790-8c3ed6b4f755\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:31:53.709768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.709587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m28pq\" (UniqueName: \"kubernetes.io/projected/6df3eb58-a5c5-4226-ab42-ec9761f89d13-kube-api-access-m28pq\") pod \"payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q\" (UID: \"6df3eb58-a5c5-4226-ab42-ec9761f89d13\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:31:53.709768 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.709641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df3eb58-a5c5-4226-ab42-ec9761f89d13-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q\" (UID: \"6df3eb58-a5c5-4226-ab42-ec9761f89d13\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:31:53.810656 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.810624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gpbc\" (UniqueName: \"kubernetes.io/projected/2f400e83-5689-4cbb-a790-8c3ed6b4f755-kube-api-access-7gpbc\") pod \"payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw\" (UID: \"2f400e83-5689-4cbb-a790-8c3ed6b4f755\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:31:53.810824 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.810665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f400e83-5689-4cbb-a790-8c3ed6b4f755-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw\" (UID: \"2f400e83-5689-4cbb-a790-8c3ed6b4f755\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:31:53.810824 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.810685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m28pq\" (UniqueName: \"kubernetes.io/projected/6df3eb58-a5c5-4226-ab42-ec9761f89d13-kube-api-access-m28pq\") pod \"payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q\" (UID: \"6df3eb58-a5c5-4226-ab42-ec9761f89d13\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:31:53.810824 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.810725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df3eb58-a5c5-4226-ab42-ec9761f89d13-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q\" (UID: \"6df3eb58-a5c5-4226-ab42-ec9761f89d13\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:31:53.811388 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.811371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f400e83-5689-4cbb-a790-8c3ed6b4f755-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw\" (UID: \"2f400e83-5689-4cbb-a790-8c3ed6b4f755\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:31:53.811481 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.811463    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df3eb58-a5c5-4226-ab42-ec9761f89d13-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q\" (UID: \"6df3eb58-a5c5-4226-ab42-ec9761f89d13\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:31:53.820297 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.820235    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gpbc\" (UniqueName: \"kubernetes.io/projected/2f400e83-5689-4cbb-a790-8c3ed6b4f755-kube-api-access-7gpbc\") pod \"payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw\" (UID: \"2f400e83-5689-4cbb-a790-8c3ed6b4f755\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:31:53.820875 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.820853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m28pq\" (UniqueName: \"kubernetes.io/projected/6df3eb58-a5c5-4226-ab42-ec9761f89d13-kube-api-access-m28pq\") pod \"payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q\" (UID: \"6df3eb58-a5c5-4226-ab42-ec9761f89d13\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:31:53.882159 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.882131    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:31:53.974503 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:53.973265    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:31:54.158652 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:54.158626    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"]
Sep 19 09:31:54.160060 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:31:54.160035    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f400e83_5689_4cbb_a790_8c3ed6b4f755.slice/crio-0178d25a42a45b24eda5101a559f914d24049161638f1505fb81be3e461aef93 WatchSource:0}: Error finding container 0178d25a42a45b24eda5101a559f914d24049161638f1505fb81be3e461aef93: Status 404 returned error can't find the container with id 0178d25a42a45b24eda5101a559f914d24049161638f1505fb81be3e461aef93
Sep 19 09:31:54.257829 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:54.257801    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"]
Sep 19 09:31:54.259166 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:31:54.259142    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df3eb58_a5c5_4226_ab42_ec9761f89d13.slice/crio-feb1c0726644c9e5434a1cbea80dba5bf6ed94f1700c2b95774ba3e507a255e8 WatchSource:0}: Error finding container feb1c0726644c9e5434a1cbea80dba5bf6ed94f1700c2b95774ba3e507a255e8: Status 404 returned error can't find the container with id feb1c0726644c9e5434a1cbea80dba5bf6ed94f1700c2b95774ba3e507a255e8
Sep 19 09:31:55.063036 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:55.062977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw" event={"ID":"2f400e83-5689-4cbb-a790-8c3ed6b4f755","Type":"ContainerStarted","Data":"4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24"}
Sep 19 09:31:55.063496 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:55.063063    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:31:55.063496 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:55.063091    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw" event={"ID":"2f400e83-5689-4cbb-a790-8c3ed6b4f755","Type":"ContainerStarted","Data":"0178d25a42a45b24eda5101a559f914d24049161638f1505fb81be3e461aef93"}
Sep 19 09:31:55.064655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:55.064630    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q" event={"ID":"6df3eb58-a5c5-4226-ab42-ec9761f89d13","Type":"ContainerStarted","Data":"5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108"}
Sep 19 09:31:55.064787 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:55.064679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q" event={"ID":"6df3eb58-a5c5-4226-ab42-ec9761f89d13","Type":"ContainerStarted","Data":"feb1c0726644c9e5434a1cbea80dba5bf6ed94f1700c2b95774ba3e507a255e8"}
Sep 19 09:31:55.064787 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:55.064727    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:31:55.088493 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:55.088446    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw" podStartSLOduration=2.088430028 podStartE2EDuration="2.088430028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:31:55.085917247 +0000 UTC m=+1498.253112489" watchObservedRunningTime="2026-09-19 09:31:55.088430028 +0000 UTC m=+1498.255625257"
Sep 19 09:31:55.111119 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:55.110957    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q" podStartSLOduration=2.110934526 podStartE2EDuration="2.110934526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:31:55.109143882 +0000 UTC m=+1498.276339103" watchObservedRunningTime="2026-09-19 09:31:55.110934526 +0000 UTC m=+1498.278129757"
Sep 19 09:31:58.957196 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:58.957168    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:31:58.957674 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:31:58.957206    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:32:06.073620 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:06.073589    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:32:06.074008 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:06.073659    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:32:21.008194 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.008115    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"]
Sep 19 09:32:21.012078 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.012057    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.014299 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.014278    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-e200e8-openshift-default-dockercfg-mbj6w\""
Sep 19 09:32:21.027098 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.027072    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"]
Sep 19 09:32:21.087143 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.087108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-data\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.087143 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.087143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znbm8\" (UniqueName: \"kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-kube-api-access-znbm8\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.087351 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.087174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23e3503d-360f-464d-ba80-9ac36db43c45-istiod-ca-cert\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.087351 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.087213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-istio-token\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.087351 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.087230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23e3503d-360f-464d-ba80-9ac36db43c45-istio-podinfo\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.087351 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.087258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-certs\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.087351 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.087325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-credential-socket\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.087513 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.087367    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-socket\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.087513 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.087386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-envoy\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.188450 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.188411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-credential-socket\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.188623 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.188476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-socket\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.188623 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.188511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-envoy\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.188623 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.188554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-data\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.188623 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.188579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znbm8\" (UniqueName: \"kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-kube-api-access-znbm8\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.188623 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.188621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23e3503d-360f-464d-ba80-9ac36db43c45-istiod-ca-cert\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.188899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.188645    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-istio-token\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.188899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.188673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23e3503d-360f-464d-ba80-9ac36db43c45-istio-podinfo\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.188899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.188720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-certs\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.188899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.188855    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-socket\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.189117 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.188981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-data\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.189117 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.189006    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-certs\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.189229 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.189212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-credential-socket\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.189464 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.189412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23e3503d-360f-464d-ba80-9ac36db43c45-istiod-ca-cert\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.191005 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.190975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-envoy\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.191254 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.191237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23e3503d-360f-464d-ba80-9ac36db43c45-istio-podinfo\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.196862 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.196838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-istio-token\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.197343 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.197322    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znbm8\" (UniqueName: \"kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-kube-api-access-znbm8\") pod \"e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") " pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.322423 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.322391    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:21.610872 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.610846    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"]
Sep 19 09:32:21.612112 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:32:21.612078    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e3503d_360f_464d_ba80_9ac36db43c45.slice/crio-2b65e6e7fa3b91b8f6ba93173972243f7dd7bf3ffe5943f00efa9a5b13504c5b WatchSource:0}: Error finding container 2b65e6e7fa3b91b8f6ba93173972243f7dd7bf3ffe5943f00efa9a5b13504c5b: Status 404 returned error can't find the container with id 2b65e6e7fa3b91b8f6ba93173972243f7dd7bf3ffe5943f00efa9a5b13504c5b
Sep 19 09:32:21.614428 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.614396    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:32:21.614521 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.614470    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:32:21.614521 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:21.614513    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:32:22.224409 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:22.224374    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq" event={"ID":"23e3503d-360f-464d-ba80-9ac36db43c45","Type":"ContainerStarted","Data":"0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36"}
Sep 19 09:32:22.224793 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:22.224425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq" event={"ID":"23e3503d-360f-464d-ba80-9ac36db43c45","Type":"ContainerStarted","Data":"2b65e6e7fa3b91b8f6ba93173972243f7dd7bf3ffe5943f00efa9a5b13504c5b"}
Sep 19 09:32:22.245370 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:22.245320    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq" podStartSLOduration=2.245306167 podStartE2EDuration="2.245306167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:32:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:32:22.243911644 +0000 UTC m=+1525.411106872" watchObservedRunningTime="2026-09-19 09:32:22.245306167 +0000 UTC m=+1525.412501397"
Sep 19 09:32:22.322959 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:22.322924    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:22.327946 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:22.327920    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:23.229835 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:23.229792    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:23.230690 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:23.230672    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:32:38.096065 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.096035    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"]
Sep 19 09:32:38.101123 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.101108    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:32:38.104453 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.104429    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e46994f4\""
Sep 19 09:32:38.104545 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.104522    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e46994f4-dockercfg-bmjzr\""
Sep 19 09:32:38.114864 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.114838    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"]
Sep 19 09:32:38.151284 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.151249    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"]
Sep 19 09:32:38.154970 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.154954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:32:38.166162 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.166139    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"]
Sep 19 09:32:38.267434 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.267388    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jgtk\" (UniqueName: \"kubernetes.io/projected/92d55501-c8a3-4573-9388-771b34435bd6-kube-api-access-9jgtk\") pod \"payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf\" (UID: \"92d55501-c8a3-4573-9388-771b34435bd6\") " pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:32:38.267628 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.267496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln\" (UID: \"db6d8a5c-9e4a-4096-ad54-3d687c39acc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:32:38.267628 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.267543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92d55501-c8a3-4573-9388-771b34435bd6-plugins-config-volume\") pod \"payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf\" (UID: \"92d55501-c8a3-4573-9388-771b34435bd6\") " pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:32:38.267628 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.267587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j222c\" (UniqueName: \"kubernetes.io/projected/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-kube-api-access-j222c\") pod \"payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln\" (UID: \"db6d8a5c-9e4a-4096-ad54-3d687c39acc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:32:38.368875 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.368781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jgtk\" (UniqueName: \"kubernetes.io/projected/92d55501-c8a3-4573-9388-771b34435bd6-kube-api-access-9jgtk\") pod \"payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf\" (UID: \"92d55501-c8a3-4573-9388-771b34435bd6\") " pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:32:38.368875 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.368863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln\" (UID: \"db6d8a5c-9e4a-4096-ad54-3d687c39acc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:32:38.369167 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.368898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92d55501-c8a3-4573-9388-771b34435bd6-plugins-config-volume\") pod \"payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf\" (UID: \"92d55501-c8a3-4573-9388-771b34435bd6\") " pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:32:38.369167 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.368929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j222c\" (UniqueName: \"kubernetes.io/projected/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-kube-api-access-j222c\") pod \"payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln\" (UID: \"db6d8a5c-9e4a-4096-ad54-3d687c39acc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:32:38.369580 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.369560    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92d55501-c8a3-4573-9388-771b34435bd6-plugins-config-volume\") pod \"payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf\" (UID: \"92d55501-c8a3-4573-9388-771b34435bd6\") " pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:32:38.369625 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.369568    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln\" (UID: \"db6d8a5c-9e4a-4096-ad54-3d687c39acc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:32:38.377177 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.377157    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j222c\" (UniqueName: \"kubernetes.io/projected/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-kube-api-access-j222c\") pod \"payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln\" (UID: \"db6d8a5c-9e4a-4096-ad54-3d687c39acc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:32:38.377286 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.377267    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jgtk\" (UniqueName: \"kubernetes.io/projected/92d55501-c8a3-4573-9388-771b34435bd6-kube-api-access-9jgtk\") pod \"payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf\" (UID: \"92d55501-c8a3-4573-9388-771b34435bd6\") " pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:32:38.411965 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.411930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:32:38.465889 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.465846    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:32:38.688165 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.688143    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"]
Sep 19 09:32:38.689870 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:32:38.689845    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d55501_c8a3_4573_9388_771b34435bd6.slice/crio-5cb6376182c89cbfc4607b52f15434dde6a56672f1294ccccad2e2c4c1f7b6d0 WatchSource:0}: Error finding container 5cb6376182c89cbfc4607b52f15434dde6a56672f1294ccccad2e2c4c1f7b6d0: Status 404 returned error can't find the container with id 5cb6376182c89cbfc4607b52f15434dde6a56672f1294ccccad2e2c4c1f7b6d0
Sep 19 09:32:38.751706 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:38.751675    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"]
Sep 19 09:32:38.751968 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:32:38.751948    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb6d8a5c_9e4a_4096_ad54_3d687c39acc1.slice/crio-7584c7030779419b96296021051ae321fad00236c7fe4d02888b2dee78e5ab26 WatchSource:0}: Error finding container 7584c7030779419b96296021051ae321fad00236c7fe4d02888b2dee78e5ab26: Status 404 returned error can't find the container with id 7584c7030779419b96296021051ae321fad00236c7fe4d02888b2dee78e5ab26
Sep 19 09:32:39.326291 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:39.326246    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln" event={"ID":"db6d8a5c-9e4a-4096-ad54-3d687c39acc1","Type":"ContainerStarted","Data":"eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99"}
Sep 19 09:32:39.326769 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:39.326309    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln" event={"ID":"db6d8a5c-9e4a-4096-ad54-3d687c39acc1","Type":"ContainerStarted","Data":"7584c7030779419b96296021051ae321fad00236c7fe4d02888b2dee78e5ab26"}
Sep 19 09:32:39.326769 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:39.326462    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:32:39.328029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:39.327982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf" event={"ID":"92d55501-c8a3-4573-9388-771b34435bd6","Type":"ContainerStarted","Data":"152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d"}
Sep 19 09:32:39.328124 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:39.328061    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf" event={"ID":"92d55501-c8a3-4573-9388-771b34435bd6","Type":"ContainerStarted","Data":"5cb6376182c89cbfc4607b52f15434dde6a56672f1294ccccad2e2c4c1f7b6d0"}
Sep 19 09:32:39.328124 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:39.328091    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:32:39.349897 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:39.349843    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln" podStartSLOduration=1.3498244609999999 podStartE2EDuration="1.349824461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:32:39.347516571 +0000 UTC m=+1542.514711800" watchObservedRunningTime="2026-09-19 09:32:39.349824461 +0000 UTC m=+1542.517019695"
Sep 19 09:32:39.371119 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:39.371070    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf" podStartSLOduration=1.371049802 podStartE2EDuration="1.371049802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:32:39.369440929 +0000 UTC m=+1542.536636160" watchObservedRunningTime="2026-09-19 09:32:39.371049802 +0000 UTC m=+1542.538245033"
Sep 19 09:32:50.337596 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:50.337566    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:32:50.337923 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:32:50.337791    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:33:14.776896 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:14.776866    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"]
Sep 19 09:33:14.781900 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:14.781882    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"
Sep 19 09:33:14.786973 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:14.786949    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:33:14.787303 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:14.787286    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:33:14.797628 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:14.797605    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"]
Sep 19 09:33:14.946041 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:14.945989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9d9d547-de4c-46b7-a3ef-9180f7003293-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft\" (UID: \"e9d9d547-de4c-46b7-a3ef-9180f7003293\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"
Sep 19 09:33:15.047429 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:15.047389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9d9d547-de4c-46b7-a3ef-9180f7003293-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft\" (UID: \"e9d9d547-de4c-46b7-a3ef-9180f7003293\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"
Sep 19 09:33:15.048374 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:15.048346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9d9d547-de4c-46b7-a3ef-9180f7003293-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft\" (UID: \"e9d9d547-de4c-46b7-a3ef-9180f7003293\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"
Sep 19 09:33:15.091240 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:15.091212    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"
Sep 19 09:33:15.363339 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:15.363314    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"]
Sep 19 09:33:15.365350 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:33:15.365325    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d9d547_de4c_46b7_a3ef_9180f7003293.slice/crio-fbdf62a04b6cbedee68db639198312b840124878715bf6d5b64c7bade6f90318 WatchSource:0}: Error finding container fbdf62a04b6cbedee68db639198312b840124878715bf6d5b64c7bade6f90318: Status 404 returned error can't find the container with id fbdf62a04b6cbedee68db639198312b840124878715bf6d5b64c7bade6f90318
Sep 19 09:33:15.549237 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:15.549204    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft" event={"ID":"e9d9d547-de4c-46b7-a3ef-9180f7003293","Type":"ContainerStarted","Data":"fbdf62a04b6cbedee68db639198312b840124878715bf6d5b64c7bade6f90318"}
Sep 19 09:33:16.556597 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:16.556567    2579 generic.go:356] "Generic (PLEG): container finished" podID="e9d9d547-de4c-46b7-a3ef-9180f7003293" containerID="26d37c17dd9ed7822899338aced5ae2dfcb651ed415a5e3863fafc9b14a520c0" exitCode=0
Sep 19 09:33:16.556975 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:16.556616    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft" event={"ID":"e9d9d547-de4c-46b7-a3ef-9180f7003293","Type":"ContainerDied","Data":"26d37c17dd9ed7822899338aced5ae2dfcb651ed415a5e3863fafc9b14a520c0"}
Sep 19 09:33:17.705794 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:17.705767    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"
Sep 19 09:33:17.875931 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:17.875836    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9d9d547-de4c-46b7-a3ef-9180f7003293-maas-api-service-ca\") pod \"e9d9d547-de4c-46b7-a3ef-9180f7003293\" (UID: \"e9d9d547-de4c-46b7-a3ef-9180f7003293\") "
Sep 19 09:33:17.876229 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:17.876205    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9d9d547-de4c-46b7-a3ef-9180f7003293-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9d9d547-de4c-46b7-a3ef-9180f7003293" (UID: "e9d9d547-de4c-46b7-a3ef-9180f7003293"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:33:17.976937 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:17.976894    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9d9d547-de4c-46b7-a3ef-9180f7003293-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:18.569912 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:18.569882    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"
Sep 19 09:33:18.569912 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:18.569903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft" event={"ID":"e9d9d547-de4c-46b7-a3ef-9180f7003293","Type":"ContainerDied","Data":"fbdf62a04b6cbedee68db639198312b840124878715bf6d5b64c7bade6f90318"}
Sep 19 09:33:18.570156 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:18.569950    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbdf62a04b6cbedee68db639198312b840124878715bf6d5b64c7bade6f90318"
Sep 19 09:33:25.334221 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:25.334185    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh"]
Sep 19 09:33:25.338578 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:25.338554    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9dfb0f-29830170-jr4sh"]
Sep 19 09:33:25.541773 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:25.541738    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"]
Sep 19 09:33:25.544725 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:25.544700    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9dfb0f-cvcft"]
Sep 19 09:33:26.904836 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:26.904803    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a42228c-144f-4271-82a2-48fe62c07205" path="/var/lib/kubelet/pods/0a42228c-144f-4271-82a2-48fe62c07205/volumes"
Sep 19 09:33:26.905213 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:26.905110    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9d9d547-de4c-46b7-a3ef-9180f7003293" path="/var/lib/kubelet/pods/e9d9d547-de4c-46b7-a3ef-9180f7003293/volumes"
Sep 19 09:33:33.073794 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.073763    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"]
Sep 19 09:33:33.074300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.074286    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d9d547-de4c-46b7-a3ef-9180f7003293" containerName="revoke-keys"
Sep 19 09:33:33.074345 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.074302    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d9d547-de4c-46b7-a3ef-9180f7003293" containerName="revoke-keys"
Sep 19 09:33:33.074390 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.074380    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d9d547-de4c-46b7-a3ef-9180f7003293" containerName="revoke-keys"
Sep 19 09:33:33.078122 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.078105    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"
Sep 19 09:33:33.080248 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.080228    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:33:33.080362 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.080287    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:33:33.086362 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.086334    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"]
Sep 19 09:33:33.130518 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.130485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f232bd2-31a7-4af2-afa5-f0714df6e3e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c18110-pzswt\" (UID: \"2f232bd2-31a7-4af2-afa5-f0714df6e3e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"
Sep 19 09:33:33.231781 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.231754    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f232bd2-31a7-4af2-afa5-f0714df6e3e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c18110-pzswt\" (UID: \"2f232bd2-31a7-4af2-afa5-f0714df6e3e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"
Sep 19 09:33:33.232441 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.232417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f232bd2-31a7-4af2-afa5-f0714df6e3e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c18110-pzswt\" (UID: \"2f232bd2-31a7-4af2-afa5-f0714df6e3e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"
Sep 19 09:33:33.389987 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.389900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"
Sep 19 09:33:33.662624 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:33.662591    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"]
Sep 19 09:33:33.664871 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:33:33.664846    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f232bd2_31a7_4af2_afa5_f0714df6e3e9.slice/crio-fe85f217b236bd0dba2ce0c763b9311db467925c4714b10deaae08cbb3ce3f50 WatchSource:0}: Error finding container fe85f217b236bd0dba2ce0c763b9311db467925c4714b10deaae08cbb3ce3f50: Status 404 returned error can't find the container with id fe85f217b236bd0dba2ce0c763b9311db467925c4714b10deaae08cbb3ce3f50
Sep 19 09:33:34.671791 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:34.671688    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f232bd2-31a7-4af2-afa5-f0714df6e3e9" containerID="63bd5954c8f1fd20cc8afbde3af13c54cdeec2ca7ec1a53c7b35744245e303fb" exitCode=0
Sep 19 09:33:34.671791 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:34.671750    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt" event={"ID":"2f232bd2-31a7-4af2-afa5-f0714df6e3e9","Type":"ContainerDied","Data":"63bd5954c8f1fd20cc8afbde3af13c54cdeec2ca7ec1a53c7b35744245e303fb"}
Sep 19 09:33:34.672201 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:34.671796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt" event={"ID":"2f232bd2-31a7-4af2-afa5-f0714df6e3e9","Type":"ContainerStarted","Data":"fe85f217b236bd0dba2ce0c763b9311db467925c4714b10deaae08cbb3ce3f50"}
Sep 19 09:33:35.816343 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:35.816313    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"
Sep 19 09:33:35.859190 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:35.859153    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f232bd2-31a7-4af2-afa5-f0714df6e3e9-maas-api-service-ca\") pod \"2f232bd2-31a7-4af2-afa5-f0714df6e3e9\" (UID: \"2f232bd2-31a7-4af2-afa5-f0714df6e3e9\") "
Sep 19 09:33:35.859535 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:35.859511    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f232bd2-31a7-4af2-afa5-f0714df6e3e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f232bd2-31a7-4af2-afa5-f0714df6e3e9" (UID: "2f232bd2-31a7-4af2-afa5-f0714df6e3e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:33:35.960818 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:35.960714    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f232bd2-31a7-4af2-afa5-f0714df6e3e9-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:36.685946 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:36.685919    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"
Sep 19 09:33:36.686138 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:36.685914    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt" event={"ID":"2f232bd2-31a7-4af2-afa5-f0714df6e3e9","Type":"ContainerDied","Data":"fe85f217b236bd0dba2ce0c763b9311db467925c4714b10deaae08cbb3ce3f50"}
Sep 19 09:33:36.686138 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:36.686067    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe85f217b236bd0dba2ce0c763b9311db467925c4714b10deaae08cbb3ce3f50"
Sep 19 09:33:43.644300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:43.644218    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"]
Sep 19 09:33:43.644724 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:43.644476    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf" podUID="be3d2d15-c604-42e2-877b-0a74f31c8843" containerName="payload-processing" containerID="cri-o://2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89" gracePeriod=30
Sep 19 09:33:43.651996 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:43.651924    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"]
Sep 19 09:33:43.652253 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:43.652227    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b" podUID="39679ffb-7f6e-4eea-a612-d138cab85cd8" containerName="payload-pre-processing" containerID="cri-o://a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71" gracePeriod=30
Sep 19 09:33:43.818538 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:43.818478    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"]
Sep 19 09:33:43.822529 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:43.822495    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c18110-pzswt"]
Sep 19 09:33:43.929662 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:43.929639    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:33:43.932357 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:43.932335    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:33:44.048652 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.048618    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39679ffb-7f6e-4eea-a612-d138cab85cd8-plugins-config-volume\") pod \"39679ffb-7f6e-4eea-a612-d138cab85cd8\" (UID: \"39679ffb-7f6e-4eea-a612-d138cab85cd8\") "
Sep 19 09:33:44.048824 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.048704    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs4dd\" (UniqueName: \"kubernetes.io/projected/39679ffb-7f6e-4eea-a612-d138cab85cd8-kube-api-access-vs4dd\") pod \"39679ffb-7f6e-4eea-a612-d138cab85cd8\" (UID: \"39679ffb-7f6e-4eea-a612-d138cab85cd8\") "
Sep 19 09:33:44.048824 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.048734    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be3d2d15-c604-42e2-877b-0a74f31c8843-plugins-config-volume\") pod \"be3d2d15-c604-42e2-877b-0a74f31c8843\" (UID: \"be3d2d15-c604-42e2-877b-0a74f31c8843\") "
Sep 19 09:33:44.048824 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.048818    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvmrm\" (UniqueName: \"kubernetes.io/projected/be3d2d15-c604-42e2-877b-0a74f31c8843-kube-api-access-lvmrm\") pod \"be3d2d15-c604-42e2-877b-0a74f31c8843\" (UID: \"be3d2d15-c604-42e2-877b-0a74f31c8843\") "
Sep 19 09:33:44.048994 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.048966    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39679ffb-7f6e-4eea-a612-d138cab85cd8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "39679ffb-7f6e-4eea-a612-d138cab85cd8" (UID: "39679ffb-7f6e-4eea-a612-d138cab85cd8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:33:44.049166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.049146    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be3d2d15-c604-42e2-877b-0a74f31c8843-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be3d2d15-c604-42e2-877b-0a74f31c8843" (UID: "be3d2d15-c604-42e2-877b-0a74f31c8843"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:33:44.049238 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.049217    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be3d2d15-c604-42e2-877b-0a74f31c8843-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:44.049288 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.049237    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39679ffb-7f6e-4eea-a612-d138cab85cd8-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:44.051083 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.051059    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be3d2d15-c604-42e2-877b-0a74f31c8843-kube-api-access-lvmrm" (OuterVolumeSpecName: "kube-api-access-lvmrm") pod "be3d2d15-c604-42e2-877b-0a74f31c8843" (UID: "be3d2d15-c604-42e2-877b-0a74f31c8843"). InnerVolumeSpecName "kube-api-access-lvmrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:33:44.051192 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.051135    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39679ffb-7f6e-4eea-a612-d138cab85cd8-kube-api-access-vs4dd" (OuterVolumeSpecName: "kube-api-access-vs4dd") pod "39679ffb-7f6e-4eea-a612-d138cab85cd8" (UID: "39679ffb-7f6e-4eea-a612-d138cab85cd8"). InnerVolumeSpecName "kube-api-access-vs4dd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:33:44.149818 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.149786    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvmrm\" (UniqueName: \"kubernetes.io/projected/be3d2d15-c604-42e2-877b-0a74f31c8843-kube-api-access-lvmrm\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:44.149818 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.149815    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs4dd\" (UniqueName: \"kubernetes.io/projected/39679ffb-7f6e-4eea-a612-d138cab85cd8-kube-api-access-vs4dd\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:44.737505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.737472    2579 generic.go:356] "Generic (PLEG): container finished" podID="39679ffb-7f6e-4eea-a612-d138cab85cd8" containerID="a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71" exitCode=0
Sep 19 09:33:44.737927 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.737518    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"
Sep 19 09:33:44.737927 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.737553    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b" event={"ID":"39679ffb-7f6e-4eea-a612-d138cab85cd8","Type":"ContainerDied","Data":"a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71"}
Sep 19 09:33:44.737927 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.737605    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b" event={"ID":"39679ffb-7f6e-4eea-a612-d138cab85cd8","Type":"ContainerDied","Data":"e94ac5ca9582c0e731e8d9696902e40ff0d73585e248c7a01ed43eda9992956c"}
Sep 19 09:33:44.737927 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.737627    2579 scope.go:117] "RemoveContainer" containerID="a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71"
Sep 19 09:33:44.738983 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.738966    2579 generic.go:356] "Generic (PLEG): container finished" podID="be3d2d15-c604-42e2-877b-0a74f31c8843" containerID="2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89" exitCode=0
Sep 19 09:33:44.739091 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.739001    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"
Sep 19 09:33:44.739146 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.739005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf" event={"ID":"be3d2d15-c604-42e2-877b-0a74f31c8843","Type":"ContainerDied","Data":"2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89"}
Sep 19 09:33:44.739146 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.739126    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf" event={"ID":"be3d2d15-c604-42e2-877b-0a74f31c8843","Type":"ContainerDied","Data":"cfb5ad8e2908ccaff9effdbb78c374673165d2c57ce2ad5de3d4433296152156"}
Sep 19 09:33:44.747627 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.747611    2579 scope.go:117] "RemoveContainer" containerID="a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71"
Sep 19 09:33:44.747973 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:33:44.747929    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71\": container with ID starting with a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71 not found: ID does not exist" containerID="a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71"
Sep 19 09:33:44.748093 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.747969    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71"} err="failed to get container status \"a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71\": rpc error: code = NotFound desc = could not find container \"a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71\": container with ID starting with a29aa1a48acafffb532e566b2fb9cb001dfb8437fd91c3708f9287dfa8980e71 not found: ID does not exist"
Sep 19 09:33:44.748093 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.747990    2579 scope.go:117] "RemoveContainer" containerID="2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89"
Sep 19 09:33:44.756832 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.756812    2579 scope.go:117] "RemoveContainer" containerID="2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89"
Sep 19 09:33:44.757322 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:33:44.757297    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89\": container with ID starting with 2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89 not found: ID does not exist" containerID="2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89"
Sep 19 09:33:44.757436 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.757332    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89"} err="failed to get container status \"2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89\": rpc error: code = NotFound desc = could not find container \"2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89\": container with ID starting with 2acd484218f9ebf48188a4715903dc2097fefe5bd120d068950d6aefb4a1ea89 not found: ID does not exist"
Sep 19 09:33:44.770586 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.770557    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"]
Sep 19 09:33:44.774601 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.774566    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c18110-d66f87b6c-klsnf"]
Sep 19 09:33:44.804869 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.804827    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"]
Sep 19 09:33:44.808281 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.808258    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c18110-5f6954d8d6-84h7b"]
Sep 19 09:33:44.904118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.904080    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f232bd2-31a7-4af2-afa5-f0714df6e3e9" path="/var/lib/kubelet/pods/2f232bd2-31a7-4af2-afa5-f0714df6e3e9/volumes"
Sep 19 09:33:44.904478 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.904464    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39679ffb-7f6e-4eea-a612-d138cab85cd8" path="/var/lib/kubelet/pods/39679ffb-7f6e-4eea-a612-d138cab85cd8/volumes"
Sep 19 09:33:44.904777 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:44.904766    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be3d2d15-c604-42e2-877b-0a74f31c8843" path="/var/lib/kubelet/pods/be3d2d15-c604-42e2-877b-0a74f31c8843/volumes"
Sep 19 09:33:45.741740 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:45.741702    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"]
Sep 19 09:33:45.742184 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:45.741923    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq" podUID="23e3503d-360f-464d-ba80-9ac36db43c45" containerName="istio-proxy" containerID="cri-o://0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36" gracePeriod=30
Sep 19 09:33:50.986852 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:50.986828    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:33:51.128073 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128010    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-credential-socket\") pod \"23e3503d-360f-464d-ba80-9ac36db43c45\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") "
Sep 19 09:33:51.128073 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128081    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-certs\") pod \"23e3503d-360f-464d-ba80-9ac36db43c45\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") "
Sep 19 09:33:51.128341 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128103    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znbm8\" (UniqueName: \"kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-kube-api-access-znbm8\") pod \"23e3503d-360f-464d-ba80-9ac36db43c45\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") "
Sep 19 09:33:51.128341 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128149    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23e3503d-360f-464d-ba80-9ac36db43c45-istiod-ca-cert\") pod \"23e3503d-360f-464d-ba80-9ac36db43c45\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") "
Sep 19 09:33:51.128341 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128208    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23e3503d-360f-464d-ba80-9ac36db43c45-istio-podinfo\") pod \"23e3503d-360f-464d-ba80-9ac36db43c45\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") "
Sep 19 09:33:51.128341 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128242    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-istio-token\") pod \"23e3503d-360f-464d-ba80-9ac36db43c45\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") "
Sep 19 09:33:51.128341 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128264    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-data\") pod \"23e3503d-360f-464d-ba80-9ac36db43c45\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") "
Sep 19 09:33:51.128341 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128310    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-envoy\") pod \"23e3503d-360f-464d-ba80-9ac36db43c45\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") "
Sep 19 09:33:51.128650 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128330    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "23e3503d-360f-464d-ba80-9ac36db43c45" (UID: "23e3503d-360f-464d-ba80-9ac36db43c45"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:33:51.128650 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128372    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-socket\") pod \"23e3503d-360f-464d-ba80-9ac36db43c45\" (UID: \"23e3503d-360f-464d-ba80-9ac36db43c45\") "
Sep 19 09:33:51.128650 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128443    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "23e3503d-360f-464d-ba80-9ac36db43c45" (UID: "23e3503d-360f-464d-ba80-9ac36db43c45"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:33:51.128844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128716    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-credential-socket\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:51.128844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128734    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-certs\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:51.128844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128731    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "23e3503d-360f-464d-ba80-9ac36db43c45" (UID: "23e3503d-360f-464d-ba80-9ac36db43c45"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:33:51.128844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128646    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23e3503d-360f-464d-ba80-9ac36db43c45-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "23e3503d-360f-464d-ba80-9ac36db43c45" (UID: "23e3503d-360f-464d-ba80-9ac36db43c45"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:33:51.128844 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.128812    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-data" (OuterVolumeSpecName: "istio-data") pod "23e3503d-360f-464d-ba80-9ac36db43c45" (UID: "23e3503d-360f-464d-ba80-9ac36db43c45"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:33:51.130564 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.130536    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "23e3503d-360f-464d-ba80-9ac36db43c45" (UID: "23e3503d-360f-464d-ba80-9ac36db43c45"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:33:51.130667 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.130588    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-istio-token" (OuterVolumeSpecName: "istio-token") pod "23e3503d-360f-464d-ba80-9ac36db43c45" (UID: "23e3503d-360f-464d-ba80-9ac36db43c45"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:33:51.130724 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.130681    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-kube-api-access-znbm8" (OuterVolumeSpecName: "kube-api-access-znbm8") pod "23e3503d-360f-464d-ba80-9ac36db43c45" (UID: "23e3503d-360f-464d-ba80-9ac36db43c45"). InnerVolumeSpecName "kube-api-access-znbm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:33:51.130764 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.130732    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23e3503d-360f-464d-ba80-9ac36db43c45-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "23e3503d-360f-464d-ba80-9ac36db43c45" (UID: "23e3503d-360f-464d-ba80-9ac36db43c45"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 09:33:51.229643 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.229604    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znbm8\" (UniqueName: \"kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-kube-api-access-znbm8\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:51.229643 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.229638    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23e3503d-360f-464d-ba80-9ac36db43c45-istiod-ca-cert\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:51.229643 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.229648    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23e3503d-360f-464d-ba80-9ac36db43c45-istio-podinfo\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:51.229879 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.229656    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23e3503d-360f-464d-ba80-9ac36db43c45-istio-token\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:51.229879 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.229664    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-data\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:51.229879 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.229670    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-istio-envoy\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:51.229879 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.229677    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e3503d-360f-464d-ba80-9ac36db43c45-workload-socket\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:33:51.785318 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.785282    2579 generic.go:356] "Generic (PLEG): container finished" podID="23e3503d-360f-464d-ba80-9ac36db43c45" containerID="0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36" exitCode=0
Sep 19 09:33:51.785504 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.785345    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"
Sep 19 09:33:51.785504 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.785370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq" event={"ID":"23e3503d-360f-464d-ba80-9ac36db43c45","Type":"ContainerDied","Data":"0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36"}
Sep 19 09:33:51.785504 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.785469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq" event={"ID":"23e3503d-360f-464d-ba80-9ac36db43c45","Type":"ContainerDied","Data":"2b65e6e7fa3b91b8f6ba93173972243f7dd7bf3ffe5943f00efa9a5b13504c5b"}
Sep 19 09:33:51.785504 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.785498    2579 scope.go:117] "RemoveContainer" containerID="0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36"
Sep 19 09:33:51.795814 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.795795    2579 scope.go:117] "RemoveContainer" containerID="0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36"
Sep 19 09:33:51.796132 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:33:51.796112    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36\": container with ID starting with 0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36 not found: ID does not exist" containerID="0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36"
Sep 19 09:33:51.796208 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.796151    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36"} err="failed to get container status \"0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36\": rpc error: code = NotFound desc = could not find container \"0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36\": container with ID starting with 0df27e6731db446bb1539dd0209e872cad134ccd1492fa4344db0b9feef1ef36 not found: ID does not exist"
Sep 19 09:33:51.807546 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.807523    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"]
Sep 19 09:33:51.814968 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:51.814945    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-e200e8-openshift-default-59f8d5bdd8-bg9qq"]
Sep 19 09:33:52.904809 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:52.904770    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23e3503d-360f-464d-ba80-9ac36db43c45" path="/var/lib/kubelet/pods/23e3503d-360f-464d-ba80-9ac36db43c45/volumes"
Sep 19 09:33:58.084469 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.084429    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"]
Sep 19 09:33:58.085138 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085119    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e3503d-360f-464d-ba80-9ac36db43c45" containerName="istio-proxy"
Sep 19 09:33:58.085235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085140    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e3503d-360f-464d-ba80-9ac36db43c45" containerName="istio-proxy"
Sep 19 09:33:58.085235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085153    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39679ffb-7f6e-4eea-a612-d138cab85cd8" containerName="payload-pre-processing"
Sep 19 09:33:58.085235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085160    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="39679ffb-7f6e-4eea-a612-d138cab85cd8" containerName="payload-pre-processing"
Sep 19 09:33:58.085235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085174    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f232bd2-31a7-4af2-afa5-f0714df6e3e9" containerName="revoke-keys"
Sep 19 09:33:58.085235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085182    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f232bd2-31a7-4af2-afa5-f0714df6e3e9" containerName="revoke-keys"
Sep 19 09:33:58.085235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085201    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be3d2d15-c604-42e2-877b-0a74f31c8843" containerName="payload-processing"
Sep 19 09:33:58.085235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085209    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be3d2d15-c604-42e2-877b-0a74f31c8843" containerName="payload-processing"
Sep 19 09:33:58.085560 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085310    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f232bd2-31a7-4af2-afa5-f0714df6e3e9" containerName="revoke-keys"
Sep 19 09:33:58.085560 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085325    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="23e3503d-360f-464d-ba80-9ac36db43c45" containerName="istio-proxy"
Sep 19 09:33:58.085560 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085334    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be3d2d15-c604-42e2-877b-0a74f31c8843" containerName="payload-processing"
Sep 19 09:33:58.085560 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.085350    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="39679ffb-7f6e-4eea-a612-d138cab85cd8" containerName="payload-pre-processing"
Sep 19 09:33:58.090113 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.090094    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:33:58.093161 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.093137    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-3240ec\""
Sep 19 09:33:58.093276 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.093243    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-3240ec-dockercfg-5kcc6\""
Sep 19 09:33:58.097877 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.097859    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"]
Sep 19 09:33:58.112551 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.112523    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"]
Sep 19 09:33:58.116179 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.116162    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:33:58.126095 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.126069    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"]
Sep 19 09:33:58.201558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.201520    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd357c9-2755-400e-99f0-7656442ed2e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87\" (UID: \"8fd357c9-2755-400e-99f0-7656442ed2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:33:58.201928 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.201904    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjs58\" (UniqueName: \"kubernetes.io/projected/8fd357c9-2755-400e-99f0-7656442ed2e6-kube-api-access-tjs58\") pod \"payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87\" (UID: \"8fd357c9-2755-400e-99f0-7656442ed2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:33:58.302856 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.302822    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2vjn\" (UniqueName: \"kubernetes.io/projected/e72cffba-35a3-49b0-8329-c9d8f654f06a-kube-api-access-r2vjn\") pod \"payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5\" (UID: \"e72cffba-35a3-49b0-8329-c9d8f654f06a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:33:58.303039 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.302895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd357c9-2755-400e-99f0-7656442ed2e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87\" (UID: \"8fd357c9-2755-400e-99f0-7656442ed2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:33:58.303039 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.302926    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjs58\" (UniqueName: \"kubernetes.io/projected/8fd357c9-2755-400e-99f0-7656442ed2e6-kube-api-access-tjs58\") pod \"payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87\" (UID: \"8fd357c9-2755-400e-99f0-7656442ed2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:33:58.303039 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.302942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e72cffba-35a3-49b0-8329-c9d8f654f06a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5\" (UID: \"e72cffba-35a3-49b0-8329-c9d8f654f06a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:33:58.303579 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.303559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd357c9-2755-400e-99f0-7656442ed2e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87\" (UID: \"8fd357c9-2755-400e-99f0-7656442ed2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:33:58.311617 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.311593    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjs58\" (UniqueName: \"kubernetes.io/projected/8fd357c9-2755-400e-99f0-7656442ed2e6-kube-api-access-tjs58\") pod \"payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87\" (UID: \"8fd357c9-2755-400e-99f0-7656442ed2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:33:58.402096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.401989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:33:58.404638 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.404606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e72cffba-35a3-49b0-8329-c9d8f654f06a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5\" (UID: \"e72cffba-35a3-49b0-8329-c9d8f654f06a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:33:58.404778 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.404717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2vjn\" (UniqueName: \"kubernetes.io/projected/e72cffba-35a3-49b0-8329-c9d8f654f06a-kube-api-access-r2vjn\") pod \"payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5\" (UID: \"e72cffba-35a3-49b0-8329-c9d8f654f06a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:33:58.405526 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.405384    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e72cffba-35a3-49b0-8329-c9d8f654f06a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5\" (UID: \"e72cffba-35a3-49b0-8329-c9d8f654f06a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:33:58.413064 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.413040    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2vjn\" (UniqueName: \"kubernetes.io/projected/e72cffba-35a3-49b0-8329-c9d8f654f06a-kube-api-access-r2vjn\") pod \"payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5\" (UID: \"e72cffba-35a3-49b0-8329-c9d8f654f06a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:33:58.427081 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.427056    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:33:58.682694 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.682668    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"]
Sep 19 09:33:58.684336 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:33:58.684300    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd357c9_2755_400e_99f0_7656442ed2e6.slice/crio-f6b34456f25d806c82522860695ce4ec9a50a7a2d19f5fa747be27e2dab7fc31 WatchSource:0}: Error finding container f6b34456f25d806c82522860695ce4ec9a50a7a2d19f5fa747be27e2dab7fc31: Status 404 returned error can't find the container with id f6b34456f25d806c82522860695ce4ec9a50a7a2d19f5fa747be27e2dab7fc31
Sep 19 09:33:58.716952 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.716923    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"]
Sep 19 09:33:58.718449 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:33:58.718419    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode72cffba_35a3_49b0_8329_c9d8f654f06a.slice/crio-a22c50f9596ff9e7f34a14faa7818755383e459ade310ff312faba31408d7fcf WatchSource:0}: Error finding container a22c50f9596ff9e7f34a14faa7818755383e459ade310ff312faba31408d7fcf: Status 404 returned error can't find the container with id a22c50f9596ff9e7f34a14faa7818755383e459ade310ff312faba31408d7fcf
Sep 19 09:33:58.833089 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.833052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87" event={"ID":"8fd357c9-2755-400e-99f0-7656442ed2e6","Type":"ContainerStarted","Data":"d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1"}
Sep 19 09:33:58.833264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.833110    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87" event={"ID":"8fd357c9-2755-400e-99f0-7656442ed2e6","Type":"ContainerStarted","Data":"f6b34456f25d806c82522860695ce4ec9a50a7a2d19f5fa747be27e2dab7fc31"}
Sep 19 09:33:58.833264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.833218    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:33:58.834823 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.834801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5" event={"ID":"e72cffba-35a3-49b0-8329-c9d8f654f06a","Type":"ContainerStarted","Data":"406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f"}
Sep 19 09:33:58.834945 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.834843    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5" event={"ID":"e72cffba-35a3-49b0-8329-c9d8f654f06a","Type":"ContainerStarted","Data":"a22c50f9596ff9e7f34a14faa7818755383e459ade310ff312faba31408d7fcf"}
Sep 19 09:33:58.834945 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.834897    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:33:58.852077 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.852000    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87" podStartSLOduration=0.851984531 podStartE2EDuration="851.984531ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:33:58.849317394 +0000 UTC m=+1622.016512625" watchObservedRunningTime="2026-09-19 09:33:58.851984531 +0000 UTC m=+1622.019179760"
Sep 19 09:33:58.867915 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:58.867843    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5" podStartSLOduration=0.86782178 podStartE2EDuration="867.82178ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:33:58.864774836 +0000 UTC m=+1622.031970067" watchObservedRunningTime="2026-09-19 09:33:58.86782178 +0000 UTC m=+1622.035017085"
Sep 19 09:33:59.035605 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:59.035517    2579 scope.go:117] "RemoveContainer" containerID="b60098c7f80509df12a0485892086bb90e1e83616aebf491fae91c60fd8bc98e"
Sep 19 09:33:59.047754 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:33:59.047728    2579 scope.go:117] "RemoveContainer" containerID="3002b04f4581b68defe72cfe37355d4f7d1f6ea3edf09a5257b75a2db9e89987"
Sep 19 09:34:09.842839 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:09.842803    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:34:09.843283 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:09.842871    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:34:33.261328 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.261288    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"]
Sep 19 09:34:33.265507 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.265491    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:34:33.267881 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.267861    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-1afa13\""
Sep 19 09:34:33.267989 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.267970    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-1afa13-dockercfg-856vq\""
Sep 19 09:34:33.275589 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.275566    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"]
Sep 19 09:34:33.361320 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.361282    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d2ac7fb-b554-49f5-bad8-940496af8ab4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc\" (UID: \"1d2ac7fb-b554-49f5-bad8-940496af8ab4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:34:33.361476 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.361436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krlh6\" (UniqueName: \"kubernetes.io/projected/1d2ac7fb-b554-49f5-bad8-940496af8ab4-kube-api-access-krlh6\") pod \"payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc\" (UID: \"1d2ac7fb-b554-49f5-bad8-940496af8ab4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:34:33.462339 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.462302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d2ac7fb-b554-49f5-bad8-940496af8ab4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc\" (UID: \"1d2ac7fb-b554-49f5-bad8-940496af8ab4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:34:33.462535 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.462404    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krlh6\" (UniqueName: \"kubernetes.io/projected/1d2ac7fb-b554-49f5-bad8-940496af8ab4-kube-api-access-krlh6\") pod \"payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc\" (UID: \"1d2ac7fb-b554-49f5-bad8-940496af8ab4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:34:33.463069 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.463048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d2ac7fb-b554-49f5-bad8-940496af8ab4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc\" (UID: \"1d2ac7fb-b554-49f5-bad8-940496af8ab4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:34:33.470597 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.470575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krlh6\" (UniqueName: \"kubernetes.io/projected/1d2ac7fb-b554-49f5-bad8-940496af8ab4-kube-api-access-krlh6\") pod \"payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc\" (UID: \"1d2ac7fb-b554-49f5-bad8-940496af8ab4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:34:33.577175 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.577139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:34:33.849843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:33.849815    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"]
Sep 19 09:34:33.851862 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:34:33.851828    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2ac7fb_b554_49f5_bad8_940496af8ab4.slice/crio-f63e123ed67b5ba8cc78e0d5c266674aa5089aa48faad56f3027e9c85a41e866 WatchSource:0}: Error finding container f63e123ed67b5ba8cc78e0d5c266674aa5089aa48faad56f3027e9c85a41e866: Status 404 returned error can't find the container with id f63e123ed67b5ba8cc78e0d5c266674aa5089aa48faad56f3027e9c85a41e866
Sep 19 09:34:34.044211 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:34.044168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc" event={"ID":"1d2ac7fb-b554-49f5-bad8-940496af8ab4","Type":"ContainerStarted","Data":"5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8"}
Sep 19 09:34:34.044418 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:34.044321    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:34:34.044418 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:34.044346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc" event={"ID":"1d2ac7fb-b554-49f5-bad8-940496af8ab4","Type":"ContainerStarted","Data":"f63e123ed67b5ba8cc78e0d5c266674aa5089aa48faad56f3027e9c85a41e866"}
Sep 19 09:34:34.062888 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:34.062835    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc" podStartSLOduration=1.062820237 podStartE2EDuration="1.062820237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:34:34.059866055 +0000 UTC m=+1657.227061301" watchObservedRunningTime="2026-09-19 09:34:34.062820237 +0000 UTC m=+1657.230015468"
Sep 19 09:34:45.055984 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:45.055953    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:34:59.087155 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:59.087122    2579 scope.go:117] "RemoveContainer" containerID="98f4e478ed9d42c904a343dc6cca199389d85c643fd802bf748e6d4a8c5a9097"
Sep 19 09:34:59.096187 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:34:59.096169    2579 scope.go:117] "RemoveContainer" containerID="6e855c1a73faba024adfd9355472ab6ff5f987856814ea9c6e1f223f6d909340"
Sep 19 09:35:25.338466 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:25.338383    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"]
Sep 19 09:35:25.342204 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:25.342187    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"
Sep 19 09:35:25.344402 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:25.344383    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:35:25.344501 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:25.344384    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:35:25.350102 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:25.350076    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"]
Sep 19 09:35:25.383025 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:25.382980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a958b8-e3b9-417d-ad66-9d824b8af7cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n\" (UID: \"f6a958b8-e3b9-417d-ad66-9d824b8af7cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"
Sep 19 09:35:25.484170 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:25.484046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a958b8-e3b9-417d-ad66-9d824b8af7cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n\" (UID: \"f6a958b8-e3b9-417d-ad66-9d824b8af7cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"
Sep 19 09:35:25.484888 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:25.484856    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a958b8-e3b9-417d-ad66-9d824b8af7cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n\" (UID: \"f6a958b8-e3b9-417d-ad66-9d824b8af7cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"
Sep 19 09:35:25.654657 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:25.654567    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"
Sep 19 09:35:25.927260 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:25.927227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"]
Sep 19 09:35:25.928779 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:35:25.928754    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a958b8_e3b9_417d_ad66_9d824b8af7cb.slice/crio-f51a1adbe4f0f71e1c36cc2e9de4e8d4afc9c3f9bbc658f74657108bb4f3d688 WatchSource:0}: Error finding container f51a1adbe4f0f71e1c36cc2e9de4e8d4afc9c3f9bbc658f74657108bb4f3d688: Status 404 returned error can't find the container with id f51a1adbe4f0f71e1c36cc2e9de4e8d4afc9c3f9bbc658f74657108bb4f3d688
Sep 19 09:35:26.357291 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:26.357250    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n" event={"ID":"f6a958b8-e3b9-417d-ad66-9d824b8af7cb","Type":"ContainerStarted","Data":"a92bdfcc3fe123743655a157c049b0914e4c12ff0097a09007504dbf8cab7587"}
Sep 19 09:35:26.357657 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:26.357343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n" event={"ID":"f6a958b8-e3b9-417d-ad66-9d824b8af7cb","Type":"ContainerStarted","Data":"f51a1adbe4f0f71e1c36cc2e9de4e8d4afc9c3f9bbc658f74657108bb4f3d688"}
Sep 19 09:35:26.375815 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:26.375769    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n" podStartSLOduration=1.375755178 podStartE2EDuration="1.375755178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:35:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:35:26.373473919 +0000 UTC m=+1709.540669164" watchObservedRunningTime="2026-09-19 09:35:26.375755178 +0000 UTC m=+1709.542950408"
Sep 19 09:35:27.365198 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:27.365163    2579 generic.go:356] "Generic (PLEG): container finished" podID="f6a958b8-e3b9-417d-ad66-9d824b8af7cb" containerID="a92bdfcc3fe123743655a157c049b0914e4c12ff0097a09007504dbf8cab7587" exitCode=0
Sep 19 09:35:27.365567 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:27.365255    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n" event={"ID":"f6a958b8-e3b9-417d-ad66-9d824b8af7cb","Type":"ContainerDied","Data":"a92bdfcc3fe123743655a157c049b0914e4c12ff0097a09007504dbf8cab7587"}
Sep 19 09:35:28.508856 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:28.508836    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"
Sep 19 09:35:28.619164 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:28.619130    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a958b8-e3b9-417d-ad66-9d824b8af7cb-maas-api-service-ca\") pod \"f6a958b8-e3b9-417d-ad66-9d824b8af7cb\" (UID: \"f6a958b8-e3b9-417d-ad66-9d824b8af7cb\") "
Sep 19 09:35:28.619475 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:28.619453    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a958b8-e3b9-417d-ad66-9d824b8af7cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f6a958b8-e3b9-417d-ad66-9d824b8af7cb" (UID: "f6a958b8-e3b9-417d-ad66-9d824b8af7cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:35:28.720231 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:28.720152    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a958b8-e3b9-417d-ad66-9d824b8af7cb-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:35:29.380217 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:29.380183    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"
Sep 19 09:35:29.380418 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:29.380183    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n" event={"ID":"f6a958b8-e3b9-417d-ad66-9d824b8af7cb","Type":"ContainerDied","Data":"f51a1adbe4f0f71e1c36cc2e9de4e8d4afc9c3f9bbc658f74657108bb4f3d688"}
Sep 19 09:35:29.380418 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:29.380322    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f51a1adbe4f0f71e1c36cc2e9de4e8d4afc9c3f9bbc658f74657108bb4f3d688"
Sep 19 09:35:40.894535 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:40.893998    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"]
Sep 19 09:35:40.894535 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:40.894271    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf" podUID="92d55501-c8a3-4573-9388-771b34435bd6" containerName="payload-processing" containerID="cri-o://152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d" gracePeriod=30
Sep 19 09:35:40.905833 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:40.905807    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"]
Sep 19 09:35:40.906123 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:40.906058    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln" podUID="db6d8a5c-9e4a-4096-ad54-3d687c39acc1" containerName="payload-pre-processing" containerID="cri-o://eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99" gracePeriod=30
Sep 19 09:35:41.063758 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.063708    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"]
Sep 19 09:35:41.066390 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.066349    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e46994f4-8sn5n"]
Sep 19 09:35:41.210406 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.210380    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:35:41.214229 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.214210    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:35:41.350649 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.350606    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jgtk\" (UniqueName: \"kubernetes.io/projected/92d55501-c8a3-4573-9388-771b34435bd6-kube-api-access-9jgtk\") pod \"92d55501-c8a3-4573-9388-771b34435bd6\" (UID: \"92d55501-c8a3-4573-9388-771b34435bd6\") "
Sep 19 09:35:41.350847 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.350673    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-plugins-config-volume\") pod \"db6d8a5c-9e4a-4096-ad54-3d687c39acc1\" (UID: \"db6d8a5c-9e4a-4096-ad54-3d687c39acc1\") "
Sep 19 09:35:41.350847 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.350692    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92d55501-c8a3-4573-9388-771b34435bd6-plugins-config-volume\") pod \"92d55501-c8a3-4573-9388-771b34435bd6\" (UID: \"92d55501-c8a3-4573-9388-771b34435bd6\") "
Sep 19 09:35:41.350847 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.350751    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j222c\" (UniqueName: \"kubernetes.io/projected/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-kube-api-access-j222c\") pod \"db6d8a5c-9e4a-4096-ad54-3d687c39acc1\" (UID: \"db6d8a5c-9e4a-4096-ad54-3d687c39acc1\") "
Sep 19 09:35:41.351092 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.351067    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92d55501-c8a3-4573-9388-771b34435bd6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "92d55501-c8a3-4573-9388-771b34435bd6" (UID: "92d55501-c8a3-4573-9388-771b34435bd6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:35:41.351147 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.351121    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "db6d8a5c-9e4a-4096-ad54-3d687c39acc1" (UID: "db6d8a5c-9e4a-4096-ad54-3d687c39acc1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:35:41.352963 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.352942    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-kube-api-access-j222c" (OuterVolumeSpecName: "kube-api-access-j222c") pod "db6d8a5c-9e4a-4096-ad54-3d687c39acc1" (UID: "db6d8a5c-9e4a-4096-ad54-3d687c39acc1"). InnerVolumeSpecName "kube-api-access-j222c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:35:41.352963 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.352951    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92d55501-c8a3-4573-9388-771b34435bd6-kube-api-access-9jgtk" (OuterVolumeSpecName: "kube-api-access-9jgtk") pod "92d55501-c8a3-4573-9388-771b34435bd6" (UID: "92d55501-c8a3-4573-9388-771b34435bd6"). InnerVolumeSpecName "kube-api-access-9jgtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:35:41.449730 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.449641    2579 generic.go:356] "Generic (PLEG): container finished" podID="92d55501-c8a3-4573-9388-771b34435bd6" containerID="152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d" exitCode=0
Sep 19 09:35:41.449730 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.449691    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"
Sep 19 09:35:41.449969 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.449728    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf" event={"ID":"92d55501-c8a3-4573-9388-771b34435bd6","Type":"ContainerDied","Data":"152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d"}
Sep 19 09:35:41.449969 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.449784    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf" event={"ID":"92d55501-c8a3-4573-9388-771b34435bd6","Type":"ContainerDied","Data":"5cb6376182c89cbfc4607b52f15434dde6a56672f1294ccccad2e2c4c1f7b6d0"}
Sep 19 09:35:41.449969 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.449810    2579 scope.go:117] "RemoveContainer" containerID="152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d"
Sep 19 09:35:41.451104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.451081    2579 generic.go:356] "Generic (PLEG): container finished" podID="db6d8a5c-9e4a-4096-ad54-3d687c39acc1" containerID="eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99" exitCode=0
Sep 19 09:35:41.451210 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.451140    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"
Sep 19 09:35:41.451210 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.451169    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln" event={"ID":"db6d8a5c-9e4a-4096-ad54-3d687c39acc1","Type":"ContainerDied","Data":"eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99"}
Sep 19 09:35:41.451307 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.451243    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln" event={"ID":"db6d8a5c-9e4a-4096-ad54-3d687c39acc1","Type":"ContainerDied","Data":"7584c7030779419b96296021051ae321fad00236c7fe4d02888b2dee78e5ab26"}
Sep 19 09:35:41.451582 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.451563    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j222c\" (UniqueName: \"kubernetes.io/projected/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-kube-api-access-j222c\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:35:41.451651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.451588    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jgtk\" (UniqueName: \"kubernetes.io/projected/92d55501-c8a3-4573-9388-771b34435bd6-kube-api-access-9jgtk\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:35:41.451651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.451602    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db6d8a5c-9e4a-4096-ad54-3d687c39acc1-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:35:41.451651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.451615    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92d55501-c8a3-4573-9388-771b34435bd6-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:35:41.460966 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.460930    2579 scope.go:117] "RemoveContainer" containerID="152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d"
Sep 19 09:35:41.461290 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:35:41.461264    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d\": container with ID starting with 152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d not found: ID does not exist" containerID="152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d"
Sep 19 09:35:41.461394 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.461299    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d"} err="failed to get container status \"152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d\": rpc error: code = NotFound desc = could not find container \"152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d\": container with ID starting with 152e6eba1672733470a9b81d8ea28e544be457919c13a2f3e5a3d2418baf114d not found: ID does not exist"
Sep 19 09:35:41.461394 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.461317    2579 scope.go:117] "RemoveContainer" containerID="eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99"
Sep 19 09:35:41.469959 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.469942    2579 scope.go:117] "RemoveContainer" containerID="eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99"
Sep 19 09:35:41.470470 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:35:41.470445    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99\": container with ID starting with eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99 not found: ID does not exist" containerID="eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99"
Sep 19 09:35:41.470545 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.470475    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99"} err="failed to get container status \"eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99\": rpc error: code = NotFound desc = could not find container \"eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99\": container with ID starting with eaf6c73d7bd858257ced8cf370e94801aeb27fbab34ccace4c124e1ef5a11d99 not found: ID does not exist"
Sep 19 09:35:41.479370 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.479349    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"]
Sep 19 09:35:41.483960 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.483941    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e46994f4-77455cbc8f-8vkwf"]
Sep 19 09:35:41.496282 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.496254    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"]
Sep 19 09:35:41.499535 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:41.499515    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e46994f4-7977645686-5rlln"]
Sep 19 09:35:42.903560 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:42.903529    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92d55501-c8a3-4573-9388-771b34435bd6" path="/var/lib/kubelet/pods/92d55501-c8a3-4573-9388-771b34435bd6/volumes"
Sep 19 09:35:42.903929 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:42.903873    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db6d8a5c-9e4a-4096-ad54-3d687c39acc1" path="/var/lib/kubelet/pods/db6d8a5c-9e4a-4096-ad54-3d687c39acc1/volumes"
Sep 19 09:35:42.904183 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:35:42.904171    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a958b8-e3b9-417d-ad66-9d824b8af7cb" path="/var/lib/kubelet/pods/f6a958b8-e3b9-417d-ad66-9d824b8af7cb/volumes"
Sep 19 09:36:58.995295 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:36:58.995261    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:36:58.996481 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:36:58.996461    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:36:59.138999 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:36:59.138967    2579 scope.go:117] "RemoveContainer" containerID="5db8f5f4519df8da44d0161382c22a9cdd777ae754bde9a45b5838d48b8f42b0"
Sep 19 09:36:59.147507 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:36:59.147487    2579 scope.go:117] "RemoveContainer" containerID="7377b5741335e9896a75f70923fb2dbb8ef8c6105dac6c0aa9300875429c128d"
Sep 19 09:37:34.797968 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.797929    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"]
Sep 19 09:37:34.798493 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.798477    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6d8a5c-9e4a-4096-ad54-3d687c39acc1" containerName="payload-pre-processing"
Sep 19 09:37:34.798538 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.798495    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6d8a5c-9e4a-4096-ad54-3d687c39acc1" containerName="payload-pre-processing"
Sep 19 09:37:34.798538 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.798526    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d55501-c8a3-4573-9388-771b34435bd6" containerName="payload-processing"
Sep 19 09:37:34.798538 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.798533    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d55501-c8a3-4573-9388-771b34435bd6" containerName="payload-processing"
Sep 19 09:37:34.798651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.798545    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a958b8-e3b9-417d-ad66-9d824b8af7cb" containerName="revoke-keys"
Sep 19 09:37:34.798651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.798551    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a958b8-e3b9-417d-ad66-9d824b8af7cb" containerName="revoke-keys"
Sep 19 09:37:34.798651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.798629    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a958b8-e3b9-417d-ad66-9d824b8af7cb" containerName="revoke-keys"
Sep 19 09:37:34.798651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.798640    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92d55501-c8a3-4573-9388-771b34435bd6" containerName="payload-processing"
Sep 19 09:37:34.798651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.798647    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6d8a5c-9e4a-4096-ad54-3d687c39acc1" containerName="payload-pre-processing"
Sep 19 09:37:34.801969 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.801954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:37:34.804221 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.804198    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-9e9462\""
Sep 19 09:37:34.804335 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.804212    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-9e9462-dockercfg-294k6\""
Sep 19 09:37:34.814244 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.814219    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"]
Sep 19 09:37:34.838469 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.838439    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"]
Sep 19 09:37:34.842201 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.842181    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:37:34.851655 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.851630    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"]
Sep 19 09:37:34.898232 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.898192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3265ab1c-37f5-449b-b728-d61b17a52548-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt\" (UID: \"3265ab1c-37f5-449b-b728-d61b17a52548\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:37:34.898394 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.898309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc2jj\" (UniqueName: \"kubernetes.io/projected/3265ab1c-37f5-449b-b728-d61b17a52548-kube-api-access-qc2jj\") pod \"payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt\" (UID: \"3265ab1c-37f5-449b-b728-d61b17a52548\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:37:34.898394 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.898347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e95b2f80-8b0e-47af-a3d7-af74360997a4-plugins-config-volume\") pod \"payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf\" (UID: \"e95b2f80-8b0e-47af-a3d7-af74360997a4\") " pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:37:34.898394 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.898387    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pjsx\" (UniqueName: \"kubernetes.io/projected/e95b2f80-8b0e-47af-a3d7-af74360997a4-kube-api-access-8pjsx\") pod \"payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf\" (UID: \"e95b2f80-8b0e-47af-a3d7-af74360997a4\") " pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:37:34.999104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.999069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc2jj\" (UniqueName: \"kubernetes.io/projected/3265ab1c-37f5-449b-b728-d61b17a52548-kube-api-access-qc2jj\") pod \"payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt\" (UID: \"3265ab1c-37f5-449b-b728-d61b17a52548\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:37:34.999104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.999106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e95b2f80-8b0e-47af-a3d7-af74360997a4-plugins-config-volume\") pod \"payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf\" (UID: \"e95b2f80-8b0e-47af-a3d7-af74360997a4\") " pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:37:34.999360 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.999135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pjsx\" (UniqueName: \"kubernetes.io/projected/e95b2f80-8b0e-47af-a3d7-af74360997a4-kube-api-access-8pjsx\") pod \"payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf\" (UID: \"e95b2f80-8b0e-47af-a3d7-af74360997a4\") " pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:37:34.999360 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.999288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3265ab1c-37f5-449b-b728-d61b17a52548-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt\" (UID: \"3265ab1c-37f5-449b-b728-d61b17a52548\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:37:34.999825 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.999802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e95b2f80-8b0e-47af-a3d7-af74360997a4-plugins-config-volume\") pod \"payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf\" (UID: \"e95b2f80-8b0e-47af-a3d7-af74360997a4\") " pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:37:34.999947 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:34.999929    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3265ab1c-37f5-449b-b728-d61b17a52548-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt\" (UID: \"3265ab1c-37f5-449b-b728-d61b17a52548\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:37:35.018640 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:35.018622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc2jj\" (UniqueName: \"kubernetes.io/projected/3265ab1c-37f5-449b-b728-d61b17a52548-kube-api-access-qc2jj\") pod \"payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt\" (UID: \"3265ab1c-37f5-449b-b728-d61b17a52548\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:37:35.019132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:35.019111    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pjsx\" (UniqueName: \"kubernetes.io/projected/e95b2f80-8b0e-47af-a3d7-af74360997a4-kube-api-access-8pjsx\") pod \"payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf\" (UID: \"e95b2f80-8b0e-47af-a3d7-af74360997a4\") " pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:37:35.113647 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:35.113547    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:37:35.153248 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:35.153204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:37:35.390862 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:35.390766    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"]
Sep 19 09:37:35.393702 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:37:35.393670    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3265ab1c_37f5_449b_b728_d61b17a52548.slice/crio-bfa98cbf8450f3cea6d123d1905e51a0bd17c8d49e6b63e622e2352caf0e668b WatchSource:0}: Error finding container bfa98cbf8450f3cea6d123d1905e51a0bd17c8d49e6b63e622e2352caf0e668b: Status 404 returned error can't find the container with id bfa98cbf8450f3cea6d123d1905e51a0bd17c8d49e6b63e622e2352caf0e668b
Sep 19 09:37:35.436278 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:35.436253    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"]
Sep 19 09:37:36.135002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:36.134961    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf" event={"ID":"e95b2f80-8b0e-47af-a3d7-af74360997a4","Type":"ContainerStarted","Data":"a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a"}
Sep 19 09:37:36.135465 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:36.135042    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf" event={"ID":"e95b2f80-8b0e-47af-a3d7-af74360997a4","Type":"ContainerStarted","Data":"d5252b58efbe92373050d32f756e953b48d3997b592f6e660c054aa9b05daef7"}
Sep 19 09:37:36.135465 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:36.135079    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:37:36.136579 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:36.136556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt" event={"ID":"3265ab1c-37f5-449b-b728-d61b17a52548","Type":"ContainerStarted","Data":"c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f"}
Sep 19 09:37:36.136697 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:36.136607    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:37:36.136697 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:36.136631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt" event={"ID":"3265ab1c-37f5-449b-b728-d61b17a52548","Type":"ContainerStarted","Data":"bfa98cbf8450f3cea6d123d1905e51a0bd17c8d49e6b63e622e2352caf0e668b"}
Sep 19 09:37:36.151718 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:36.151671    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf" podStartSLOduration=2.151653747 podStartE2EDuration="2.151653747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:37:36.14982754 +0000 UTC m=+1839.317022773" watchObservedRunningTime="2026-09-19 09:37:36.151653747 +0000 UTC m=+1839.318848998"
Sep 19 09:37:36.168350 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:36.168302    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt" podStartSLOduration=2.168288622 podStartE2EDuration="2.168288622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:37:36.165988279 +0000 UTC m=+1839.333183510" watchObservedRunningTime="2026-09-19 09:37:36.168288622 +0000 UTC m=+1839.335483852"
Sep 19 09:37:47.144993 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:47.144958    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:37:47.145473 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:47.145144    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:37:59.172878 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:37:59.172847    2579 scope.go:117] "RemoveContainer" containerID="5e660396762254ada38314bc0cd2fa5ac9c874a9c8036d8719979da336206590"
Sep 19 09:38:10.525380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.525305    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"]
Sep 19 09:38:10.529295 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.529279    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:38:10.531901 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.531883    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-0304ec-dockercfg-54w9c\""
Sep 19 09:38:10.532053 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.532037    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-0304ec\""
Sep 19 09:38:10.542152 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.542125    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"]
Sep 19 09:38:10.665888 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.665852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/486104b3-502f-4b55-a57c-2b0c745220aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9\" (UID: \"486104b3-502f-4b55-a57c-2b0c745220aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:38:10.666249 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.666213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x57sg\" (UniqueName: \"kubernetes.io/projected/486104b3-502f-4b55-a57c-2b0c745220aa-kube-api-access-x57sg\") pod \"payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9\" (UID: \"486104b3-502f-4b55-a57c-2b0c745220aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:38:10.767143 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.767099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x57sg\" (UniqueName: \"kubernetes.io/projected/486104b3-502f-4b55-a57c-2b0c745220aa-kube-api-access-x57sg\") pod \"payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9\" (UID: \"486104b3-502f-4b55-a57c-2b0c745220aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:38:10.767340 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.767173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/486104b3-502f-4b55-a57c-2b0c745220aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9\" (UID: \"486104b3-502f-4b55-a57c-2b0c745220aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:38:10.767879 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.767854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/486104b3-502f-4b55-a57c-2b0c745220aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9\" (UID: \"486104b3-502f-4b55-a57c-2b0c745220aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:38:10.774658 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.774633    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x57sg\" (UniqueName: \"kubernetes.io/projected/486104b3-502f-4b55-a57c-2b0c745220aa-kube-api-access-x57sg\") pod \"payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9\" (UID: \"486104b3-502f-4b55-a57c-2b0c745220aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:38:10.839715 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:10.839674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:38:11.110754 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:11.110723    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"]
Sep 19 09:38:11.112486 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:38:11.112465    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486104b3_502f_4b55_a57c_2b0c745220aa.slice/crio-1a1ec3a194c17d3622a218fed1ca7cdd8ff35c09bb17a054f991e32ef140c28f WatchSource:0}: Error finding container 1a1ec3a194c17d3622a218fed1ca7cdd8ff35c09bb17a054f991e32ef140c28f: Status 404 returned error can't find the container with id 1a1ec3a194c17d3622a218fed1ca7cdd8ff35c09bb17a054f991e32ef140c28f
Sep 19 09:38:11.339072 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:11.339009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9" event={"ID":"486104b3-502f-4b55-a57c-2b0c745220aa","Type":"ContainerStarted","Data":"4236d4cae77d5d2ee22c009e2159faa39b91e6adb05c3d80eb54d0d311a4641b"}
Sep 19 09:38:11.339229 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:11.339190    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:38:11.339299 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:11.339236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9" event={"ID":"486104b3-502f-4b55-a57c-2b0c745220aa","Type":"ContainerStarted","Data":"1a1ec3a194c17d3622a218fed1ca7cdd8ff35c09bb17a054f991e32ef140c28f"}
Sep 19 09:38:11.358957 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:11.358898    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9" podStartSLOduration=1.358879727 podStartE2EDuration="1.358879727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:38:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:38:11.354716965 +0000 UTC m=+1874.521912195" watchObservedRunningTime="2026-09-19 09:38:11.358879727 +0000 UTC m=+1874.526074959"
Sep 19 09:38:12.130369 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:12.130334    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"]
Sep 19 09:38:12.133752 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:12.133734    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"
Sep 19 09:38:12.136095 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:12.136070    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:38:12.136210 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:12.136076    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:38:12.141381 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:12.141355    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"]
Sep 19 09:38:12.179390 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:12.179358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f32e571-ccf6-4556-9781-893859bd9bc3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn\" (UID: \"7f32e571-ccf6-4556-9781-893859bd9bc3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"
Sep 19 09:38:12.280924 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:12.280889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f32e571-ccf6-4556-9781-893859bd9bc3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn\" (UID: \"7f32e571-ccf6-4556-9781-893859bd9bc3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"
Sep 19 09:38:12.281532 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:12.281515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f32e571-ccf6-4556-9781-893859bd9bc3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn\" (UID: \"7f32e571-ccf6-4556-9781-893859bd9bc3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"
Sep 19 09:38:12.445842 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:12.445729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"
Sep 19 09:38:12.720976 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:12.720929    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"]
Sep 19 09:38:12.723832 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:38:12.723809    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f32e571_ccf6_4556_9781_893859bd9bc3.slice/crio-afd56aaf7fbe67d99a259cee60a8b251f0811cacb6069b78a76ef32004a6c356 WatchSource:0}: Error finding container afd56aaf7fbe67d99a259cee60a8b251f0811cacb6069b78a76ef32004a6c356: Status 404 returned error can't find the container with id afd56aaf7fbe67d99a259cee60a8b251f0811cacb6069b78a76ef32004a6c356
Sep 19 09:38:13.351689 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:13.351661    2579 generic.go:356] "Generic (PLEG): container finished" podID="7f32e571-ccf6-4556-9781-893859bd9bc3" containerID="70dd8091c9c6345c8900e02f22b5446d76bdb2fe55b47db1d3c92e94aa80aa88" exitCode=0
Sep 19 09:38:13.351989 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:13.351716    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn" event={"ID":"7f32e571-ccf6-4556-9781-893859bd9bc3","Type":"ContainerDied","Data":"70dd8091c9c6345c8900e02f22b5446d76bdb2fe55b47db1d3c92e94aa80aa88"}
Sep 19 09:38:13.351989 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:13.351767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn" event={"ID":"7f32e571-ccf6-4556-9781-893859bd9bc3","Type":"ContainerStarted","Data":"afd56aaf7fbe67d99a259cee60a8b251f0811cacb6069b78a76ef32004a6c356"}
Sep 19 09:38:14.502850 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:14.502827    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"
Sep 19 09:38:14.604669 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:14.604640    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f32e571-ccf6-4556-9781-893859bd9bc3-maas-api-service-ca\") pod \"7f32e571-ccf6-4556-9781-893859bd9bc3\" (UID: \"7f32e571-ccf6-4556-9781-893859bd9bc3\") "
Sep 19 09:38:14.605039 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:14.604994    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f32e571-ccf6-4556-9781-893859bd9bc3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7f32e571-ccf6-4556-9781-893859bd9bc3" (UID: "7f32e571-ccf6-4556-9781-893859bd9bc3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:38:14.705637 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:14.705563    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f32e571-ccf6-4556-9781-893859bd9bc3-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:15.364471 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:15.364426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn" event={"ID":"7f32e571-ccf6-4556-9781-893859bd9bc3","Type":"ContainerDied","Data":"afd56aaf7fbe67d99a259cee60a8b251f0811cacb6069b78a76ef32004a6c356"}
Sep 19 09:38:15.364653 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:15.364515    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afd56aaf7fbe67d99a259cee60a8b251f0811cacb6069b78a76ef32004a6c356"
Sep 19 09:38:15.364653 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:15.364445    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"
Sep 19 09:38:22.347193 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:22.347156    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:38:27.889763 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:27.889721    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"]
Sep 19 09:38:27.890263 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:27.889994    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg" podUID="4d417ec5-3c67-431d-be5b-be939e19406a" containerName="payload-processing" containerID="cri-o://9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591" gracePeriod=30
Sep 19 09:38:27.894148 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:27.894121    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"]
Sep 19 09:38:27.894498 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:27.894473    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6" podUID="e6bb31b6-067c-411f-8e1b-4276c77d4946" containerName="payload-pre-processing" containerID="cri-o://cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085" gracePeriod=30
Sep 19 09:38:28.114237 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.114174    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"]
Sep 19 09:38:28.121051 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.120975    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-14e3f6-k67pn"]
Sep 19 09:38:28.206709 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.206685    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:38:28.209384 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.209359    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:38:28.250506 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.250480    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl5lw\" (UniqueName: \"kubernetes.io/projected/4d417ec5-3c67-431d-be5b-be939e19406a-kube-api-access-pl5lw\") pod \"4d417ec5-3c67-431d-be5b-be939e19406a\" (UID: \"4d417ec5-3c67-431d-be5b-be939e19406a\") "
Sep 19 09:38:28.250506 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.250510    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdvtq\" (UniqueName: \"kubernetes.io/projected/e6bb31b6-067c-411f-8e1b-4276c77d4946-kube-api-access-zdvtq\") pod \"e6bb31b6-067c-411f-8e1b-4276c77d4946\" (UID: \"e6bb31b6-067c-411f-8e1b-4276c77d4946\") "
Sep 19 09:38:28.250732 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.250556    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d417ec5-3c67-431d-be5b-be939e19406a-plugins-config-volume\") pod \"4d417ec5-3c67-431d-be5b-be939e19406a\" (UID: \"4d417ec5-3c67-431d-be5b-be939e19406a\") "
Sep 19 09:38:28.250732 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.250598    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6bb31b6-067c-411f-8e1b-4276c77d4946-plugins-config-volume\") pod \"e6bb31b6-067c-411f-8e1b-4276c77d4946\" (UID: \"e6bb31b6-067c-411f-8e1b-4276c77d4946\") "
Sep 19 09:38:28.250942 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.250922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6bb31b6-067c-411f-8e1b-4276c77d4946-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e6bb31b6-067c-411f-8e1b-4276c77d4946" (UID: "e6bb31b6-067c-411f-8e1b-4276c77d4946"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:38:28.251002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.250940    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d417ec5-3c67-431d-be5b-be939e19406a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d417ec5-3c67-431d-be5b-be939e19406a" (UID: "4d417ec5-3c67-431d-be5b-be939e19406a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:38:28.251081 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.251064    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d417ec5-3c67-431d-be5b-be939e19406a-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:28.251081 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.251079    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6bb31b6-067c-411f-8e1b-4276c77d4946-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:28.252785 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.252758    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d417ec5-3c67-431d-be5b-be939e19406a-kube-api-access-pl5lw" (OuterVolumeSpecName: "kube-api-access-pl5lw") pod "4d417ec5-3c67-431d-be5b-be939e19406a" (UID: "4d417ec5-3c67-431d-be5b-be939e19406a"). InnerVolumeSpecName "kube-api-access-pl5lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:38:28.252863 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.252814    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6bb31b6-067c-411f-8e1b-4276c77d4946-kube-api-access-zdvtq" (OuterVolumeSpecName: "kube-api-access-zdvtq") pod "e6bb31b6-067c-411f-8e1b-4276c77d4946" (UID: "e6bb31b6-067c-411f-8e1b-4276c77d4946"). InnerVolumeSpecName "kube-api-access-zdvtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:38:28.351978 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.351941    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl5lw\" (UniqueName: \"kubernetes.io/projected/4d417ec5-3c67-431d-be5b-be939e19406a-kube-api-access-pl5lw\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:28.351978 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.351970    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdvtq\" (UniqueName: \"kubernetes.io/projected/e6bb31b6-067c-411f-8e1b-4276c77d4946-kube-api-access-zdvtq\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:28.441951 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.441871    2579 generic.go:356] "Generic (PLEG): container finished" podID="4d417ec5-3c67-431d-be5b-be939e19406a" containerID="9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591" exitCode=0
Sep 19 09:38:28.441951 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.441913    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"
Sep 19 09:38:28.442186 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.441954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg" event={"ID":"4d417ec5-3c67-431d-be5b-be939e19406a","Type":"ContainerDied","Data":"9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591"}
Sep 19 09:38:28.442186 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.442009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg" event={"ID":"4d417ec5-3c67-431d-be5b-be939e19406a","Type":"ContainerDied","Data":"fa9ef0fd3f3f934818f34c0e2cde8a5d091578f91fa223ee28b3dc633133c0fb"}
Sep 19 09:38:28.442186 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.442059    2579 scope.go:117] "RemoveContainer" containerID="9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591"
Sep 19 09:38:28.443496 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.443476    2579 generic.go:356] "Generic (PLEG): container finished" podID="e6bb31b6-067c-411f-8e1b-4276c77d4946" containerID="cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085" exitCode=0
Sep 19 09:38:28.443610 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.443511    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"
Sep 19 09:38:28.443610 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.443511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6" event={"ID":"e6bb31b6-067c-411f-8e1b-4276c77d4946","Type":"ContainerDied","Data":"cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085"}
Sep 19 09:38:28.443712 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.443641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6" event={"ID":"e6bb31b6-067c-411f-8e1b-4276c77d4946","Type":"ContainerDied","Data":"f597920da6addc0e71c526f56e3b6b4be498de213d00729fd87eedfe9b276517"}
Sep 19 09:38:28.451497 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.451482    2579 scope.go:117] "RemoveContainer" containerID="9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591"
Sep 19 09:38:28.451772 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:38:28.451745    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591\": container with ID starting with 9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591 not found: ID does not exist" containerID="9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591"
Sep 19 09:38:28.451828 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.451775    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591"} err="failed to get container status \"9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591\": rpc error: code = NotFound desc = could not find container \"9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591\": container with ID starting with 9f8dac4b7d2e4a62287e840721a0daecb5e4d331c9cc51eb77cf7e816ab5b591 not found: ID does not exist"
Sep 19 09:38:28.451828 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.451790    2579 scope.go:117] "RemoveContainer" containerID="cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085"
Sep 19 09:38:28.460336 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.460318    2579 scope.go:117] "RemoveContainer" containerID="cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085"
Sep 19 09:38:28.460607 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:38:28.460586    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085\": container with ID starting with cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085 not found: ID does not exist" containerID="cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085"
Sep 19 09:38:28.460662 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.460614    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085"} err="failed to get container status \"cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085\": rpc error: code = NotFound desc = could not find container \"cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085\": container with ID starting with cf58872bf17e767cdbffdffcfc598cf77ea6c4bfa125cb05287e04d475eab085 not found: ID does not exist"
Sep 19 09:38:28.466480 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.466453    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"]
Sep 19 09:38:28.470908 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.470884    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-14e3f6-6db5ff75cc-6gppg"]
Sep 19 09:38:28.481361 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.481337    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"]
Sep 19 09:38:28.483278 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.483260    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-14e3f6-76c755bb7d-slnf6"]
Sep 19 09:38:28.906501 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.906472    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d417ec5-3c67-431d-be5b-be939e19406a" path="/var/lib/kubelet/pods/4d417ec5-3c67-431d-be5b-be939e19406a/volumes"
Sep 19 09:38:28.906855 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.906800    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f32e571-ccf6-4556-9781-893859bd9bc3" path="/var/lib/kubelet/pods/7f32e571-ccf6-4556-9781-893859bd9bc3/volumes"
Sep 19 09:38:28.907139 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:28.907126    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6bb31b6-067c-411f-8e1b-4276c77d4946" path="/var/lib/kubelet/pods/e6bb31b6-067c-411f-8e1b-4276c77d4946/volumes"
Sep 19 09:38:37.221258 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.221220    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"]
Sep 19 09:38:37.221788 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.221688    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6bb31b6-067c-411f-8e1b-4276c77d4946" containerName="payload-pre-processing"
Sep 19 09:38:37.221788 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.221699    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6bb31b6-067c-411f-8e1b-4276c77d4946" containerName="payload-pre-processing"
Sep 19 09:38:37.221788 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.221728    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d417ec5-3c67-431d-be5b-be939e19406a" containerName="payload-processing"
Sep 19 09:38:37.221788 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.221733    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d417ec5-3c67-431d-be5b-be939e19406a" containerName="payload-processing"
Sep 19 09:38:37.221788 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.221742    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f32e571-ccf6-4556-9781-893859bd9bc3" containerName="revoke-keys"
Sep 19 09:38:37.221788 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.221747    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f32e571-ccf6-4556-9781-893859bd9bc3" containerName="revoke-keys"
Sep 19 09:38:37.222126 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.221812    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f32e571-ccf6-4556-9781-893859bd9bc3" containerName="revoke-keys"
Sep 19 09:38:37.222126 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.221820    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6bb31b6-067c-411f-8e1b-4276c77d4946" containerName="payload-pre-processing"
Sep 19 09:38:37.222126 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.221829    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d417ec5-3c67-431d-be5b-be939e19406a" containerName="payload-processing"
Sep 19 09:38:37.226786 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.226768    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"
Sep 19 09:38:37.230201 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.230181    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:38:37.230703 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.230690    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:38:37.242739 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.242714    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"]
Sep 19 09:38:37.294141 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.294106    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"]
Sep 19 09:38:37.294342 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.294321    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy" containerID="cri-o://fa36c6443974a6d7a33bedf4c4ef0aae02bf18936bde13cf212146a3715d8838" gracePeriod=30
Sep 19 09:38:37.351808 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.351777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7c6388-972a-4b58-8be1-a68955b00ba5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9e9462-2tg47\" (UID: \"2a7c6388-972a-4b58-8be1-a68955b00ba5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"
Sep 19 09:38:37.453177 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.453139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7c6388-972a-4b58-8be1-a68955b00ba5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9e9462-2tg47\" (UID: \"2a7c6388-972a-4b58-8be1-a68955b00ba5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"
Sep 19 09:38:37.453789 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.453762    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7c6388-972a-4b58-8be1-a68955b00ba5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9e9462-2tg47\" (UID: \"2a7c6388-972a-4b58-8be1-a68955b00ba5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"
Sep 19 09:38:37.537468 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.537377    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"
Sep 19 09:38:37.821743 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:37.821711    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"]
Sep 19 09:38:37.823345 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:38:37.823319    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7c6388_972a_4b58_8be1_a68955b00ba5.slice/crio-1b6f59d485deda1907027abb82c2cd61d9db4780bb1acf7d019229033ce6d684 WatchSource:0}: Error finding container 1b6f59d485deda1907027abb82c2cd61d9db4780bb1acf7d019229033ce6d684: Status 404 returned error can't find the container with id 1b6f59d485deda1907027abb82c2cd61d9db4780bb1acf7d019229033ce6d684
Sep 19 09:38:38.485955 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:38.485877    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 09:38:38.485955 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:38.485930    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 09:38:38.509207 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:38.509176    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47" event={"ID":"2a7c6388-972a-4b58-8be1-a68955b00ba5","Type":"ContainerStarted","Data":"e08ab92ec74783a97ea9216718e8298a26a13ed8e9b00b829578e85f0ee0da45"}
Sep 19 09:38:38.509376 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:38.509225    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47" event={"ID":"2a7c6388-972a-4b58-8be1-a68955b00ba5","Type":"ContainerStarted","Data":"1b6f59d485deda1907027abb82c2cd61d9db4780bb1acf7d019229033ce6d684"}
Sep 19 09:38:38.535165 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:38.535122    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47" podStartSLOduration=1.5351051660000001 podStartE2EDuration="1.535105166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:38:38.533814031 +0000 UTC m=+1901.701009275" watchObservedRunningTime="2026-09-19 09:38:38.535105166 +0000 UTC m=+1901.702300395"
Sep 19 09:38:39.515914 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:39.515881    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a7c6388-972a-4b58-8be1-a68955b00ba5" containerID="e08ab92ec74783a97ea9216718e8298a26a13ed8e9b00b829578e85f0ee0da45" exitCode=0
Sep 19 09:38:39.516316 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:39.515972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47" event={"ID":"2a7c6388-972a-4b58-8be1-a68955b00ba5","Type":"ContainerDied","Data":"e08ab92ec74783a97ea9216718e8298a26a13ed8e9b00b829578e85f0ee0da45"}
Sep 19 09:38:40.663527 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:40.663504    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"
Sep 19 09:38:40.786217 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:40.786131    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7c6388-972a-4b58-8be1-a68955b00ba5-maas-api-service-ca\") pod \"2a7c6388-972a-4b58-8be1-a68955b00ba5\" (UID: \"2a7c6388-972a-4b58-8be1-a68955b00ba5\") "
Sep 19 09:38:40.786495 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:40.786472    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a7c6388-972a-4b58-8be1-a68955b00ba5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2a7c6388-972a-4b58-8be1-a68955b00ba5" (UID: "2a7c6388-972a-4b58-8be1-a68955b00ba5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:38:40.887583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:40.887544    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7c6388-972a-4b58-8be1-a68955b00ba5-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:41.528638 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:41.528609    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"
Sep 19 09:38:41.528804 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:41.528640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47" event={"ID":"2a7c6388-972a-4b58-8be1-a68955b00ba5","Type":"ContainerDied","Data":"1b6f59d485deda1907027abb82c2cd61d9db4780bb1acf7d019229033ce6d684"}
Sep 19 09:38:41.528804 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:41.528710    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b6f59d485deda1907027abb82c2cd61d9db4780bb1acf7d019229033ce6d684"
Sep 19 09:38:42.536047 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.536002    2579 generic.go:356] "Generic (PLEG): container finished" podID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerID="fa36c6443974a6d7a33bedf4c4ef0aae02bf18936bde13cf212146a3715d8838" exitCode=0
Sep 19 09:38:42.536387 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.536051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" event={"ID":"87ad42c5-4c31-479d-a58a-ef36ca1edbc1","Type":"ContainerDied","Data":"fa36c6443974a6d7a33bedf4c4ef0aae02bf18936bde13cf212146a3715d8838"}
Sep 19 09:38:42.536387 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.536125    2579 scope.go:117] "RemoveContainer" containerID="2a169c784d46f6e4d1998260aa8f3de0a0557b60b44e10b7f9e9e0de5598ee07"
Sep 19 09:38:42.556762 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.556744    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:38:42.706699 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.706603    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-podinfo\") pod \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") "
Sep 19 09:38:42.706699 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.706642    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istiod-ca-cert\") pod \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") "
Sep 19 09:38:42.706699 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.706687    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-credential-socket\") pod \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") "
Sep 19 09:38:42.706975 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.706754    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-envoy\") pod \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") "
Sep 19 09:38:42.706975 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.706797    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-certs\") pod \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") "
Sep 19 09:38:42.706975 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.706821    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-token\") pod \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") "
Sep 19 09:38:42.706975 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.706836    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-socket\") pod \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") "
Sep 19 09:38:42.706975 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.706889    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-data\") pod \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") "
Sep 19 09:38:42.706975 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.706913    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2q8x\" (UniqueName: \"kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-kube-api-access-d2q8x\") pod \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\" (UID: \"87ad42c5-4c31-479d-a58a-ef36ca1edbc1\") "
Sep 19 09:38:42.707300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.707055    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87ad42c5-4c31-479d-a58a-ef36ca1edbc1" (UID: "87ad42c5-4c31-479d-a58a-ef36ca1edbc1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:38:42.707300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.707156    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87ad42c5-4c31-479d-a58a-ef36ca1edbc1" (UID: "87ad42c5-4c31-479d-a58a-ef36ca1edbc1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:38:42.707300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.707177    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87ad42c5-4c31-479d-a58a-ef36ca1edbc1" (UID: "87ad42c5-4c31-479d-a58a-ef36ca1edbc1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:38:42.707300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.707247    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87ad42c5-4c31-479d-a58a-ef36ca1edbc1" (UID: "87ad42c5-4c31-479d-a58a-ef36ca1edbc1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:38:42.707666 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.707341    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-data" (OuterVolumeSpecName: "istio-data") pod "87ad42c5-4c31-479d-a58a-ef36ca1edbc1" (UID: "87ad42c5-4c31-479d-a58a-ef36ca1edbc1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:38:42.707666 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.707431    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-socket\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:42.707666 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.707448    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-data\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:42.707666 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.707461    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istiod-ca-cert\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:42.707666 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.707473    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-credential-socket\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:42.707666 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.707486    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-workload-certs\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:42.709097 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.709072    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87ad42c5-4c31-479d-a58a-ef36ca1edbc1" (UID: "87ad42c5-4c31-479d-a58a-ef36ca1edbc1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 09:38:42.709195 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.709133    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87ad42c5-4c31-479d-a58a-ef36ca1edbc1" (UID: "87ad42c5-4c31-479d-a58a-ef36ca1edbc1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:38:42.709195 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.709166    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-token" (OuterVolumeSpecName: "istio-token") pod "87ad42c5-4c31-479d-a58a-ef36ca1edbc1" (UID: "87ad42c5-4c31-479d-a58a-ef36ca1edbc1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:38:42.709268 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.709227    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-kube-api-access-d2q8x" (OuterVolumeSpecName: "kube-api-access-d2q8x") pod "87ad42c5-4c31-479d-a58a-ef36ca1edbc1" (UID: "87ad42c5-4c31-479d-a58a-ef36ca1edbc1"). InnerVolumeSpecName "kube-api-access-d2q8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:38:42.808515 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.808483    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2q8x\" (UniqueName: \"kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-kube-api-access-d2q8x\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:42.808515 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.808509    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-podinfo\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:42.808515 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.808518    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-envoy\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:42.808515 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:42.808525    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87ad42c5-4c31-479d-a58a-ef36ca1edbc1-istio-token\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:43.543470 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:43.543435    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"
Sep 19 09:38:43.543916 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:43.543481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt" event={"ID":"87ad42c5-4c31-479d-a58a-ef36ca1edbc1","Type":"ContainerDied","Data":"3fd36fb298debf4a25edf1f98d7e2675ed068e41f9b3922fdb01a90a23b4b3c2"}
Sep 19 09:38:43.543916 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:43.543530    2579 scope.go:117] "RemoveContainer" containerID="fa36c6443974a6d7a33bedf4c4ef0aae02bf18936bde13cf212146a3715d8838"
Sep 19 09:38:43.606182 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:43.606153    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"]
Sep 19 09:38:43.616163 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:43.616136    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-14e3f6-openshift-default-dfdff76fd-sb2gt"]
Sep 19 09:38:44.903861 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:44.903828    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" path="/var/lib/kubelet/pods/87ad42c5-4c31-479d-a58a-ef36ca1edbc1/volumes"
Sep 19 09:38:52.728380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:52.728346    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"]
Sep 19 09:38:52.728841 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:52.728621    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf" podUID="e95b2f80-8b0e-47af-a3d7-af74360997a4" containerName="payload-processing" containerID="cri-o://a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a" gracePeriod=30
Sep 19 09:38:52.735140 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:52.735111    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"]
Sep 19 09:38:52.735337 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:52.735315    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt" podUID="3265ab1c-37f5-449b-b728-d61b17a52548" containerName="payload-pre-processing" containerID="cri-o://c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f" gracePeriod=30
Sep 19 09:38:52.907610 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:52.907575    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"]
Sep 19 09:38:52.907976 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:52.907951    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e9462-2tg47"]
Sep 19 09:38:53.010214 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.010190    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:38:53.013001 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.012979    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:38:53.107751 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.107712    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pjsx\" (UniqueName: \"kubernetes.io/projected/e95b2f80-8b0e-47af-a3d7-af74360997a4-kube-api-access-8pjsx\") pod \"e95b2f80-8b0e-47af-a3d7-af74360997a4\" (UID: \"e95b2f80-8b0e-47af-a3d7-af74360997a4\") "
Sep 19 09:38:53.107949 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.107799    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3265ab1c-37f5-449b-b728-d61b17a52548-plugins-config-volume\") pod \"3265ab1c-37f5-449b-b728-d61b17a52548\" (UID: \"3265ab1c-37f5-449b-b728-d61b17a52548\") "
Sep 19 09:38:53.107949 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.107838    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc2jj\" (UniqueName: \"kubernetes.io/projected/3265ab1c-37f5-449b-b728-d61b17a52548-kube-api-access-qc2jj\") pod \"3265ab1c-37f5-449b-b728-d61b17a52548\" (UID: \"3265ab1c-37f5-449b-b728-d61b17a52548\") "
Sep 19 09:38:53.107949 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.107878    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e95b2f80-8b0e-47af-a3d7-af74360997a4-plugins-config-volume\") pod \"e95b2f80-8b0e-47af-a3d7-af74360997a4\" (UID: \"e95b2f80-8b0e-47af-a3d7-af74360997a4\") "
Sep 19 09:38:53.111161 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.108550    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e95b2f80-8b0e-47af-a3d7-af74360997a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e95b2f80-8b0e-47af-a3d7-af74360997a4" (UID: "e95b2f80-8b0e-47af-a3d7-af74360997a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:38:53.111161 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.108593    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3265ab1c-37f5-449b-b728-d61b17a52548-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3265ab1c-37f5-449b-b728-d61b17a52548" (UID: "3265ab1c-37f5-449b-b728-d61b17a52548"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:38:53.111161 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.108922    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3265ab1c-37f5-449b-b728-d61b17a52548-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:53.111161 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.108945    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e95b2f80-8b0e-47af-a3d7-af74360997a4-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:53.111161 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.111095    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e95b2f80-8b0e-47af-a3d7-af74360997a4-kube-api-access-8pjsx" (OuterVolumeSpecName: "kube-api-access-8pjsx") pod "e95b2f80-8b0e-47af-a3d7-af74360997a4" (UID: "e95b2f80-8b0e-47af-a3d7-af74360997a4"). InnerVolumeSpecName "kube-api-access-8pjsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:38:53.111457 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.111183    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3265ab1c-37f5-449b-b728-d61b17a52548-kube-api-access-qc2jj" (OuterVolumeSpecName: "kube-api-access-qc2jj") pod "3265ab1c-37f5-449b-b728-d61b17a52548" (UID: "3265ab1c-37f5-449b-b728-d61b17a52548"). InnerVolumeSpecName "kube-api-access-qc2jj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:38:53.210405 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.210367    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pjsx\" (UniqueName: \"kubernetes.io/projected/e95b2f80-8b0e-47af-a3d7-af74360997a4-kube-api-access-8pjsx\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:53.210405 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.210397    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc2jj\" (UniqueName: \"kubernetes.io/projected/3265ab1c-37f5-449b-b728-d61b17a52548-kube-api-access-qc2jj\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:38:53.603176 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.603142    2579 generic.go:356] "Generic (PLEG): container finished" podID="3265ab1c-37f5-449b-b728-d61b17a52548" containerID="c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f" exitCode=0
Sep 19 09:38:53.603339 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.603201    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"
Sep 19 09:38:53.603339 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.603232    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt" event={"ID":"3265ab1c-37f5-449b-b728-d61b17a52548","Type":"ContainerDied","Data":"c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f"}
Sep 19 09:38:53.603339 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.603325    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt" event={"ID":"3265ab1c-37f5-449b-b728-d61b17a52548","Type":"ContainerDied","Data":"bfa98cbf8450f3cea6d123d1905e51a0bd17c8d49e6b63e622e2352caf0e668b"}
Sep 19 09:38:53.603523 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.603350    2579 scope.go:117] "RemoveContainer" containerID="c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f"
Sep 19 09:38:53.604619 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.604599    2579 generic.go:356] "Generic (PLEG): container finished" podID="e95b2f80-8b0e-47af-a3d7-af74360997a4" containerID="a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a" exitCode=0
Sep 19 09:38:53.604711 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.604653    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"
Sep 19 09:38:53.604711 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.604700    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf" event={"ID":"e95b2f80-8b0e-47af-a3d7-af74360997a4","Type":"ContainerDied","Data":"a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a"}
Sep 19 09:38:53.604817 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.604748    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf" event={"ID":"e95b2f80-8b0e-47af-a3d7-af74360997a4","Type":"ContainerDied","Data":"d5252b58efbe92373050d32f756e953b48d3997b592f6e660c054aa9b05daef7"}
Sep 19 09:38:53.615651 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.615625    2579 scope.go:117] "RemoveContainer" containerID="c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f"
Sep 19 09:38:53.616048 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:38:53.616000    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f\": container with ID starting with c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f not found: ID does not exist" containerID="c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f"
Sep 19 09:38:53.616139 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.616056    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f"} err="failed to get container status \"c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f\": rpc error: code = NotFound desc = could not find container \"c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f\": container with ID starting with c22ae33e3f253070bd8fdf398e78c0492ee5975825e57fa95f4c0b9388e8431f not found: ID does not exist"
Sep 19 09:38:53.616139 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.616073    2579 scope.go:117] "RemoveContainer" containerID="a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a"
Sep 19 09:38:53.624629 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.624614    2579 scope.go:117] "RemoveContainer" containerID="a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a"
Sep 19 09:38:53.624882 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:38:53.624864    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a\": container with ID starting with a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a not found: ID does not exist" containerID="a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a"
Sep 19 09:38:53.624927 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.624890    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a"} err="failed to get container status \"a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a\": rpc error: code = NotFound desc = could not find container \"a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a\": container with ID starting with a576d6d58cea0eedb7b99cfc5dbdc27748dd0609f52412316f2268f5474cfd8a not found: ID does not exist"
Sep 19 09:38:53.631603 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.631581    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"]
Sep 19 09:38:53.635568 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.635533    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9e9462-54d89d9fc4-wzjkt"]
Sep 19 09:38:53.646115 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.646091    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"]
Sep 19 09:38:53.650501 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:53.650471    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9e9462-69d8ffbcfc-wsbdf"]
Sep 19 09:38:54.905689 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:54.905654    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a7c6388-972a-4b58-8be1-a68955b00ba5" path="/var/lib/kubelet/pods/2a7c6388-972a-4b58-8be1-a68955b00ba5/volumes"
Sep 19 09:38:54.906082 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:54.905997    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3265ab1c-37f5-449b-b728-d61b17a52548" path="/var/lib/kubelet/pods/3265ab1c-37f5-449b-b728-d61b17a52548/volumes"
Sep 19 09:38:54.906331 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:38:54.906318    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e95b2f80-8b0e-47af-a3d7-af74360997a4" path="/var/lib/kubelet/pods/e95b2f80-8b0e-47af-a3d7-af74360997a4/volumes"
Sep 19 09:39:00.005007 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.004968    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"]
Sep 19 09:39:00.005434 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005420    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95b2f80-8b0e-47af-a3d7-af74360997a4" containerName="payload-processing"
Sep 19 09:39:00.005480 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005436    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95b2f80-8b0e-47af-a3d7-af74360997a4" containerName="payload-processing"
Sep 19 09:39:00.005480 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005453    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a7c6388-972a-4b58-8be1-a68955b00ba5" containerName="revoke-keys"
Sep 19 09:39:00.005480 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005458    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a7c6388-972a-4b58-8be1-a68955b00ba5" containerName="revoke-keys"
Sep 19 09:39:00.005480 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005472    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3265ab1c-37f5-449b-b728-d61b17a52548" containerName="payload-pre-processing"
Sep 19 09:39:00.005480 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005479    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3265ab1c-37f5-449b-b728-d61b17a52548" containerName="payload-pre-processing"
Sep 19 09:39:00.005631 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005487    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy"
Sep 19 09:39:00.005631 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005492    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy"
Sep 19 09:39:00.005631 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005499    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy"
Sep 19 09:39:00.005631 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005505    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy"
Sep 19 09:39:00.005631 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005567    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e95b2f80-8b0e-47af-a3d7-af74360997a4" containerName="payload-processing"
Sep 19 09:39:00.005631 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005573    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a7c6388-972a-4b58-8be1-a68955b00ba5" containerName="revoke-keys"
Sep 19 09:39:00.005631 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005580    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy"
Sep 19 09:39:00.005631 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.005585    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3265ab1c-37f5-449b-b728-d61b17a52548" containerName="payload-pre-processing"
Sep 19 09:39:00.010599 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.010582    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"
Sep 19 09:39:00.012994 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.012963    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:39:00.013895 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.013769    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:39:00.017178 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.017155    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"]
Sep 19 09:39:00.079877 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.079845    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87cf5e12-5349-4168-920a-09bd8bb27536-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0304ec-97l2p\" (UID: \"87cf5e12-5349-4168-920a-09bd8bb27536\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"
Sep 19 09:39:00.181006 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.180965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87cf5e12-5349-4168-920a-09bd8bb27536-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0304ec-97l2p\" (UID: \"87cf5e12-5349-4168-920a-09bd8bb27536\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"
Sep 19 09:39:00.181631 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.181611    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87cf5e12-5349-4168-920a-09bd8bb27536-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0304ec-97l2p\" (UID: \"87cf5e12-5349-4168-920a-09bd8bb27536\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"
Sep 19 09:39:00.321447 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.321414    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"
Sep 19 09:39:00.592093 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.592069    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"]
Sep 19 09:39:00.594096 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:39:00.594071    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cf5e12_5349_4168_920a_09bd8bb27536.slice/crio-def2472619952f9504a14f84356a0ff8e0c5485ecc0a7f5bc8ff0a1f21cca054 WatchSource:0}: Error finding container def2472619952f9504a14f84356a0ff8e0c5485ecc0a7f5bc8ff0a1f21cca054: Status 404 returned error can't find the container with id def2472619952f9504a14f84356a0ff8e0c5485ecc0a7f5bc8ff0a1f21cca054
Sep 19 09:39:00.657336 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:00.657310    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p" event={"ID":"87cf5e12-5349-4168-920a-09bd8bb27536","Type":"ContainerStarted","Data":"def2472619952f9504a14f84356a0ff8e0c5485ecc0a7f5bc8ff0a1f21cca054"}
Sep 19 09:39:01.664663 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:01.664630    2579 generic.go:356] "Generic (PLEG): container finished" podID="87cf5e12-5349-4168-920a-09bd8bb27536" containerID="df792789f0f97eabe0b3b129f833ed479e54c2ee4d17718b44c91ccc430a00aa" exitCode=0
Sep 19 09:39:01.665098 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:01.664720    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p" event={"ID":"87cf5e12-5349-4168-920a-09bd8bb27536","Type":"ContainerDied","Data":"df792789f0f97eabe0b3b129f833ed479e54c2ee4d17718b44c91ccc430a00aa"}
Sep 19 09:39:02.805906 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:02.805878    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"
Sep 19 09:39:02.906471 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:02.906445    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87cf5e12-5349-4168-920a-09bd8bb27536-maas-api-service-ca\") pod \"87cf5e12-5349-4168-920a-09bd8bb27536\" (UID: \"87cf5e12-5349-4168-920a-09bd8bb27536\") "
Sep 19 09:39:02.906767 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:02.906747    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87cf5e12-5349-4168-920a-09bd8bb27536-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87cf5e12-5349-4168-920a-09bd8bb27536" (UID: "87cf5e12-5349-4168-920a-09bd8bb27536"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:39:03.007505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:03.007429    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87cf5e12-5349-4168-920a-09bd8bb27536-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:03.677319 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:03.677293    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"
Sep 19 09:39:03.677498 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:03.677325    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p" event={"ID":"87cf5e12-5349-4168-920a-09bd8bb27536","Type":"ContainerDied","Data":"def2472619952f9504a14f84356a0ff8e0c5485ecc0a7f5bc8ff0a1f21cca054"}
Sep 19 09:39:03.677498 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:03.677396    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="def2472619952f9504a14f84356a0ff8e0c5485ecc0a7f5bc8ff0a1f21cca054"
Sep 19 09:39:15.573199 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:15.573152    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"]
Sep 19 09:39:15.573778 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:15.573418    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9" podUID="486104b3-502f-4b55-a57c-2b0c745220aa" containerName="payload-pre-processing" containerID="cri-o://4236d4cae77d5d2ee22c009e2159faa39b91e6adb05c3d80eb54d0d311a4641b" gracePeriod=30
Sep 19 09:39:15.748245 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:15.748207    2579 generic.go:356] "Generic (PLEG): container finished" podID="486104b3-502f-4b55-a57c-2b0c745220aa" containerID="4236d4cae77d5d2ee22c009e2159faa39b91e6adb05c3d80eb54d0d311a4641b" exitCode=0
Sep 19 09:39:15.748370 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:15.748285    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9" event={"ID":"486104b3-502f-4b55-a57c-2b0c745220aa","Type":"ContainerDied","Data":"4236d4cae77d5d2ee22c009e2159faa39b91e6adb05c3d80eb54d0d311a4641b"}
Sep 19 09:39:15.758680 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:15.758655    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"]
Sep 19 09:39:15.762879 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:15.762851    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0304ec-97l2p"]
Sep 19 09:39:15.846946 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:15.846611    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:39:15.935623 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:15.935593    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/486104b3-502f-4b55-a57c-2b0c745220aa-plugins-config-volume\") pod \"486104b3-502f-4b55-a57c-2b0c745220aa\" (UID: \"486104b3-502f-4b55-a57c-2b0c745220aa\") "
Sep 19 09:39:15.935623 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:15.935626    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x57sg\" (UniqueName: \"kubernetes.io/projected/486104b3-502f-4b55-a57c-2b0c745220aa-kube-api-access-x57sg\") pod \"486104b3-502f-4b55-a57c-2b0c745220aa\" (UID: \"486104b3-502f-4b55-a57c-2b0c745220aa\") "
Sep 19 09:39:15.936033 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:15.935994    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/486104b3-502f-4b55-a57c-2b0c745220aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "486104b3-502f-4b55-a57c-2b0c745220aa" (UID: "486104b3-502f-4b55-a57c-2b0c745220aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:39:15.937944 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:15.937923    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/486104b3-502f-4b55-a57c-2b0c745220aa-kube-api-access-x57sg" (OuterVolumeSpecName: "kube-api-access-x57sg") pod "486104b3-502f-4b55-a57c-2b0c745220aa" (UID: "486104b3-502f-4b55-a57c-2b0c745220aa"). InnerVolumeSpecName "kube-api-access-x57sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:39:16.036777 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:16.036739    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/486104b3-502f-4b55-a57c-2b0c745220aa-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:16.037037 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:16.036983    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x57sg\" (UniqueName: \"kubernetes.io/projected/486104b3-502f-4b55-a57c-2b0c745220aa-kube-api-access-x57sg\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:16.755599 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:16.755563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9" event={"ID":"486104b3-502f-4b55-a57c-2b0c745220aa","Type":"ContainerDied","Data":"1a1ec3a194c17d3622a218fed1ca7cdd8ff35c09bb17a054f991e32ef140c28f"}
Sep 19 09:39:16.756089 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:16.755616    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"
Sep 19 09:39:16.756089 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:16.755648    2579 scope.go:117] "RemoveContainer" containerID="4236d4cae77d5d2ee22c009e2159faa39b91e6adb05c3d80eb54d0d311a4641b"
Sep 19 09:39:16.786245 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:16.786215    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"]
Sep 19 09:39:16.792290 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:16.792270    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0304ec-54794f799d-b4jz9"]
Sep 19 09:39:16.904767 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:16.904732    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="486104b3-502f-4b55-a57c-2b0c745220aa" path="/var/lib/kubelet/pods/486104b3-502f-4b55-a57c-2b0c745220aa/volumes"
Sep 19 09:39:16.905096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:16.905083    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87cf5e12-5349-4168-920a-09bd8bb27536" path="/var/lib/kubelet/pods/87cf5e12-5349-4168-920a-09bd8bb27536/volumes"
Sep 19 09:39:22.668744 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.668707    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"]
Sep 19 09:39:22.669227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.669192    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87cf5e12-5349-4168-920a-09bd8bb27536" containerName="revoke-keys"
Sep 19 09:39:22.669227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.669205    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="87cf5e12-5349-4168-920a-09bd8bb27536" containerName="revoke-keys"
Sep 19 09:39:22.669227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.669219    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="486104b3-502f-4b55-a57c-2b0c745220aa" containerName="payload-pre-processing"
Sep 19 09:39:22.669227 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.669225    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="486104b3-502f-4b55-a57c-2b0c745220aa" containerName="payload-pre-processing"
Sep 19 09:39:22.669355 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.669296    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="486104b3-502f-4b55-a57c-2b0c745220aa" containerName="payload-pre-processing"
Sep 19 09:39:22.669355 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.669305    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="87cf5e12-5349-4168-920a-09bd8bb27536" containerName="revoke-keys"
Sep 19 09:39:22.669355 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.669315    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ad42c5-4c31-479d-a58a-ef36ca1edbc1" containerName="istio-proxy"
Sep 19 09:39:22.672487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.672471    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"
Sep 19 09:39:22.676701 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.676678    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:39:22.676827 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.676705    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:39:22.680448 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.680384    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"]
Sep 19 09:39:22.709532 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.709500    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z\" (UID: \"ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"
Sep 19 09:39:22.810739 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.810707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z\" (UID: \"ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"
Sep 19 09:39:22.811377 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.811354    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z\" (UID: \"ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"
Sep 19 09:39:22.984302 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:22.984214    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"
Sep 19 09:39:23.255112 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:23.255088    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"]
Sep 19 09:39:23.256933 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:39:23.256908    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6d9bf7_a5ab_40f4_b12c_3fd1e7d8e5a1.slice/crio-6745a054486cb9ff7177da392bedf32edf36986e4faad9bbcd76346c49770f4e WatchSource:0}: Error finding container 6745a054486cb9ff7177da392bedf32edf36986e4faad9bbcd76346c49770f4e: Status 404 returned error can't find the container with id 6745a054486cb9ff7177da392bedf32edf36986e4faad9bbcd76346c49770f4e
Sep 19 09:39:23.797199 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:23.797166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z" event={"ID":"ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1","Type":"ContainerStarted","Data":"a28b1e5926be8df2fa6c18579cd804cb7317787b02b72eca7fc468a3b33a8fe6"}
Sep 19 09:39:23.797570 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:23.797216    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z" event={"ID":"ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1","Type":"ContainerStarted","Data":"6745a054486cb9ff7177da392bedf32edf36986e4faad9bbcd76346c49770f4e"}
Sep 19 09:39:24.805596 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:24.805559    2579 generic.go:356] "Generic (PLEG): container finished" podID="ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1" containerID="a28b1e5926be8df2fa6c18579cd804cb7317787b02b72eca7fc468a3b33a8fe6" exitCode=0
Sep 19 09:39:24.805977 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:24.805647    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z" event={"ID":"ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1","Type":"ContainerDied","Data":"a28b1e5926be8df2fa6c18579cd804cb7317787b02b72eca7fc468a3b33a8fe6"}
Sep 19 09:39:25.954935 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:25.954911    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"
Sep 19 09:39:26.035784 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:26.035755    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1-maas-api-service-ca\") pod \"ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1\" (UID: \"ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1\") "
Sep 19 09:39:26.036152 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:26.036126    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1" (UID: "ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:39:26.137387 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:26.137302    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:26.819884 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:26.819859    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"
Sep 19 09:39:26.820087 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:26.819862    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z" event={"ID":"ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1","Type":"ContainerDied","Data":"6745a054486cb9ff7177da392bedf32edf36986e4faad9bbcd76346c49770f4e"}
Sep 19 09:39:26.820087 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:26.819972    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6745a054486cb9ff7177da392bedf32edf36986e4faad9bbcd76346c49770f4e"
Sep 19 09:39:33.613468 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.613414    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"]
Sep 19 09:39:33.613978 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.613710    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb" podUID="f5100055-8353-4811-ac93-66d63089163e" containerName="payload-processing" containerID="cri-o://d796f02f24861f8b0be0488c175d3fa5ddfa3292aafee82db2e289deb2d7ee22" gracePeriod=30
Sep 19 09:39:33.615788 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.615765    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"]
Sep 19 09:39:33.615990 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.615945    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq" podUID="ba16b663-8b29-4094-ad5a-a1eb28ba4f6a" containerName="payload-pre-processing" containerID="cri-o://1d9c61b86643ac47312a6e8f55e3f24b0f90758c43a92be1deb7a441dff0f141" gracePeriod=30
Sep 19 09:39:33.868573 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.868444    2579 generic.go:356] "Generic (PLEG): container finished" podID="ba16b663-8b29-4094-ad5a-a1eb28ba4f6a" containerID="1d9c61b86643ac47312a6e8f55e3f24b0f90758c43a92be1deb7a441dff0f141" exitCode=0
Sep 19 09:39:33.868736 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.868563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq" event={"ID":"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a","Type":"ContainerDied","Data":"1d9c61b86643ac47312a6e8f55e3f24b0f90758c43a92be1deb7a441dff0f141"}
Sep 19 09:39:33.870796 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.870772    2579 generic.go:356] "Generic (PLEG): container finished" podID="f5100055-8353-4811-ac93-66d63089163e" containerID="d796f02f24861f8b0be0488c175d3fa5ddfa3292aafee82db2e289deb2d7ee22" exitCode=0
Sep 19 09:39:33.870896 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.870853    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb" event={"ID":"f5100055-8353-4811-ac93-66d63089163e","Type":"ContainerDied","Data":"d796f02f24861f8b0be0488c175d3fa5ddfa3292aafee82db2e289deb2d7ee22"}
Sep 19 09:39:33.892148 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.892126    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:39:33.907407 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.907382    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"]
Sep 19 09:39:33.914463 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.914446    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:39:33.916621 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:33.916600    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-261ce4-l682z"]
Sep 19 09:39:34.016390 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.016356    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lzl9\" (UniqueName: \"kubernetes.io/projected/f5100055-8353-4811-ac93-66d63089163e-kube-api-access-5lzl9\") pod \"f5100055-8353-4811-ac93-66d63089163e\" (UID: \"f5100055-8353-4811-ac93-66d63089163e\") "
Sep 19 09:39:34.016390 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.016399    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5100055-8353-4811-ac93-66d63089163e-plugins-config-volume\") pod \"f5100055-8353-4811-ac93-66d63089163e\" (UID: \"f5100055-8353-4811-ac93-66d63089163e\") "
Sep 19 09:39:34.016637 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.016453    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqsks\" (UniqueName: \"kubernetes.io/projected/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-kube-api-access-jqsks\") pod \"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a\" (UID: \"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a\") "
Sep 19 09:39:34.016637 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.016534    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-plugins-config-volume\") pod \"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a\" (UID: \"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a\") "
Sep 19 09:39:34.016845 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.016821    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5100055-8353-4811-ac93-66d63089163e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5100055-8353-4811-ac93-66d63089163e" (UID: "f5100055-8353-4811-ac93-66d63089163e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:39:34.016927 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.016907    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ba16b663-8b29-4094-ad5a-a1eb28ba4f6a" (UID: "ba16b663-8b29-4094-ad5a-a1eb28ba4f6a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:39:34.016974 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.016915    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5100055-8353-4811-ac93-66d63089163e-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:34.018717 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.018695    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-kube-api-access-jqsks" (OuterVolumeSpecName: "kube-api-access-jqsks") pod "ba16b663-8b29-4094-ad5a-a1eb28ba4f6a" (UID: "ba16b663-8b29-4094-ad5a-a1eb28ba4f6a"). InnerVolumeSpecName "kube-api-access-jqsks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:39:34.018979 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.018961    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5100055-8353-4811-ac93-66d63089163e-kube-api-access-5lzl9" (OuterVolumeSpecName: "kube-api-access-5lzl9") pod "f5100055-8353-4811-ac93-66d63089163e" (UID: "f5100055-8353-4811-ac93-66d63089163e"). InnerVolumeSpecName "kube-api-access-5lzl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:39:34.117515 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.117474    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lzl9\" (UniqueName: \"kubernetes.io/projected/f5100055-8353-4811-ac93-66d63089163e-kube-api-access-5lzl9\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:34.117515 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.117506    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqsks\" (UniqueName: \"kubernetes.io/projected/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-kube-api-access-jqsks\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:34.117515 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.117515    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:34.878996 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.878910    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"
Sep 19 09:39:34.878996 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.878936    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq" event={"ID":"ba16b663-8b29-4094-ad5a-a1eb28ba4f6a","Type":"ContainerDied","Data":"3c7cdf59a9cddbd9b8c3f5b6ef69a948d0bce0bfb058b87e45612fef035ce374"}
Sep 19 09:39:34.879482 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.879009    2579 scope.go:117] "RemoveContainer" containerID="1d9c61b86643ac47312a6e8f55e3f24b0f90758c43a92be1deb7a441dff0f141"
Sep 19 09:39:34.880529 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.880512    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"
Sep 19 09:39:34.880601 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.880533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb" event={"ID":"f5100055-8353-4811-ac93-66d63089163e","Type":"ContainerDied","Data":"67c0057bf73a55a4c770c61bb85599ddac373e7c903be5a857b099e85799adb8"}
Sep 19 09:39:34.896647 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.896628    2579 scope.go:117] "RemoveContainer" containerID="d796f02f24861f8b0be0488c175d3fa5ddfa3292aafee82db2e289deb2d7ee22"
Sep 19 09:39:34.903322 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.903296    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1" path="/var/lib/kubelet/pods/ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1/volumes"
Sep 19 09:39:34.945121 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.945089    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"]
Sep 19 09:39:34.956823 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:34.956799    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-261ce4-659948d75d-wdpzq"]
Sep 19 09:39:35.025404 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:35.025372    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"]
Sep 19 09:39:35.052606 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:35.052579    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-261ce4-fcd5fb9b7-4qgzb"]
Sep 19 09:39:36.906370 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:36.906338    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba16b663-8b29-4094-ad5a-a1eb28ba4f6a" path="/var/lib/kubelet/pods/ba16b663-8b29-4094-ad5a-a1eb28ba4f6a/volumes"
Sep 19 09:39:36.906737 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:36.906692    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5100055-8353-4811-ac93-66d63089163e" path="/var/lib/kubelet/pods/f5100055-8353-4811-ac93-66d63089163e/volumes"
Sep 19 09:39:40.969282 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.969188    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"]
Sep 19 09:39:40.969746 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.969729    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5100055-8353-4811-ac93-66d63089163e" containerName="payload-processing"
Sep 19 09:39:40.969790 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.969749    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5100055-8353-4811-ac93-66d63089163e" containerName="payload-processing"
Sep 19 09:39:40.969790 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.969758    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1" containerName="revoke-keys"
Sep 19 09:39:40.969790 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.969764    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1" containerName="revoke-keys"
Sep 19 09:39:40.969790 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.969780    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba16b663-8b29-4094-ad5a-a1eb28ba4f6a" containerName="payload-pre-processing"
Sep 19 09:39:40.969790 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.969788    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba16b663-8b29-4094-ad5a-a1eb28ba4f6a" containerName="payload-pre-processing"
Sep 19 09:39:40.969934 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.969867    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba16b663-8b29-4094-ad5a-a1eb28ba4f6a" containerName="payload-pre-processing"
Sep 19 09:39:40.969934 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.969876    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5100055-8353-4811-ac93-66d63089163e" containerName="payload-processing"
Sep 19 09:39:40.969934 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.969886    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6d9bf7-a5ab-40f4-b12c-3fd1e7d8e5a1" containerName="revoke-keys"
Sep 19 09:39:40.974150 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.974134    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"
Sep 19 09:39:40.976309 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.976286    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:39:40.976518 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.976504    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:39:40.981126 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:40.981098    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"]
Sep 19 09:39:41.087598 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:41.087555    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe8d206-3ec0-436f-a341-1d2b6e096de7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq\" (UID: \"afe8d206-3ec0-436f-a341-1d2b6e096de7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"
Sep 19 09:39:41.188787 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:41.188749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe8d206-3ec0-436f-a341-1d2b6e096de7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq\" (UID: \"afe8d206-3ec0-436f-a341-1d2b6e096de7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"
Sep 19 09:39:41.189347 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:41.189330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe8d206-3ec0-436f-a341-1d2b6e096de7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq\" (UID: \"afe8d206-3ec0-436f-a341-1d2b6e096de7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"
Sep 19 09:39:41.285397 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:41.285315    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"
Sep 19 09:39:41.557619 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:41.557582    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"]
Sep 19 09:39:41.559309 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:39:41.559284    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe8d206_3ec0_436f_a341_1d2b6e096de7.slice/crio-8fe44504ac22f2cdf69e85194699f2947f7db903bf5259a5be146a5ed364a390 WatchSource:0}: Error finding container 8fe44504ac22f2cdf69e85194699f2947f7db903bf5259a5be146a5ed364a390: Status 404 returned error can't find the container with id 8fe44504ac22f2cdf69e85194699f2947f7db903bf5259a5be146a5ed364a390
Sep 19 09:39:41.925298 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:41.925256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq" event={"ID":"afe8d206-3ec0-436f-a341-1d2b6e096de7","Type":"ContainerStarted","Data":"ad0356bb3e900c8342fa9d334582f689e1bf50d98f8d9a70c36986a2e527363c"}
Sep 19 09:39:41.925504 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:41.925319    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq" event={"ID":"afe8d206-3ec0-436f-a341-1d2b6e096de7","Type":"ContainerStarted","Data":"8fe44504ac22f2cdf69e85194699f2947f7db903bf5259a5be146a5ed364a390"}
Sep 19 09:39:41.942788 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:41.942731    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq" podStartSLOduration=1.942712227 podStartE2EDuration="1.942712227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:39:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:39:41.941192653 +0000 UTC m=+1965.108387885" watchObservedRunningTime="2026-09-19 09:39:41.942712227 +0000 UTC m=+1965.109907457"
Sep 19 09:39:42.932259 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:42.932227    2579 generic.go:356] "Generic (PLEG): container finished" podID="afe8d206-3ec0-436f-a341-1d2b6e096de7" containerID="ad0356bb3e900c8342fa9d334582f689e1bf50d98f8d9a70c36986a2e527363c" exitCode=0
Sep 19 09:39:42.932644 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:42.932294    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq" event={"ID":"afe8d206-3ec0-436f-a341-1d2b6e096de7","Type":"ContainerDied","Data":"ad0356bb3e900c8342fa9d334582f689e1bf50d98f8d9a70c36986a2e527363c"}
Sep 19 09:39:44.069795 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:44.069769    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"
Sep 19 09:39:44.218600 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:44.218518    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe8d206-3ec0-436f-a341-1d2b6e096de7-maas-api-service-ca\") pod \"afe8d206-3ec0-436f-a341-1d2b6e096de7\" (UID: \"afe8d206-3ec0-436f-a341-1d2b6e096de7\") "
Sep 19 09:39:44.218865 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:44.218844    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afe8d206-3ec0-436f-a341-1d2b6e096de7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "afe8d206-3ec0-436f-a341-1d2b6e096de7" (UID: "afe8d206-3ec0-436f-a341-1d2b6e096de7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:39:44.319582 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:44.319548    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe8d206-3ec0-436f-a341-1d2b6e096de7-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:44.944085 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:44.944060    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"
Sep 19 09:39:44.944249 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:44.944051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq" event={"ID":"afe8d206-3ec0-436f-a341-1d2b6e096de7","Type":"ContainerDied","Data":"8fe44504ac22f2cdf69e85194699f2947f7db903bf5259a5be146a5ed364a390"}
Sep 19 09:39:44.944249 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:44.944176    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fe44504ac22f2cdf69e85194699f2947f7db903bf5259a5be146a5ed364a390"
Sep 19 09:39:51.570743 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.570707    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"]
Sep 19 09:39:51.571235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.570960    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q" podUID="6df3eb58-a5c5-4226-ab42-ec9761f89d13" containerName="payload-processing" containerID="cri-o://5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108" gracePeriod=30
Sep 19 09:39:51.584507 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.584478    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"]
Sep 19 09:39:51.584689 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.584670    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw" podUID="2f400e83-5689-4cbb-a790-8c3ed6b4f755" containerName="payload-pre-processing" containerID="cri-o://4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24" gracePeriod=30
Sep 19 09:39:51.773842 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.773808    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"]
Sep 19 09:39:51.781285 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.781255    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-66c0fb-jtmgq"]
Sep 19 09:39:51.841984 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.841964    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:39:51.871401 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.871378    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:39:51.983912 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.983878    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f400e83-5689-4cbb-a790-8c3ed6b4f755" containerID="4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24" exitCode=0
Sep 19 09:39:51.984118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.983922    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"
Sep 19 09:39:51.984118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.983964    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw" event={"ID":"2f400e83-5689-4cbb-a790-8c3ed6b4f755","Type":"ContainerDied","Data":"4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24"}
Sep 19 09:39:51.984118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.984035    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw" event={"ID":"2f400e83-5689-4cbb-a790-8c3ed6b4f755","Type":"ContainerDied","Data":"0178d25a42a45b24eda5101a559f914d24049161638f1505fb81be3e461aef93"}
Sep 19 09:39:51.984118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.984069    2579 scope.go:117] "RemoveContainer" containerID="4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24"
Sep 19 09:39:51.985314 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.985295    2579 generic.go:356] "Generic (PLEG): container finished" podID="6df3eb58-a5c5-4226-ab42-ec9761f89d13" containerID="5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108" exitCode=0
Sep 19 09:39:51.985413 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.985331    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"
Sep 19 09:39:51.985413 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.985380    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q" event={"ID":"6df3eb58-a5c5-4226-ab42-ec9761f89d13","Type":"ContainerDied","Data":"5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108"}
Sep 19 09:39:51.985486 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.985423    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q" event={"ID":"6df3eb58-a5c5-4226-ab42-ec9761f89d13","Type":"ContainerDied","Data":"feb1c0726644c9e5434a1cbea80dba5bf6ed94f1700c2b95774ba3e507a255e8"}
Sep 19 09:39:51.993364 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.993342    2579 scope.go:117] "RemoveContainer" containerID="4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24"
Sep 19 09:39:51.993574 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.993557    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df3eb58-a5c5-4226-ab42-ec9761f89d13-plugins-config-volume\") pod \"6df3eb58-a5c5-4226-ab42-ec9761f89d13\" (UID: \"6df3eb58-a5c5-4226-ab42-ec9761f89d13\") "
Sep 19 09:39:51.993643 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:39:51.993611    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24\": container with ID starting with 4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24 not found: ID does not exist" containerID="4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24"
Sep 19 09:39:51.993695 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.993640    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24"} err="failed to get container status \"4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24\": rpc error: code = NotFound desc = could not find container \"4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24\": container with ID starting with 4bec4ff9d72d99ebd36ff0758ea1dd6200aeed4c3c8a1e1a20c800735fd0fd24 not found: ID does not exist"
Sep 19 09:39:51.993695 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.993661    2579 scope.go:117] "RemoveContainer" containerID="5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108"
Sep 19 09:39:51.993695 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.993669    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m28pq\" (UniqueName: \"kubernetes.io/projected/6df3eb58-a5c5-4226-ab42-ec9761f89d13-kube-api-access-m28pq\") pod \"6df3eb58-a5c5-4226-ab42-ec9761f89d13\" (UID: \"6df3eb58-a5c5-4226-ab42-ec9761f89d13\") "
Sep 19 09:39:51.993969 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.993752    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f400e83-5689-4cbb-a790-8c3ed6b4f755-plugins-config-volume\") pod \"2f400e83-5689-4cbb-a790-8c3ed6b4f755\" (UID: \"2f400e83-5689-4cbb-a790-8c3ed6b4f755\") "
Sep 19 09:39:51.993969 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.993791    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gpbc\" (UniqueName: \"kubernetes.io/projected/2f400e83-5689-4cbb-a790-8c3ed6b4f755-kube-api-access-7gpbc\") pod \"2f400e83-5689-4cbb-a790-8c3ed6b4f755\" (UID: \"2f400e83-5689-4cbb-a790-8c3ed6b4f755\") "
Sep 19 09:39:51.994118 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.994096    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6df3eb58-a5c5-4226-ab42-ec9761f89d13-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6df3eb58-a5c5-4226-ab42-ec9761f89d13" (UID: "6df3eb58-a5c5-4226-ab42-ec9761f89d13"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:39:51.994207 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.994186    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f400e83-5689-4cbb-a790-8c3ed6b4f755-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f400e83-5689-4cbb-a790-8c3ed6b4f755" (UID: "2f400e83-5689-4cbb-a790-8c3ed6b4f755"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:39:51.995838 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.995811    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6df3eb58-a5c5-4226-ab42-ec9761f89d13-kube-api-access-m28pq" (OuterVolumeSpecName: "kube-api-access-m28pq") pod "6df3eb58-a5c5-4226-ab42-ec9761f89d13" (UID: "6df3eb58-a5c5-4226-ab42-ec9761f89d13"). InnerVolumeSpecName "kube-api-access-m28pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:39:51.996055 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:51.996034    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f400e83-5689-4cbb-a790-8c3ed6b4f755-kube-api-access-7gpbc" (OuterVolumeSpecName: "kube-api-access-7gpbc") pod "2f400e83-5689-4cbb-a790-8c3ed6b4f755" (UID: "2f400e83-5689-4cbb-a790-8c3ed6b4f755"). InnerVolumeSpecName "kube-api-access-7gpbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:39:52.001704 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.001685    2579 scope.go:117] "RemoveContainer" containerID="5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108"
Sep 19 09:39:52.001969 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:39:52.001946    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108\": container with ID starting with 5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108 not found: ID does not exist" containerID="5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108"
Sep 19 09:39:52.002029 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.001971    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108"} err="failed to get container status \"5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108\": rpc error: code = NotFound desc = could not find container \"5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108\": container with ID starting with 5bca52120fd71819bbef8e0515bb7196e5ba355c399377566abe57abe1445108 not found: ID does not exist"
Sep 19 09:39:52.094887 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.094808    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m28pq\" (UniqueName: \"kubernetes.io/projected/6df3eb58-a5c5-4226-ab42-ec9761f89d13-kube-api-access-m28pq\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:52.094887 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.094836    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f400e83-5689-4cbb-a790-8c3ed6b4f755-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:52.094887 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.094845    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gpbc\" (UniqueName: \"kubernetes.io/projected/2f400e83-5689-4cbb-a790-8c3ed6b4f755-kube-api-access-7gpbc\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:52.094887 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.094856    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df3eb58-a5c5-4226-ab42-ec9761f89d13-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:39:52.322089 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.322054    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"]
Sep 19 09:39:52.326415 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.326394    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-66c0fb-fdb8bd8c7-dvc6q"]
Sep 19 09:39:52.337624 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.337601    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"]
Sep 19 09:39:52.343934 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.343911    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-66c0fb-6fd8cbcb74-zljqw"]
Sep 19 09:39:52.904493 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.904413    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f400e83-5689-4cbb-a790-8c3ed6b4f755" path="/var/lib/kubelet/pods/2f400e83-5689-4cbb-a790-8c3ed6b4f755/volumes"
Sep 19 09:39:52.904834 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.904742    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6df3eb58-a5c5-4226-ab42-ec9761f89d13" path="/var/lib/kubelet/pods/6df3eb58-a5c5-4226-ab42-ec9761f89d13/volumes"
Sep 19 09:39:52.905061 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:52.905048    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afe8d206-3ec0-436f-a341-1d2b6e096de7" path="/var/lib/kubelet/pods/afe8d206-3ec0-436f-a341-1d2b6e096de7/volumes"
Sep 19 09:39:59.222470 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:59.222437    2579 scope.go:117] "RemoveContainer" containerID="26d37c17dd9ed7822899338aced5ae2dfcb651ed415a5e3863fafc9b14a520c0"
Sep 19 09:39:59.230926 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:39:59.230909    2579 scope.go:117] "RemoveContainer" containerID="63bd5954c8f1fd20cc8afbde3af13c54cdeec2ca7ec1a53c7b35744245e303fb"
Sep 19 09:41:59.030418 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:41:59.030387    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:41:59.032588 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:41:59.032571    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:41:59.284273 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:41:59.284197    2579 scope.go:117] "RemoveContainer" containerID="a92bdfcc3fe123743655a157c049b0914e4c12ff0097a09007504dbf8cab7587"
Sep 19 09:42:29.966876 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.966840    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"]
Sep 19 09:42:29.967505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.967408    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe8d206-3ec0-436f-a341-1d2b6e096de7" containerName="revoke-keys"
Sep 19 09:42:29.967505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.967425    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe8d206-3ec0-436f-a341-1d2b6e096de7" containerName="revoke-keys"
Sep 19 09:42:29.967505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.967463    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6df3eb58-a5c5-4226-ab42-ec9761f89d13" containerName="payload-processing"
Sep 19 09:42:29.967505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.967468    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6df3eb58-a5c5-4226-ab42-ec9761f89d13" containerName="payload-processing"
Sep 19 09:42:29.967505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.967481    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f400e83-5689-4cbb-a790-8c3ed6b4f755" containerName="payload-pre-processing"
Sep 19 09:42:29.967505 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.967486    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f400e83-5689-4cbb-a790-8c3ed6b4f755" containerName="payload-pre-processing"
Sep 19 09:42:29.967738 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.967540    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f400e83-5689-4cbb-a790-8c3ed6b4f755" containerName="payload-pre-processing"
Sep 19 09:42:29.967738 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.967550    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6df3eb58-a5c5-4226-ab42-ec9761f89d13" containerName="payload-processing"
Sep 19 09:42:29.967738 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.967556    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="afe8d206-3ec0-436f-a341-1d2b6e096de7" containerName="revoke-keys"
Sep 19 09:42:29.970710 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.970681    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:29.973282 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.973257    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-6fd1a9-openshift-default-dockercfg-rz9g9\""
Sep 19 09:42:29.983353 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:29.983329    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"]
Sep 19 09:42:30.040665 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.040632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/264dd078-edd5-43da-9bbe-fb4668b1458f-istiod-ca-cert\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.040847 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.040673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-credential-socket\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.040847 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.040724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-envoy\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.040847 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.040788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wprd\" (UniqueName: \"kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-kube-api-access-5wprd\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.040847 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.040814    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-podinfo\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.040847 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.040833    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-data\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.041136 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.040866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-token\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.041136 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.040906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-socket\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.041136 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.040956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-certs\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.142462 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.142419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wprd\" (UniqueName: \"kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-kube-api-access-5wprd\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.142462 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.142467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-podinfo\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.142737 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.142488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-data\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.142737 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.142506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-token\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.142737 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.142523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-socket\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.142737 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.142557    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-certs\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.142737 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.142605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/264dd078-edd5-43da-9bbe-fb4668b1458f-istiod-ca-cert\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.142737 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.142656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-credential-socket\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.142737 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.142695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-envoy\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.143116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.142918    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-data\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.143116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.142969    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-socket\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.143116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.143048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-certs\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.143228 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.143112    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-credential-socket\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.143354 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.143335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/264dd078-edd5-43da-9bbe-fb4668b1458f-istiod-ca-cert\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.144968 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.144952    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-envoy\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.145315 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.145294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-podinfo\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.150679 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.150658    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-token\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.150814 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.150795    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wprd\" (UniqueName: \"kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-kube-api-access-5wprd\") pod \"e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") " pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.281067 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.280961    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:30.575931 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.575879    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"]
Sep 19 09:42:30.578447 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:42:30.578422    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264dd078_edd5_43da_9bbe_fb4668b1458f.slice/crio-dfd8bdb4538032d2163ea1a8b118a191b1f34dbd4a378ed15e5faf72cd1e80bd WatchSource:0}: Error finding container dfd8bdb4538032d2163ea1a8b118a191b1f34dbd4a378ed15e5faf72cd1e80bd: Status 404 returned error can't find the container with id dfd8bdb4538032d2163ea1a8b118a191b1f34dbd4a378ed15e5faf72cd1e80bd
Sep 19 09:42:30.580679 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.580630    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:42:30.580764 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.580717    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:42:30.580764 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.580756    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:42:30.842167 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.842065    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" event={"ID":"264dd078-edd5-43da-9bbe-fb4668b1458f","Type":"ContainerStarted","Data":"07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda"}
Sep 19 09:42:30.842167 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.842142    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" event={"ID":"264dd078-edd5-43da-9bbe-fb4668b1458f","Type":"ContainerStarted","Data":"dfd8bdb4538032d2163ea1a8b118a191b1f34dbd4a378ed15e5faf72cd1e80bd"}
Sep 19 09:42:30.865627 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:30.865565    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" podStartSLOduration=1.865546906 podStartE2EDuration="1.865546906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:42:30.863356169 +0000 UTC m=+2134.030551419" watchObservedRunningTime="2026-09-19 09:42:30.865546906 +0000 UTC m=+2134.032742137"
Sep 19 09:42:31.281420 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:31.281336    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:31.286233 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:31.286210    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:31.847607 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:31.847575    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:31.848558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:31.848539    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:36.180061 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.180003    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"]
Sep 19 09:42:36.184223 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.184201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:42:36.187646 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.187621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-6fd1a9-dockercfg-dqpzg\""
Sep 19 09:42:36.188906 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.188885    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-6fd1a9\""
Sep 19 09:42:36.197870 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.197843    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"]
Sep 19 09:42:36.216595 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.216556    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5164b77e-3def-474c-9c89-be2ad6552e4b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg\" (UID: \"5164b77e-3def-474c-9c89-be2ad6552e4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:42:36.216766 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.216613    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4q7x\" (UniqueName: \"kubernetes.io/projected/5164b77e-3def-474c-9c89-be2ad6552e4b-kube-api-access-z4q7x\") pod \"payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg\" (UID: \"5164b77e-3def-474c-9c89-be2ad6552e4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:42:36.317595 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.317551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5164b77e-3def-474c-9c89-be2ad6552e4b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg\" (UID: \"5164b77e-3def-474c-9c89-be2ad6552e4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:42:36.317793 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.317646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4q7x\" (UniqueName: \"kubernetes.io/projected/5164b77e-3def-474c-9c89-be2ad6552e4b-kube-api-access-z4q7x\") pod \"payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg\" (UID: \"5164b77e-3def-474c-9c89-be2ad6552e4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:42:36.318596 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.318566    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5164b77e-3def-474c-9c89-be2ad6552e4b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg\" (UID: \"5164b77e-3def-474c-9c89-be2ad6552e4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:42:36.326804 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.326784    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4q7x\" (UniqueName: \"kubernetes.io/projected/5164b77e-3def-474c-9c89-be2ad6552e4b-kube-api-access-z4q7x\") pod \"payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg\" (UID: \"5164b77e-3def-474c-9c89-be2ad6552e4b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:42:36.502683 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.502585    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:42:36.786763 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.786737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"]
Sep 19 09:42:36.788687 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:42:36.788657    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5164b77e_3def_474c_9c89_be2ad6552e4b.slice/crio-970422ca580885bb3d6a52c0adea4525c495237a2a3b428f826f97bd6bf49e6a WatchSource:0}: Error finding container 970422ca580885bb3d6a52c0adea4525c495237a2a3b428f826f97bd6bf49e6a: Status 404 returned error can't find the container with id 970422ca580885bb3d6a52c0adea4525c495237a2a3b428f826f97bd6bf49e6a
Sep 19 09:42:36.877157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.877121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg" event={"ID":"5164b77e-3def-474c-9c89-be2ad6552e4b","Type":"ContainerStarted","Data":"d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124"}
Sep 19 09:42:36.877327 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.877175    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg" event={"ID":"5164b77e-3def-474c-9c89-be2ad6552e4b","Type":"ContainerStarted","Data":"970422ca580885bb3d6a52c0adea4525c495237a2a3b428f826f97bd6bf49e6a"}
Sep 19 09:42:36.877327 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.877251    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:42:36.899189 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:36.899121    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg" podStartSLOduration=0.899102602 podStartE2EDuration="899.102602ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:42:36.896506236 +0000 UTC m=+2140.063701468" watchObservedRunningTime="2026-09-19 09:42:36.899102602 +0000 UTC m=+2140.066297831"
Sep 19 09:42:47.885052 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:47.885001    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:42:50.968603 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:50.968568    2579 generic.go:356] "Generic (PLEG): container finished" podID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerID="07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda" exitCode=0
Sep 19 09:42:50.969124 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:50.968648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" event={"ID":"264dd078-edd5-43da-9bbe-fb4668b1458f","Type":"ContainerDied","Data":"07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda"}
Sep 19 09:42:50.969192 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:50.969174    2579 scope.go:117] "RemoveContainer" containerID="07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda"
Sep 19 09:42:50.970236 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:50.970208    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:42:50.970321 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:50.970277    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:42:50.970321 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:50.970309    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 09:42:51.977087 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:51.977050    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" event={"ID":"264dd078-edd5-43da-9bbe-fb4668b1458f","Type":"ContainerStarted","Data":"0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e"}
Sep 19 09:42:52.281956 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:52.281859    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:52.282168 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:52.282115    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 19 09:42:52.282245 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:52.282162    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 19 09:42:53.281625 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:53.281597    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 19 09:42:53.282004 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:53.281648    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 19 09:42:54.281427 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:54.281396    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 19 09:42:54.281595 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:54.281449    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 19 09:42:55.282271 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:55.282233    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 19 09:42:55.282660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:55.282289    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 19 09:42:56.282369 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:56.282332    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 19 09:42:56.282812 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:56.282390    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 19 09:42:57.285367 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:57.285335    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:57.285833 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:57.285696    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:42:57.286391 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:42:57.286371    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:43:37.531190 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:43:37.531159    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-w2qx6_6b21d1b6-4a79-4a72-827b-242b01e840d1/payload-processing/0.log"
Sep 19 09:44:10.694922 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:10.694849    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg_5164b77e-3def-474c-9c89-be2ad6552e4b/payload-processing/0.log"
Sep 19 09:44:10.813540 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:10.813512    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-w2qx6_6b21d1b6-4a79-4a72-827b-242b01e840d1/payload-processing/0.log"
Sep 19 09:44:18.684075 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.684042    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"]
Sep 19 09:44:18.687776 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.687758    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:18.690171 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.690152    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-9f4a5b-dockercfg-6v7tw\""
Sep 19 09:44:18.690361 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.690339    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-9f4a5b\""
Sep 19 09:44:18.704101 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.704070    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"]
Sep 19 09:44:18.726106 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.726078    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"]
Sep 19 09:44:18.729790 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.729768    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:18.742559 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.742531    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"]
Sep 19 09:44:18.754236 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.754208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c655\" (UniqueName: \"kubernetes.io/projected/ac16e59c-2420-473c-b036-a4194fabfba8-kube-api-access-9c655\") pod \"payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw\" (UID: \"ac16e59c-2420-473c-b036-a4194fabfba8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:18.754378 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.754258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac16e59c-2420-473c-b036-a4194fabfba8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw\" (UID: \"ac16e59c-2420-473c-b036-a4194fabfba8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:18.754378 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.754330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqjb2\" (UniqueName: \"kubernetes.io/projected/24ea6547-7753-4d8d-b93c-bf1e1a59c767-kube-api-access-tqjb2\") pod \"payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf\" (UID: \"24ea6547-7753-4d8d-b93c-bf1e1a59c767\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:18.754378 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.754356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24ea6547-7753-4d8d-b93c-bf1e1a59c767-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf\" (UID: \"24ea6547-7753-4d8d-b93c-bf1e1a59c767\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:18.855679 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.855644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqjb2\" (UniqueName: \"kubernetes.io/projected/24ea6547-7753-4d8d-b93c-bf1e1a59c767-kube-api-access-tqjb2\") pod \"payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf\" (UID: \"24ea6547-7753-4d8d-b93c-bf1e1a59c767\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:18.855679 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.855682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24ea6547-7753-4d8d-b93c-bf1e1a59c767-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf\" (UID: \"24ea6547-7753-4d8d-b93c-bf1e1a59c767\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:18.856081 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.855734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c655\" (UniqueName: \"kubernetes.io/projected/ac16e59c-2420-473c-b036-a4194fabfba8-kube-api-access-9c655\") pod \"payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw\" (UID: \"ac16e59c-2420-473c-b036-a4194fabfba8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:18.856081 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.855769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac16e59c-2420-473c-b036-a4194fabfba8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw\" (UID: \"ac16e59c-2420-473c-b036-a4194fabfba8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:18.856538 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.856519    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24ea6547-7753-4d8d-b93c-bf1e1a59c767-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf\" (UID: \"24ea6547-7753-4d8d-b93c-bf1e1a59c767\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:18.856585 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.856546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac16e59c-2420-473c-b036-a4194fabfba8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw\" (UID: \"ac16e59c-2420-473c-b036-a4194fabfba8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:18.863616 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.863586    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqjb2\" (UniqueName: \"kubernetes.io/projected/24ea6547-7753-4d8d-b93c-bf1e1a59c767-kube-api-access-tqjb2\") pod \"payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf\" (UID: \"24ea6547-7753-4d8d-b93c-bf1e1a59c767\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:18.863782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.863762    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c655\" (UniqueName: \"kubernetes.io/projected/ac16e59c-2420-473c-b036-a4194fabfba8-kube-api-access-9c655\") pod \"payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw\" (UID: \"ac16e59c-2420-473c-b036-a4194fabfba8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:18.998131 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:18.998047    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:19.039510 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:19.039476    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:19.275209 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:19.275186    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"]
Sep 19 09:44:19.277582 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:44:19.277551    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac16e59c_2420_473c_b036_a4194fabfba8.slice/crio-6a29f61ffa71f68b606d30c47d5b542a03715c439000cb373348aaa1e4bec697 WatchSource:0}: Error finding container 6a29f61ffa71f68b606d30c47d5b542a03715c439000cb373348aaa1e4bec697: Status 404 returned error can't find the container with id 6a29f61ffa71f68b606d30c47d5b542a03715c439000cb373348aaa1e4bec697
Sep 19 09:44:19.331860 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:19.331840    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"]
Sep 19 09:44:19.333676 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:44:19.333649    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ea6547_7753_4d8d_b93c_bf1e1a59c767.slice/crio-12e6fc0fab50cbe362aec8a5eb106ac69498ea915359408f7bbc85f4c65d901e WatchSource:0}: Error finding container 12e6fc0fab50cbe362aec8a5eb106ac69498ea915359408f7bbc85f4c65d901e: Status 404 returned error can't find the container with id 12e6fc0fab50cbe362aec8a5eb106ac69498ea915359408f7bbc85f4c65d901e
Sep 19 09:44:19.462723 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:19.462679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf" event={"ID":"24ea6547-7753-4d8d-b93c-bf1e1a59c767","Type":"ContainerStarted","Data":"54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113"}
Sep 19 09:44:19.462914 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:19.462744    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:19.462914 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:19.462767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf" event={"ID":"24ea6547-7753-4d8d-b93c-bf1e1a59c767","Type":"ContainerStarted","Data":"12e6fc0fab50cbe362aec8a5eb106ac69498ea915359408f7bbc85f4c65d901e"}
Sep 19 09:44:19.464153 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:19.464125    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw" event={"ID":"ac16e59c-2420-473c-b036-a4194fabfba8","Type":"ContainerStarted","Data":"d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566"}
Sep 19 09:44:19.464279 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:19.464167    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw" event={"ID":"ac16e59c-2420-473c-b036-a4194fabfba8","Type":"ContainerStarted","Data":"6a29f61ffa71f68b606d30c47d5b542a03715c439000cb373348aaa1e4bec697"}
Sep 19 09:44:19.464279 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:19.464193    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:19.478147 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:19.478100    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf" podStartSLOduration=1.478085592 podStartE2EDuration="1.478085592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:44:19.477663088 +0000 UTC m=+2242.644858319" watchObservedRunningTime="2026-09-19 09:44:19.478085592 +0000 UTC m=+2242.645280821"
Sep 19 09:44:19.495855 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:19.495811    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw" podStartSLOduration=1.495798746 podStartE2EDuration="1.495798746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:44:19.494122471 +0000 UTC m=+2242.661317702" watchObservedRunningTime="2026-09-19 09:44:19.495798746 +0000 UTC m=+2242.662993972"
Sep 19 09:44:30.472580 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:30.472549    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:30.473057 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:30.472619    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:45.269793 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:45.269753    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"]
Sep 19 09:44:45.273248 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:45.273231    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"
Sep 19 09:44:45.275382 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:45.275364    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:44:45.275460 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:45.275372    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:44:45.280316 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:45.280277    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"]
Sep 19 09:44:45.329932 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:45.329899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5689508-f643-436f-82af-9750cc6a9650-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4\" (UID: \"c5689508-f643-436f-82af-9750cc6a9650\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"
Sep 19 09:44:45.430744 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:45.430706    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5689508-f643-436f-82af-9750cc6a9650-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4\" (UID: \"c5689508-f643-436f-82af-9750cc6a9650\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"
Sep 19 09:44:45.431345 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:45.431328    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5689508-f643-436f-82af-9750cc6a9650-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4\" (UID: \"c5689508-f643-436f-82af-9750cc6a9650\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"
Sep 19 09:44:45.585951 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:45.585905    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"
Sep 19 09:44:45.857633 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:45.857606    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"]
Sep 19 09:44:45.859248 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:44:45.859226    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5689508_f643_436f_82af_9750cc6a9650.slice/crio-72eda73c75854082bd15fec2ba4aa8ce3cd9649d52251cb957e54c53d2b2c32f WatchSource:0}: Error finding container 72eda73c75854082bd15fec2ba4aa8ce3cd9649d52251cb957e54c53d2b2c32f: Status 404 returned error can't find the container with id 72eda73c75854082bd15fec2ba4aa8ce3cd9649d52251cb957e54c53d2b2c32f
Sep 19 09:44:46.619927 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:46.619889    2579 generic.go:356] "Generic (PLEG): container finished" podID="c5689508-f643-436f-82af-9750cc6a9650" containerID="b70e9f6c9445fe5af75170e0534c134fc442e7b06da2c7318af686dca5d1e6c5" exitCode=0
Sep 19 09:44:46.620316 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:46.619946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4" event={"ID":"c5689508-f643-436f-82af-9750cc6a9650","Type":"ContainerDied","Data":"b70e9f6c9445fe5af75170e0534c134fc442e7b06da2c7318af686dca5d1e6c5"}
Sep 19 09:44:46.620316 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:46.620000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4" event={"ID":"c5689508-f643-436f-82af-9750cc6a9650","Type":"ContainerStarted","Data":"72eda73c75854082bd15fec2ba4aa8ce3cd9649d52251cb957e54c53d2b2c32f"}
Sep 19 09:44:47.761104 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:47.761080    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"
Sep 19 09:44:47.856334 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:47.856295    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5689508-f643-436f-82af-9750cc6a9650-maas-api-service-ca\") pod \"c5689508-f643-436f-82af-9750cc6a9650\" (UID: \"c5689508-f643-436f-82af-9750cc6a9650\") "
Sep 19 09:44:47.856704 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:47.856680    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5689508-f643-436f-82af-9750cc6a9650-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c5689508-f643-436f-82af-9750cc6a9650" (UID: "c5689508-f643-436f-82af-9750cc6a9650"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:44:47.957777 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:47.957692    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5689508-f643-436f-82af-9750cc6a9650-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:44:48.637409 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:48.637381    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"
Sep 19 09:44:48.637615 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:48.637408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4" event={"ID":"c5689508-f643-436f-82af-9750cc6a9650","Type":"ContainerDied","Data":"72eda73c75854082bd15fec2ba4aa8ce3cd9649d52251cb957e54c53d2b2c32f"}
Sep 19 09:44:48.637615 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:48.637475    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72eda73c75854082bd15fec2ba4aa8ce3cd9649d52251cb957e54c53d2b2c32f"
Sep 19 09:44:56.657170 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:56.657128    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"]
Sep 19 09:44:56.657555 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:56.657407    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf" podUID="24ea6547-7753-4d8d-b93c-bf1e1a59c767" containerName="payload-processing" containerID="cri-o://54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113" gracePeriod=30
Sep 19 09:44:56.663728 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:56.663700    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"]
Sep 19 09:44:56.663980 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:56.663953    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw" podUID="ac16e59c-2420-473c-b036-a4194fabfba8" containerName="payload-pre-processing" containerID="cri-o://d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566" gracePeriod=30
Sep 19 09:44:56.829653 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:56.829614    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"]
Sep 19 09:44:56.833812 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:56.833322    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9f4a5b-cppn4"]
Sep 19 09:44:56.904360 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:56.904320    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5689508-f643-436f-82af-9750cc6a9650" path="/var/lib/kubelet/pods/c5689508-f643-436f-82af-9750cc6a9650/volumes"
Sep 19 09:44:56.949675 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:56.949653    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:56.952574 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:56.952554    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:57.048899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.048866    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c655\" (UniqueName: \"kubernetes.io/projected/ac16e59c-2420-473c-b036-a4194fabfba8-kube-api-access-9c655\") pod \"ac16e59c-2420-473c-b036-a4194fabfba8\" (UID: \"ac16e59c-2420-473c-b036-a4194fabfba8\") "
Sep 19 09:44:57.049093 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.048914    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac16e59c-2420-473c-b036-a4194fabfba8-plugins-config-volume\") pod \"ac16e59c-2420-473c-b036-a4194fabfba8\" (UID: \"ac16e59c-2420-473c-b036-a4194fabfba8\") "
Sep 19 09:44:57.049093 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.048931    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqjb2\" (UniqueName: \"kubernetes.io/projected/24ea6547-7753-4d8d-b93c-bf1e1a59c767-kube-api-access-tqjb2\") pod \"24ea6547-7753-4d8d-b93c-bf1e1a59c767\" (UID: \"24ea6547-7753-4d8d-b93c-bf1e1a59c767\") "
Sep 19 09:44:57.049195 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.049097    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24ea6547-7753-4d8d-b93c-bf1e1a59c767-plugins-config-volume\") pod \"24ea6547-7753-4d8d-b93c-bf1e1a59c767\" (UID: \"24ea6547-7753-4d8d-b93c-bf1e1a59c767\") "
Sep 19 09:44:57.049275 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.049244    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac16e59c-2420-473c-b036-a4194fabfba8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac16e59c-2420-473c-b036-a4194fabfba8" (UID: "ac16e59c-2420-473c-b036-a4194fabfba8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:44:57.049438 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.049420    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac16e59c-2420-473c-b036-a4194fabfba8-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:44:57.049541 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.049483    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ea6547-7753-4d8d-b93c-bf1e1a59c767-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "24ea6547-7753-4d8d-b93c-bf1e1a59c767" (UID: "24ea6547-7753-4d8d-b93c-bf1e1a59c767"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:44:57.051144 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.051123    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ea6547-7753-4d8d-b93c-bf1e1a59c767-kube-api-access-tqjb2" (OuterVolumeSpecName: "kube-api-access-tqjb2") pod "24ea6547-7753-4d8d-b93c-bf1e1a59c767" (UID: "24ea6547-7753-4d8d-b93c-bf1e1a59c767"). InnerVolumeSpecName "kube-api-access-tqjb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:44:57.051260 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.051241    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac16e59c-2420-473c-b036-a4194fabfba8-kube-api-access-9c655" (OuterVolumeSpecName: "kube-api-access-9c655") pod "ac16e59c-2420-473c-b036-a4194fabfba8" (UID: "ac16e59c-2420-473c-b036-a4194fabfba8"). InnerVolumeSpecName "kube-api-access-9c655". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:44:57.150461 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.150427    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24ea6547-7753-4d8d-b93c-bf1e1a59c767-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:44:57.150461 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.150456    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c655\" (UniqueName: \"kubernetes.io/projected/ac16e59c-2420-473c-b036-a4194fabfba8-kube-api-access-9c655\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:44:57.150461 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.150465    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqjb2\" (UniqueName: \"kubernetes.io/projected/24ea6547-7753-4d8d-b93c-bf1e1a59c767-kube-api-access-tqjb2\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:44:57.692223 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.692186    2579 generic.go:356] "Generic (PLEG): container finished" podID="24ea6547-7753-4d8d-b93c-bf1e1a59c767" containerID="54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113" exitCode=0
Sep 19 09:44:57.692688 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.692235    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"
Sep 19 09:44:57.692688 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.692269    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf" event={"ID":"24ea6547-7753-4d8d-b93c-bf1e1a59c767","Type":"ContainerDied","Data":"54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113"}
Sep 19 09:44:57.692688 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.692342    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf" event={"ID":"24ea6547-7753-4d8d-b93c-bf1e1a59c767","Type":"ContainerDied","Data":"12e6fc0fab50cbe362aec8a5eb106ac69498ea915359408f7bbc85f4c65d901e"}
Sep 19 09:44:57.692688 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.692376    2579 scope.go:117] "RemoveContainer" containerID="54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113"
Sep 19 09:44:57.693775 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.693754    2579 generic.go:356] "Generic (PLEG): container finished" podID="ac16e59c-2420-473c-b036-a4194fabfba8" containerID="d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566" exitCode=0
Sep 19 09:44:57.693853 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.693787    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw" event={"ID":"ac16e59c-2420-473c-b036-a4194fabfba8","Type":"ContainerDied","Data":"d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566"}
Sep 19 09:44:57.693853 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.693802    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"
Sep 19 09:44:57.693853 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.693835    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw" event={"ID":"ac16e59c-2420-473c-b036-a4194fabfba8","Type":"ContainerDied","Data":"6a29f61ffa71f68b606d30c47d5b542a03715c439000cb373348aaa1e4bec697"}
Sep 19 09:44:57.703275 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.703252    2579 scope.go:117] "RemoveContainer" containerID="54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113"
Sep 19 09:44:57.703600 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:44:57.703578    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113\": container with ID starting with 54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113 not found: ID does not exist" containerID="54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113"
Sep 19 09:44:57.703690 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.703606    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113"} err="failed to get container status \"54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113\": rpc error: code = NotFound desc = could not find container \"54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113\": container with ID starting with 54fed8affbb3392b295bbcb204d418da727719a9636ae0fd73180b9aae253113 not found: ID does not exist"
Sep 19 09:44:57.703690 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.703629    2579 scope.go:117] "RemoveContainer" containerID="d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566"
Sep 19 09:44:57.711979 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.711955    2579 scope.go:117] "RemoveContainer" containerID="d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566"
Sep 19 09:44:57.712263 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:44:57.712242    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566\": container with ID starting with d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566 not found: ID does not exist" containerID="d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566"
Sep 19 09:44:57.712336 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.712272    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566"} err="failed to get container status \"d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566\": rpc error: code = NotFound desc = could not find container \"d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566\": container with ID starting with d078d0009b8386390bcb73d9519c690fe1331df2c565210d3c04ad9bd8e06566 not found: ID does not exist"
Sep 19 09:44:57.718943 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.718920    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"]
Sep 19 09:44:57.726339 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.726318    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9f4a5b-795ccd6bc8-cgsbw"]
Sep 19 09:44:57.744180 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.744156    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"]
Sep 19 09:44:57.748910 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:57.748886    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9f4a5b-6b4d5b7fdf-hqzcf"]
Sep 19 09:44:58.903720 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:58.903687    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24ea6547-7753-4d8d-b93c-bf1e1a59c767" path="/var/lib/kubelet/pods/24ea6547-7753-4d8d-b93c-bf1e1a59c767/volumes"
Sep 19 09:44:58.904085 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:58.904059    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac16e59c-2420-473c-b036-a4194fabfba8" path="/var/lib/kubelet/pods/ac16e59c-2420-473c-b036-a4194fabfba8/volumes"
Sep 19 09:44:59.322781 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:59.322751    2579 scope.go:117] "RemoveContainer" containerID="e08ab92ec74783a97ea9216718e8298a26a13ed8e9b00b829578e85f0ee0da45"
Sep 19 09:44:59.331082 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:44:59.331061    2579 scope.go:117] "RemoveContainer" containerID="70dd8091c9c6345c8900e02f22b5446d76bdb2fe55b47db1d3c92e94aa80aa88"
Sep 19 09:45:00.137002 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.136965    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830185-qk6hk"]
Sep 19 09:45:00.137455 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.137440    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac16e59c-2420-473c-b036-a4194fabfba8" containerName="payload-pre-processing"
Sep 19 09:45:00.137498 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.137456    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac16e59c-2420-473c-b036-a4194fabfba8" containerName="payload-pre-processing"
Sep 19 09:45:00.137498 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.137465    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ea6547-7753-4d8d-b93c-bf1e1a59c767" containerName="payload-processing"
Sep 19 09:45:00.137498 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.137471    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ea6547-7753-4d8d-b93c-bf1e1a59c767" containerName="payload-processing"
Sep 19 09:45:00.137498 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.137479    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5689508-f643-436f-82af-9750cc6a9650" containerName="revoke-keys"
Sep 19 09:45:00.137498 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.137484    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5689508-f643-436f-82af-9750cc6a9650" containerName="revoke-keys"
Sep 19 09:45:00.137643 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.137548    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac16e59c-2420-473c-b036-a4194fabfba8" containerName="payload-pre-processing"
Sep 19 09:45:00.137643 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.137557    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5689508-f643-436f-82af-9750cc6a9650" containerName="revoke-keys"
Sep 19 09:45:00.137643 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.137564    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ea6547-7753-4d8d-b93c-bf1e1a59c767" containerName="payload-processing"
Sep 19 09:45:00.142316 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.142297    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830185-qk6hk"
Sep 19 09:45:00.144749 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.144727    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:45:00.146173 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.146149    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd"]
Sep 19 09:45:00.150325 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.150166    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx"]
Sep 19 09:45:00.150325 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.150282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd"
Sep 19 09:45:00.153797 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.153777    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830185-qk6hk"
Sep 19 09:45:00.153918 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.153892    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830185-qk6hk"]
Sep 19 09:45:00.154001 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.153989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx"
Sep 19 09:45:00.157968 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.157875    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd"]
Sep 19 09:45:00.167722 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.167697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd"
Sep 19 09:45:00.168942 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.168883    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx"]
Sep 19 09:45:00.216784 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.216758    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx"
Sep 19 09:45:00.442486 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.442408    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830185-qk6hk"]
Sep 19 09:45:00.444806 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:45:00.444781    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88cb9074_1566_4157_b96c_368e3dd2af3a.slice/crio-7ab268c8bbec26bb1172c821423c343774e3e10e665defb6d4c9fcdd8c75c06c WatchSource:0}: Error finding container 7ab268c8bbec26bb1172c821423c343774e3e10e665defb6d4c9fcdd8c75c06c: Status 404 returned error can't find the container with id 7ab268c8bbec26bb1172c821423c343774e3e10e665defb6d4c9fcdd8c75c06c
Sep 19 09:45:00.473829 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.473784    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd"]
Sep 19 09:45:00.476272 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:45:00.476248    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf15ee64_3b3b_4998_a43e_3711ae713bd4.slice/crio-1c033d61624779814344083d8e4d5fbc26bcca4c05e326217eb55d9dbe8e21cf WatchSource:0}: Error finding container 1c033d61624779814344083d8e4d5fbc26bcca4c05e326217eb55d9dbe8e21cf: Status 404 returned error can't find the container with id 1c033d61624779814344083d8e4d5fbc26bcca4c05e326217eb55d9dbe8e21cf
Sep 19 09:45:00.521962 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.521934    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx"]
Sep 19 09:45:00.523069 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:45:00.523047    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa848111_91b7_446b_966f_7c55cab876da.slice/crio-6074c1024ecb89cff5fb966ef76808931ebd29bd727bc9410d2ad67dd25070d9 WatchSource:0}: Error finding container 6074c1024ecb89cff5fb966ef76808931ebd29bd727bc9410d2ad67dd25070d9: Status 404 returned error can't find the container with id 6074c1024ecb89cff5fb966ef76808931ebd29bd727bc9410d2ad67dd25070d9
Sep 19 09:45:00.721389 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.721358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx" event={"ID":"aa848111-91b7-446b-966f-7c55cab876da","Type":"ContainerStarted","Data":"6074c1024ecb89cff5fb966ef76808931ebd29bd727bc9410d2ad67dd25070d9"}
Sep 19 09:45:00.722782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.722751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd" event={"ID":"cf15ee64-3b3b-4998-a43e-3711ae713bd4","Type":"ContainerStarted","Data":"1c033d61624779814344083d8e4d5fbc26bcca4c05e326217eb55d9dbe8e21cf"}
Sep 19 09:45:00.724062 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:00.724041    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830185-qk6hk" event={"ID":"88cb9074-1566-4157-b96c-368e3dd2af3a","Type":"ContainerStarted","Data":"7ab268c8bbec26bb1172c821423c343774e3e10e665defb6d4c9fcdd8c75c06c"}
Sep 19 09:45:01.731318 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:01.731286    2579 generic.go:356] "Generic (PLEG): container finished" podID="aa848111-91b7-446b-966f-7c55cab876da" containerID="56a0b0a28bfbcec05a9bf4958cb01645409337debbaf6759c3f7e776f4b65ccc" exitCode=0
Sep 19 09:45:01.731766 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:01.731399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx" event={"ID":"aa848111-91b7-446b-966f-7c55cab876da","Type":"ContainerDied","Data":"56a0b0a28bfbcec05a9bf4958cb01645409337debbaf6759c3f7e776f4b65ccc"}
Sep 19 09:45:01.732858 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:01.732833    2579 generic.go:356] "Generic (PLEG): container finished" podID="cf15ee64-3b3b-4998-a43e-3711ae713bd4" containerID="e74d7427cd9807029dc842024589e267a9d5f5a86753c810a7544e0cf504eee7" exitCode=0
Sep 19 09:45:01.732954 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:01.732908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd" event={"ID":"cf15ee64-3b3b-4998-a43e-3711ae713bd4","Type":"ContainerDied","Data":"e74d7427cd9807029dc842024589e267a9d5f5a86753c810a7544e0cf504eee7"}
Sep 19 09:45:01.744614 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:01.742966    2579 generic.go:356] "Generic (PLEG): container finished" podID="88cb9074-1566-4157-b96c-368e3dd2af3a" containerID="4ca41b810239197f48f601e303c77225540da2a69bd066293a02b3f4c67801f0" exitCode=0
Sep 19 09:45:01.744614 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:01.743169    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830185-qk6hk" event={"ID":"88cb9074-1566-4157-b96c-368e3dd2af3a","Type":"ContainerDied","Data":"4ca41b810239197f48f601e303c77225540da2a69bd066293a02b3f4c67801f0"}
Sep 19 09:45:02.906290 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:02.906258    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd"
Sep 19 09:45:02.947912 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:02.947889    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx"
Sep 19 09:45:02.951866 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:02.951845    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830185-qk6hk"
Sep 19 09:45:03.756288 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:03.756260    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx"
Sep 19 09:45:03.756288 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:03.756268    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx" event={"ID":"aa848111-91b7-446b-966f-7c55cab876da","Type":"ContainerDied","Data":"6074c1024ecb89cff5fb966ef76808931ebd29bd727bc9410d2ad67dd25070d9"}
Sep 19 09:45:03.756566 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:03.756326    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6074c1024ecb89cff5fb966ef76808931ebd29bd727bc9410d2ad67dd25070d9"
Sep 19 09:45:03.757923 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:03.757897    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd" event={"ID":"cf15ee64-3b3b-4998-a43e-3711ae713bd4","Type":"ContainerDied","Data":"1c033d61624779814344083d8e4d5fbc26bcca4c05e326217eb55d9dbe8e21cf"}
Sep 19 09:45:03.758062 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:03.757941    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c033d61624779814344083d8e4d5fbc26bcca4c05e326217eb55d9dbe8e21cf"
Sep 19 09:45:03.758062 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:03.757906    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd"
Sep 19 09:45:03.759492 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:03.759475    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830185-qk6hk"
Sep 19 09:45:03.759583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:03.759494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830185-qk6hk" event={"ID":"88cb9074-1566-4157-b96c-368e3dd2af3a","Type":"ContainerDied","Data":"7ab268c8bbec26bb1172c821423c343774e3e10e665defb6d4c9fcdd8c75c06c"}
Sep 19 09:45:03.759583 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:03.759530    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ab268c8bbec26bb1172c821423c343774e3e10e665defb6d4c9fcdd8c75c06c"
Sep 19 09:45:07.227006 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.226843    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"]
Sep 19 09:45:07.227487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.227349    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa848111-91b7-446b-966f-7c55cab876da" containerName="cleanup"
Sep 19 09:45:07.227487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.227363    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa848111-91b7-446b-966f-7c55cab876da" containerName="cleanup"
Sep 19 09:45:07.227487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.227374    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf15ee64-3b3b-4998-a43e-3711ae713bd4" containerName="cleanup"
Sep 19 09:45:07.227487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.227379    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf15ee64-3b3b-4998-a43e-3711ae713bd4" containerName="cleanup"
Sep 19 09:45:07.227487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.227388    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88cb9074-1566-4157-b96c-368e3dd2af3a" containerName="cleanup"
Sep 19 09:45:07.227487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.227394    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="88cb9074-1566-4157-b96c-368e3dd2af3a" containerName="cleanup"
Sep 19 09:45:07.227487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.227463    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="88cb9074-1566-4157-b96c-368e3dd2af3a" containerName="cleanup"
Sep 19 09:45:07.227487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.227474    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf15ee64-3b3b-4998-a43e-3711ae713bd4" containerName="cleanup"
Sep 19 09:45:07.227487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.227488    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa848111-91b7-446b-966f-7c55cab876da" containerName="cleanup"
Sep 19 09:45:07.230540 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.230522    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"
Sep 19 09:45:07.233142 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.233121    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:45:07.233256 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.233173    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:45:07.238852 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.238537    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"]
Sep 19 09:45:07.351684 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.351651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ceba2328-50de-4eba-bc85-f809fa0f0c8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4\" (UID: \"ceba2328-50de-4eba-bc85-f809fa0f0c8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"
Sep 19 09:45:07.453097 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.453066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ceba2328-50de-4eba-bc85-f809fa0f0c8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4\" (UID: \"ceba2328-50de-4eba-bc85-f809fa0f0c8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"
Sep 19 09:45:07.453706 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.453624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ceba2328-50de-4eba-bc85-f809fa0f0c8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4\" (UID: \"ceba2328-50de-4eba-bc85-f809fa0f0c8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"
Sep 19 09:45:07.543050 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.543001    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"
Sep 19 09:45:07.815217 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:07.815191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"]
Sep 19 09:45:07.817011 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:45:07.816984    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceba2328_50de_4eba_bc85_f809fa0f0c8e.slice/crio-3cf14b6bcf61e50410eb4a8a644fff7911b368766eae1a2b6539431f3a8f6ab4 WatchSource:0}: Error finding container 3cf14b6bcf61e50410eb4a8a644fff7911b368766eae1a2b6539431f3a8f6ab4: Status 404 returned error can't find the container with id 3cf14b6bcf61e50410eb4a8a644fff7911b368766eae1a2b6539431f3a8f6ab4
Sep 19 09:45:08.789757 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:08.789730    2579 generic.go:356] "Generic (PLEG): container finished" podID="ceba2328-50de-4eba-bc85-f809fa0f0c8e" containerID="a0d283ea1b9cc0bf7f6bc3c31cbffb92cc4caefb44433d22fe5c1502871bf72f" exitCode=0
Sep 19 09:45:08.790169 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:08.789814    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4" event={"ID":"ceba2328-50de-4eba-bc85-f809fa0f0c8e","Type":"ContainerDied","Data":"a0d283ea1b9cc0bf7f6bc3c31cbffb92cc4caefb44433d22fe5c1502871bf72f"}
Sep 19 09:45:08.790169 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:08.789880    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4" event={"ID":"ceba2328-50de-4eba-bc85-f809fa0f0c8e","Type":"ContainerStarted","Data":"3cf14b6bcf61e50410eb4a8a644fff7911b368766eae1a2b6539431f3a8f6ab4"}
Sep 19 09:45:09.935790 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:09.935763    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"
Sep 19 09:45:10.081258 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:10.081167    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ceba2328-50de-4eba-bc85-f809fa0f0c8e-maas-api-service-ca\") pod \"ceba2328-50de-4eba-bc85-f809fa0f0c8e\" (UID: \"ceba2328-50de-4eba-bc85-f809fa0f0c8e\") "
Sep 19 09:45:10.081570 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:10.081550    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ceba2328-50de-4eba-bc85-f809fa0f0c8e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ceba2328-50de-4eba-bc85-f809fa0f0c8e" (UID: "ceba2328-50de-4eba-bc85-f809fa0f0c8e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:45:10.182264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:10.182232    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ceba2328-50de-4eba-bc85-f809fa0f0c8e-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:45:10.802468 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:10.802437    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"
Sep 19 09:45:10.802468 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:10.802461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4" event={"ID":"ceba2328-50de-4eba-bc85-f809fa0f0c8e","Type":"ContainerDied","Data":"3cf14b6bcf61e50410eb4a8a644fff7911b368766eae1a2b6539431f3a8f6ab4"}
Sep 19 09:45:10.802723 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:10.802529    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cf14b6bcf61e50410eb4a8a644fff7911b368766eae1a2b6539431f3a8f6ab4"
Sep 19 09:45:22.997558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:22.997518    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"]
Sep 19 09:45:22.998004 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:22.997758    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg" podUID="5164b77e-3def-474c-9c89-be2ad6552e4b" containerName="payload-processing" containerID="cri-o://d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124" gracePeriod=30
Sep 19 09:45:23.197284 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.197247    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"]
Sep 19 09:45:23.201576 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.201552    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6fd1a9-nsrj4"]
Sep 19 09:45:23.253947 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.253891    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:45:23.314753 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.314719    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5164b77e-3def-474c-9c89-be2ad6552e4b-plugins-config-volume\") pod \"5164b77e-3def-474c-9c89-be2ad6552e4b\" (UID: \"5164b77e-3def-474c-9c89-be2ad6552e4b\") "
Sep 19 09:45:23.314949 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.314914    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4q7x\" (UniqueName: \"kubernetes.io/projected/5164b77e-3def-474c-9c89-be2ad6552e4b-kube-api-access-z4q7x\") pod \"5164b77e-3def-474c-9c89-be2ad6552e4b\" (UID: \"5164b77e-3def-474c-9c89-be2ad6552e4b\") "
Sep 19 09:45:23.315253 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.315227    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5164b77e-3def-474c-9c89-be2ad6552e4b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5164b77e-3def-474c-9c89-be2ad6552e4b" (UID: "5164b77e-3def-474c-9c89-be2ad6552e4b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:45:23.317569 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.317533    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5164b77e-3def-474c-9c89-be2ad6552e4b-kube-api-access-z4q7x" (OuterVolumeSpecName: "kube-api-access-z4q7x") pod "5164b77e-3def-474c-9c89-be2ad6552e4b" (UID: "5164b77e-3def-474c-9c89-be2ad6552e4b"). InnerVolumeSpecName "kube-api-access-z4q7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:45:23.416346 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.416299    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4q7x\" (UniqueName: \"kubernetes.io/projected/5164b77e-3def-474c-9c89-be2ad6552e4b-kube-api-access-z4q7x\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:45:23.416346 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.416341    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5164b77e-3def-474c-9c89-be2ad6552e4b-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:45:23.875784 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.875748    2579 generic.go:356] "Generic (PLEG): container finished" podID="5164b77e-3def-474c-9c89-be2ad6552e4b" containerID="d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124" exitCode=0
Sep 19 09:45:23.875946 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.875798    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"
Sep 19 09:45:23.875946 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.875835    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg" event={"ID":"5164b77e-3def-474c-9c89-be2ad6552e4b","Type":"ContainerDied","Data":"d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124"}
Sep 19 09:45:23.875946 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.875892    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg" event={"ID":"5164b77e-3def-474c-9c89-be2ad6552e4b","Type":"ContainerDied","Data":"970422ca580885bb3d6a52c0adea4525c495237a2a3b428f826f97bd6bf49e6a"}
Sep 19 09:45:23.875946 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.875914    2579 scope.go:117] "RemoveContainer" containerID="d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124"
Sep 19 09:45:23.889514 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.889493    2579 scope.go:117] "RemoveContainer" containerID="d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124"
Sep 19 09:45:23.889831 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:45:23.889805    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124\": container with ID starting with d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124 not found: ID does not exist" containerID="d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124"
Sep 19 09:45:23.889886 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.889843    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124"} err="failed to get container status \"d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124\": rpc error: code = NotFound desc = could not find container \"d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124\": container with ID starting with d25b2c4f25e657d2833568e5a25fb9bcd07b34d8bf7ec18feaec1838fbade124 not found: ID does not exist"
Sep 19 09:45:23.920558 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.920531    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"]
Sep 19 09:45:23.939174 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:23.939151    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6fd1a9-6bcdf8ff-dmnqg"]
Sep 19 09:45:24.904469 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:24.904436    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5164b77e-3def-474c-9c89-be2ad6552e4b" path="/var/lib/kubelet/pods/5164b77e-3def-474c-9c89-be2ad6552e4b/volumes"
Sep 19 09:45:24.904841 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:24.904755    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ceba2328-50de-4eba-bc85-f809fa0f0c8e" path="/var/lib/kubelet/pods/ceba2328-50de-4eba-bc85-f809fa0f0c8e/volumes"
Sep 19 09:45:59.363038 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:59.362981    2579 scope.go:117] "RemoveContainer" containerID="a28b1e5926be8df2fa6c18579cd804cb7317787b02b72eca7fc468a3b33a8fe6"
Sep 19 09:45:59.371940 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:59.371922    2579 scope.go:117] "RemoveContainer" containerID="df792789f0f97eabe0b3b129f833ed479e54c2ee4d17718b44c91ccc430a00aa"
Sep 19 09:45:59.379843 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:45:59.379823    2579 scope.go:117] "RemoveContainer" containerID="ad0356bb3e900c8342fa9d334582f689e1bf50d98f8d9a70c36986a2e527363c"
Sep 19 09:46:26.781215 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:26.781181    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"]
Sep 19 09:46:26.781677 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:26.781416    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy" containerID="cri-o://0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e" gracePeriod=30
Sep 19 09:46:27.147224 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.147191    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"]
Sep 19 09:46:27.147652 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.147632    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5164b77e-3def-474c-9c89-be2ad6552e4b" containerName="payload-processing"
Sep 19 09:46:27.147725 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.147667    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5164b77e-3def-474c-9c89-be2ad6552e4b" containerName="payload-processing"
Sep 19 09:46:27.147725 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.147683    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceba2328-50de-4eba-bc85-f809fa0f0c8e" containerName="revoke-keys"
Sep 19 09:46:27.147725 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.147689    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceba2328-50de-4eba-bc85-f809fa0f0c8e" containerName="revoke-keys"
Sep 19 09:46:27.147820 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.147769    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceba2328-50de-4eba-bc85-f809fa0f0c8e" containerName="revoke-keys"
Sep 19 09:46:27.147820 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.147777    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5164b77e-3def-474c-9c89-be2ad6552e4b" containerName="payload-processing"
Sep 19 09:46:27.151102 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.151084    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"
Sep 19 09:46:27.153300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.153277    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:46:27.153414 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.153277    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:46:27.157442 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.157417    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"]
Sep 19 09:46:27.251754 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.251724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51a2bb2a-7bca-44bc-b8d5-42e052f10430-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m\" (UID: \"51a2bb2a-7bca-44bc-b8d5-42e052f10430\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"
Sep 19 09:46:27.287664 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.287635    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 09:46:27.287817 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.287688    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 09:46:27.352896 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.352863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51a2bb2a-7bca-44bc-b8d5-42e052f10430-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m\" (UID: \"51a2bb2a-7bca-44bc-b8d5-42e052f10430\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"
Sep 19 09:46:27.353457 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.353438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51a2bb2a-7bca-44bc-b8d5-42e052f10430-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m\" (UID: \"51a2bb2a-7bca-44bc-b8d5-42e052f10430\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"
Sep 19 09:46:27.462181 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.462101    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"
Sep 19 09:46:27.733489 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:27.733465    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"]
Sep 19 09:46:27.735501 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:46:27.735470    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a2bb2a_7bca_44bc_b8d5_42e052f10430.slice/crio-816bd48d54f6ff20ece4a9ada8877e253dd8cbe2bb2f0762c5e7a87ea9aa9dad WatchSource:0}: Error finding container 816bd48d54f6ff20ece4a9ada8877e253dd8cbe2bb2f0762c5e7a87ea9aa9dad: Status 404 returned error can't find the container with id 816bd48d54f6ff20ece4a9ada8877e253dd8cbe2bb2f0762c5e7a87ea9aa9dad
Sep 19 09:46:28.231957 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:28.231917    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m" event={"ID":"51a2bb2a-7bca-44bc-b8d5-42e052f10430","Type":"ContainerStarted","Data":"74340419d296037109b79f14e2d201f497785be22091fff36463c86176203927"}
Sep 19 09:46:28.232452 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:28.231974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m" event={"ID":"51a2bb2a-7bca-44bc-b8d5-42e052f10430","Type":"ContainerStarted","Data":"816bd48d54f6ff20ece4a9ada8877e253dd8cbe2bb2f0762c5e7a87ea9aa9dad"}
Sep 19 09:46:28.249339 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:28.249283    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m" podStartSLOduration=1.249269121 podStartE2EDuration="1.249269121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:46:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:46:28.247902474 +0000 UTC m=+2371.415097707" watchObservedRunningTime="2026-09-19 09:46:28.249269121 +0000 UTC m=+2371.416464350"
Sep 19 09:46:29.239432 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:29.239398    2579 generic.go:356] "Generic (PLEG): container finished" podID="51a2bb2a-7bca-44bc-b8d5-42e052f10430" containerID="74340419d296037109b79f14e2d201f497785be22091fff36463c86176203927" exitCode=0
Sep 19 09:46:29.239823 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:29.239487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m" event={"ID":"51a2bb2a-7bca-44bc-b8d5-42e052f10430","Type":"ContainerDied","Data":"74340419d296037109b79f14e2d201f497785be22091fff36463c86176203927"}
Sep 19 09:46:30.378036 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:30.377986    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"
Sep 19 09:46:30.486850 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:30.486813    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51a2bb2a-7bca-44bc-b8d5-42e052f10430-maas-api-service-ca\") pod \"51a2bb2a-7bca-44bc-b8d5-42e052f10430\" (UID: \"51a2bb2a-7bca-44bc-b8d5-42e052f10430\") "
Sep 19 09:46:30.487179 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:30.487156    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a2bb2a-7bca-44bc-b8d5-42e052f10430-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "51a2bb2a-7bca-44bc-b8d5-42e052f10430" (UID: "51a2bb2a-7bca-44bc-b8d5-42e052f10430"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:46:30.588009 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:30.587975    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51a2bb2a-7bca-44bc-b8d5-42e052f10430-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:31.251899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:31.251807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m" event={"ID":"51a2bb2a-7bca-44bc-b8d5-42e052f10430","Type":"ContainerDied","Data":"816bd48d54f6ff20ece4a9ada8877e253dd8cbe2bb2f0762c5e7a87ea9aa9dad"}
Sep 19 09:46:31.251899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:31.251860    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="816bd48d54f6ff20ece4a9ada8877e253dd8cbe2bb2f0762c5e7a87ea9aa9dad"
Sep 19 09:46:31.251899 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:31.251825    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"
Sep 19 09:46:32.043999 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.043937    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:46:32.103260 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103228    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-envoy\") pod \"264dd078-edd5-43da-9bbe-fb4668b1458f\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") "
Sep 19 09:46:32.103436 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103266    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/264dd078-edd5-43da-9bbe-fb4668b1458f-istiod-ca-cert\") pod \"264dd078-edd5-43da-9bbe-fb4668b1458f\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") "
Sep 19 09:46:32.103436 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103301    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-socket\") pod \"264dd078-edd5-43da-9bbe-fb4668b1458f\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") "
Sep 19 09:46:32.103436 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103349    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-data\") pod \"264dd078-edd5-43da-9bbe-fb4668b1458f\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") "
Sep 19 09:46:32.103436 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103390    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-token\") pod \"264dd078-edd5-43da-9bbe-fb4668b1458f\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") "
Sep 19 09:46:32.103630 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103449    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-credential-socket\") pod \"264dd078-edd5-43da-9bbe-fb4668b1458f\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") "
Sep 19 09:46:32.103630 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103488    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wprd\" (UniqueName: \"kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-kube-api-access-5wprd\") pod \"264dd078-edd5-43da-9bbe-fb4668b1458f\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") "
Sep 19 09:46:32.103630 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103616    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-podinfo\") pod \"264dd078-edd5-43da-9bbe-fb4668b1458f\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") "
Sep 19 09:46:32.103760 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103632    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "264dd078-edd5-43da-9bbe-fb4668b1458f" (UID: "264dd078-edd5-43da-9bbe-fb4668b1458f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:46:32.103760 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103649    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-data" (OuterVolumeSpecName: "istio-data") pod "264dd078-edd5-43da-9bbe-fb4668b1458f" (UID: "264dd078-edd5-43da-9bbe-fb4668b1458f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:46:32.103760 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103664    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-certs\") pod \"264dd078-edd5-43da-9bbe-fb4668b1458f\" (UID: \"264dd078-edd5-43da-9bbe-fb4668b1458f\") "
Sep 19 09:46:32.103760 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103697    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/264dd078-edd5-43da-9bbe-fb4668b1458f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "264dd078-edd5-43da-9bbe-fb4668b1458f" (UID: "264dd078-edd5-43da-9bbe-fb4668b1458f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:46:32.103968 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103877    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "264dd078-edd5-43da-9bbe-fb4668b1458f" (UID: "264dd078-edd5-43da-9bbe-fb4668b1458f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:46:32.104055 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.103965    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "264dd078-edd5-43da-9bbe-fb4668b1458f" (UID: "264dd078-edd5-43da-9bbe-fb4668b1458f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:46:32.104127 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.104110    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/264dd078-edd5-43da-9bbe-fb4668b1458f-istiod-ca-cert\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:32.104185 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.104128    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-socket\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:32.104185 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.104138    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-data\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:32.104185 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.104146    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-credential-socket\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:32.104185 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.104153    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-workload-certs\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:32.105799 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.105774    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-token" (OuterVolumeSpecName: "istio-token") pod "264dd078-edd5-43da-9bbe-fb4668b1458f" (UID: "264dd078-edd5-43da-9bbe-fb4668b1458f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:46:32.105799 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.105783    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "264dd078-edd5-43da-9bbe-fb4668b1458f" (UID: "264dd078-edd5-43da-9bbe-fb4668b1458f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 09:46:32.106151 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.106133    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-kube-api-access-5wprd" (OuterVolumeSpecName: "kube-api-access-5wprd") pod "264dd078-edd5-43da-9bbe-fb4668b1458f" (UID: "264dd078-edd5-43da-9bbe-fb4668b1458f"). InnerVolumeSpecName "kube-api-access-5wprd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:46:32.106151 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.106136    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "264dd078-edd5-43da-9bbe-fb4668b1458f" (UID: "264dd078-edd5-43da-9bbe-fb4668b1458f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 09:46:32.205416 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.205385    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wprd\" (UniqueName: \"kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-kube-api-access-5wprd\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:32.205416 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.205411    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-podinfo\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:32.205416 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.205422    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-envoy\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:32.205644 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.205429    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/264dd078-edd5-43da-9bbe-fb4668b1458f-istio-token\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:32.258488 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.258451    2579 generic.go:356] "Generic (PLEG): container finished" podID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerID="0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e" exitCode=0
Sep 19 09:46:32.258635 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.258500    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"
Sep 19 09:46:32.258635 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.258537    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" event={"ID":"264dd078-edd5-43da-9bbe-fb4668b1458f","Type":"ContainerDied","Data":"0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e"}
Sep 19 09:46:32.258635 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.258595    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6" event={"ID":"264dd078-edd5-43da-9bbe-fb4668b1458f","Type":"ContainerDied","Data":"dfd8bdb4538032d2163ea1a8b118a191b1f34dbd4a378ed15e5faf72cd1e80bd"}
Sep 19 09:46:32.258635 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.258618    2579 scope.go:117] "RemoveContainer" containerID="0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e"
Sep 19 09:46:32.268318 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.268296    2579 scope.go:117] "RemoveContainer" containerID="07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda"
Sep 19 09:46:32.279684 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.279513    2579 scope.go:117] "RemoveContainer" containerID="0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e"
Sep 19 09:46:32.279921 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:46:32.279879    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e\": container with ID starting with 0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e not found: ID does not exist" containerID="0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e"
Sep 19 09:46:32.280067 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.279919    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e"} err="failed to get container status \"0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e\": rpc error: code = NotFound desc = could not find container \"0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e\": container with ID starting with 0841fa5cd3a45d7430358c1f4c264f625397273565e7cd0be8a8f9829308a56e not found: ID does not exist"
Sep 19 09:46:32.280067 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.279944    2579 scope.go:117] "RemoveContainer" containerID="07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda"
Sep 19 09:46:32.280320 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:46:32.280294    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda\": container with ID starting with 07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda not found: ID does not exist" containerID="07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda"
Sep 19 09:46:32.280391 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.280324    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda"} err="failed to get container status \"07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda\": rpc error: code = NotFound desc = could not find container \"07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda\": container with ID starting with 07172c7f73fe99616e482a45b8071e814810e09d8d4b2d5a2e211c6150663fda not found: ID does not exist"
Sep 19 09:46:32.282274 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.282247    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"]
Sep 19 09:46:32.288425 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.288403    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-6fd1a9-openshift-default-8b5856f48-k9zb6"]
Sep 19 09:46:32.904264 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:32.904230    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" path="/var/lib/kubelet/pods/264dd078-edd5-43da-9bbe-fb4668b1458f/volumes"
Sep 19 09:46:37.618790 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:37.618754    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx"]
Sep 19 09:46:37.625359 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:37.625331    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e10409-29830185-927lx"]
Sep 19 09:46:37.825187 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:37.825154    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"]
Sep 19 09:46:37.826957 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:37.826933    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e10409-rxz2m"]
Sep 19 09:46:38.904637 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:38.904592    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a2bb2a-7bca-44bc-b8d5-42e052f10430" path="/var/lib/kubelet/pods/51a2bb2a-7bca-44bc-b8d5-42e052f10430/volumes"
Sep 19 09:46:38.905137 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:38.905123    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa848111-91b7-446b-966f-7c55cab876da" path="/var/lib/kubelet/pods/aa848111-91b7-446b-966f-7c55cab876da/volumes"
Sep 19 09:46:44.775482 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.775448    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"]
Sep 19 09:46:44.775871 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.775858    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a2bb2a-7bca-44bc-b8d5-42e052f10430" containerName="revoke-keys"
Sep 19 09:46:44.775925 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.775873    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a2bb2a-7bca-44bc-b8d5-42e052f10430" containerName="revoke-keys"
Sep 19 09:46:44.775925 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.775889    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy"
Sep 19 09:46:44.775925 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.775894    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy"
Sep 19 09:46:44.775925 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.775902    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy"
Sep 19 09:46:44.775925 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.775908    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy"
Sep 19 09:46:44.776116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.775980    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy"
Sep 19 09:46:44.776116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.775993    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="264dd078-edd5-43da-9bbe-fb4668b1458f" containerName="istio-proxy"
Sep 19 09:46:44.776116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.776000    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a2bb2a-7bca-44bc-b8d5-42e052f10430" containerName="revoke-keys"
Sep 19 09:46:44.780702 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.780685    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"
Sep 19 09:46:44.783967 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.783948    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:46:44.784066 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.783966    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:46:44.797895 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.797866    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"]
Sep 19 09:46:44.931751 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:44.931720    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d915bb-7fa1-422c-b218-22d58a8e6941-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2\" (UID: \"c5d915bb-7fa1-422c-b218-22d58a8e6941\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"
Sep 19 09:46:45.033099 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:45.032969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d915bb-7fa1-422c-b218-22d58a8e6941-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2\" (UID: \"c5d915bb-7fa1-422c-b218-22d58a8e6941\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"
Sep 19 09:46:45.033573 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:45.033549    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d915bb-7fa1-422c-b218-22d58a8e6941-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2\" (UID: \"c5d915bb-7fa1-422c-b218-22d58a8e6941\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"
Sep 19 09:46:45.090054 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:45.089997    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"
Sep 19 09:46:45.366772 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:45.366746    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"]
Sep 19 09:46:45.368716 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:46:45.368693    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d915bb_7fa1_422c_b218_22d58a8e6941.slice/crio-411baf90ce296d33c2f5f5d540767deed6915dbacd99a44021cf4a9a7444a000 WatchSource:0}: Error finding container 411baf90ce296d33c2f5f5d540767deed6915dbacd99a44021cf4a9a7444a000: Status 404 returned error can't find the container with id 411baf90ce296d33c2f5f5d540767deed6915dbacd99a44021cf4a9a7444a000
Sep 19 09:46:46.341235 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:46.341197    2579 generic.go:356] "Generic (PLEG): container finished" podID="c5d915bb-7fa1-422c-b218-22d58a8e6941" containerID="842d84c965d68cdc0c2d75b68f4fd9adeb65fb0d7089860910b0fba3daa68fbb" exitCode=0
Sep 19 09:46:46.341612 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:46.341290    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2" event={"ID":"c5d915bb-7fa1-422c-b218-22d58a8e6941","Type":"ContainerDied","Data":"842d84c965d68cdc0c2d75b68f4fd9adeb65fb0d7089860910b0fba3daa68fbb"}
Sep 19 09:46:46.341612 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:46.341343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2" event={"ID":"c5d915bb-7fa1-422c-b218-22d58a8e6941","Type":"ContainerStarted","Data":"411baf90ce296d33c2f5f5d540767deed6915dbacd99a44021cf4a9a7444a000"}
Sep 19 09:46:47.481972 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:47.481941    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"
Sep 19 09:46:47.557099 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:47.557070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d915bb-7fa1-422c-b218-22d58a8e6941-maas-api-service-ca\") pod \"c5d915bb-7fa1-422c-b218-22d58a8e6941\" (UID: \"c5d915bb-7fa1-422c-b218-22d58a8e6941\") "
Sep 19 09:46:47.557412 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:47.557391    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d915bb-7fa1-422c-b218-22d58a8e6941-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c5d915bb-7fa1-422c-b218-22d58a8e6941" (UID: "c5d915bb-7fa1-422c-b218-22d58a8e6941"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:46:47.658304 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:47.658218    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d915bb-7fa1-422c-b218-22d58a8e6941-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:48.353157 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:48.353130    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"
Sep 19 09:46:48.353326 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:48.353169    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2" event={"ID":"c5d915bb-7fa1-422c-b218-22d58a8e6941","Type":"ContainerDied","Data":"411baf90ce296d33c2f5f5d540767deed6915dbacd99a44021cf4a9a7444a000"}
Sep 19 09:46:48.353326 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:48.353213    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="411baf90ce296d33c2f5f5d540767deed6915dbacd99a44021cf4a9a7444a000"
Sep 19 09:46:55.313798 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.313767    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd"]
Sep 19 09:46:55.316885 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.316862    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3240ec-29830185-cvksd"]
Sep 19 09:46:55.345082 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.345047    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"]
Sep 19 09:46:55.345434 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.345311    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5" podUID="e72cffba-35a3-49b0-8329-c9d8f654f06a" containerName="payload-processing" containerID="cri-o://406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f" gracePeriod=30
Sep 19 09:46:55.350147 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.350119    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"]
Sep 19 09:46:55.350481 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.350434    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87" podUID="8fd357c9-2755-400e-99f0-7656442ed2e6" containerName="payload-pre-processing" containerID="cri-o://d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1" gracePeriod=30
Sep 19 09:46:55.524485 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.524454    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"]
Sep 19 09:46:55.527732 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.527708    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3240ec-trqm2"]
Sep 19 09:46:55.604942 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.604905    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:46:55.631431 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.631405    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:46:55.751633 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.751600    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2vjn\" (UniqueName: \"kubernetes.io/projected/e72cffba-35a3-49b0-8329-c9d8f654f06a-kube-api-access-r2vjn\") pod \"e72cffba-35a3-49b0-8329-c9d8f654f06a\" (UID: \"e72cffba-35a3-49b0-8329-c9d8f654f06a\") "
Sep 19 09:46:55.751782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.751664    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd357c9-2755-400e-99f0-7656442ed2e6-plugins-config-volume\") pod \"8fd357c9-2755-400e-99f0-7656442ed2e6\" (UID: \"8fd357c9-2755-400e-99f0-7656442ed2e6\") "
Sep 19 09:46:55.751782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.751713    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e72cffba-35a3-49b0-8329-c9d8f654f06a-plugins-config-volume\") pod \"e72cffba-35a3-49b0-8329-c9d8f654f06a\" (UID: \"e72cffba-35a3-49b0-8329-c9d8f654f06a\") "
Sep 19 09:46:55.751782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.751742    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjs58\" (UniqueName: \"kubernetes.io/projected/8fd357c9-2755-400e-99f0-7656442ed2e6-kube-api-access-tjs58\") pod \"8fd357c9-2755-400e-99f0-7656442ed2e6\" (UID: \"8fd357c9-2755-400e-99f0-7656442ed2e6\") "
Sep 19 09:46:55.752082 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.752060    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e72cffba-35a3-49b0-8329-c9d8f654f06a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e72cffba-35a3-49b0-8329-c9d8f654f06a" (UID: "e72cffba-35a3-49b0-8329-c9d8f654f06a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:46:55.752137 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.752094    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fd357c9-2755-400e-99f0-7656442ed2e6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8fd357c9-2755-400e-99f0-7656442ed2e6" (UID: "8fd357c9-2755-400e-99f0-7656442ed2e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:46:55.753958 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.753935    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e72cffba-35a3-49b0-8329-c9d8f654f06a-kube-api-access-r2vjn" (OuterVolumeSpecName: "kube-api-access-r2vjn") pod "e72cffba-35a3-49b0-8329-c9d8f654f06a" (UID: "e72cffba-35a3-49b0-8329-c9d8f654f06a"). InnerVolumeSpecName "kube-api-access-r2vjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:46:55.753958 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.753947    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fd357c9-2755-400e-99f0-7656442ed2e6-kube-api-access-tjs58" (OuterVolumeSpecName: "kube-api-access-tjs58") pod "8fd357c9-2755-400e-99f0-7656442ed2e6" (UID: "8fd357c9-2755-400e-99f0-7656442ed2e6"). InnerVolumeSpecName "kube-api-access-tjs58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:46:55.852699 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.852622    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2vjn\" (UniqueName: \"kubernetes.io/projected/e72cffba-35a3-49b0-8329-c9d8f654f06a-kube-api-access-r2vjn\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:55.852699 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.852649    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd357c9-2755-400e-99f0-7656442ed2e6-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:55.852699 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.852658    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e72cffba-35a3-49b0-8329-c9d8f654f06a-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:55.852699 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:55.852667    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjs58\" (UniqueName: \"kubernetes.io/projected/8fd357c9-2755-400e-99f0-7656442ed2e6-kube-api-access-tjs58\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:46:56.398401 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.398366    2579 generic.go:356] "Generic (PLEG): container finished" podID="e72cffba-35a3-49b0-8329-c9d8f654f06a" containerID="406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f" exitCode=0
Sep 19 09:46:56.398856 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.398414    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"
Sep 19 09:46:56.398856 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.398464    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5" event={"ID":"e72cffba-35a3-49b0-8329-c9d8f654f06a","Type":"ContainerDied","Data":"406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f"}
Sep 19 09:46:56.398856 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.398569    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5" event={"ID":"e72cffba-35a3-49b0-8329-c9d8f654f06a","Type":"ContainerDied","Data":"a22c50f9596ff9e7f34a14faa7818755383e459ade310ff312faba31408d7fcf"}
Sep 19 09:46:56.398856 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.398605    2579 scope.go:117] "RemoveContainer" containerID="406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f"
Sep 19 09:46:56.399985 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.399915    2579 generic.go:356] "Generic (PLEG): container finished" podID="8fd357c9-2755-400e-99f0-7656442ed2e6" containerID="d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1" exitCode=0
Sep 19 09:46:56.399985 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.399951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87" event={"ID":"8fd357c9-2755-400e-99f0-7656442ed2e6","Type":"ContainerDied","Data":"d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1"}
Sep 19 09:46:56.400142 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.400009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87" event={"ID":"8fd357c9-2755-400e-99f0-7656442ed2e6","Type":"ContainerDied","Data":"f6b34456f25d806c82522860695ce4ec9a50a7a2d19f5fa747be27e2dab7fc31"}
Sep 19 09:46:56.400142 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.399960    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"
Sep 19 09:46:56.408637 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.408618    2579 scope.go:117] "RemoveContainer" containerID="406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f"
Sep 19 09:46:56.408960 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:46:56.408941    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f\": container with ID starting with 406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f not found: ID does not exist" containerID="406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f"
Sep 19 09:46:56.409008 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.408967    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f"} err="failed to get container status \"406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f\": rpc error: code = NotFound desc = could not find container \"406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f\": container with ID starting with 406fcdf258d11c55b0b07579bf7a8bd645f43bb6ed90e2629b3eb8bc3c52af5f not found: ID does not exist"
Sep 19 09:46:56.409008 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.408982    2579 scope.go:117] "RemoveContainer" containerID="d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1"
Sep 19 09:46:56.417464 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.417445    2579 scope.go:117] "RemoveContainer" containerID="d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1"
Sep 19 09:46:56.417721 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:46:56.417701    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1\": container with ID starting with d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1 not found: ID does not exist" containerID="d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1"
Sep 19 09:46:56.417776 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.417727    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1"} err="failed to get container status \"d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1\": rpc error: code = NotFound desc = could not find container \"d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1\": container with ID starting with d8d08d5f54f8f1ee63d271e48f987d3cac84b344dbe20a9c77dff4f69e8999f1 not found: ID does not exist"
Sep 19 09:46:56.426231 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.426209    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"]
Sep 19 09:46:56.428096 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.428074    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3240ec-6fd67cdfdb-7cs87"]
Sep 19 09:46:56.440396 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.440374    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"]
Sep 19 09:46:56.452487 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.452466    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3240ec-67477b7c49-d9lq5"]
Sep 19 09:46:56.903420 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.903390    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fd357c9-2755-400e-99f0-7656442ed2e6" path="/var/lib/kubelet/pods/8fd357c9-2755-400e-99f0-7656442ed2e6/volumes"
Sep 19 09:46:56.903773 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.903760    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5d915bb-7fa1-422c-b218-22d58a8e6941" path="/var/lib/kubelet/pods/c5d915bb-7fa1-422c-b218-22d58a8e6941/volumes"
Sep 19 09:46:56.904042 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.904028    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf15ee64-3b3b-4998-a43e-3711ae713bd4" path="/var/lib/kubelet/pods/cf15ee64-3b3b-4998-a43e-3711ae713bd4/volumes"
Sep 19 09:46:56.904355 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:56.904341    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e72cffba-35a3-49b0-8329-c9d8f654f06a" path="/var/lib/kubelet/pods/e72cffba-35a3-49b0-8329-c9d8f654f06a/volumes"
Sep 19 09:46:59.067702 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:59.067678    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:46:59.069457 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:46:59.069435    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:47:02.842489 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.842455    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"]
Sep 19 09:47:02.849133 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.849087    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e72cffba-35a3-49b0-8329-c9d8f654f06a" containerName="payload-processing"
Sep 19 09:47:02.849314 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.849215    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e72cffba-35a3-49b0-8329-c9d8f654f06a" containerName="payload-processing"
Sep 19 09:47:02.849314 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.849241    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd357c9-2755-400e-99f0-7656442ed2e6" containerName="payload-pre-processing"
Sep 19 09:47:02.849314 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.849250    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd357c9-2755-400e-99f0-7656442ed2e6" containerName="payload-pre-processing"
Sep 19 09:47:02.849314 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.849284    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d915bb-7fa1-422c-b218-22d58a8e6941" containerName="revoke-keys"
Sep 19 09:47:02.849314 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.849291    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d915bb-7fa1-422c-b218-22d58a8e6941" containerName="revoke-keys"
Sep 19 09:47:02.849553 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.849531    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d915bb-7fa1-422c-b218-22d58a8e6941" containerName="revoke-keys"
Sep 19 09:47:02.849607 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.849553    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e72cffba-35a3-49b0-8329-c9d8f654f06a" containerName="payload-processing"
Sep 19 09:47:02.849607 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.849565    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fd357c9-2755-400e-99f0-7656442ed2e6" containerName="payload-pre-processing"
Sep 19 09:47:02.854090 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.854066    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"]
Sep 19 09:47:02.854212 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.854174    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"
Sep 19 09:47:02.856782 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.856755    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 09:47:02.856906 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.856852    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7qlc\""
Sep 19 09:47:02.912493 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:02.912462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fcdaf2-72d9-460f-8f27-a7a94b349b68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn\" (UID: \"19fcdaf2-72d9-460f-8f27-a7a94b349b68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"
Sep 19 09:47:03.013297 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:03.013251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fcdaf2-72d9-460f-8f27-a7a94b349b68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn\" (UID: \"19fcdaf2-72d9-460f-8f27-a7a94b349b68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"
Sep 19 09:47:03.013850 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:03.013828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fcdaf2-72d9-460f-8f27-a7a94b349b68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn\" (UID: \"19fcdaf2-72d9-460f-8f27-a7a94b349b68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"
Sep 19 09:47:03.165963 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:03.165862    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"
Sep 19 09:47:03.442900 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:03.442877    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"]
Sep 19 09:47:03.444820 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:47:03.444795    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fcdaf2_72d9_460f_8f27_a7a94b349b68.slice/crio-2e9c5faa2a0e8293d6177a9debdc44f392005264ca9c4ed9e695cdd7a81c7a3f WatchSource:0}: Error finding container 2e9c5faa2a0e8293d6177a9debdc44f392005264ca9c4ed9e695cdd7a81c7a3f: Status 404 returned error can't find the container with id 2e9c5faa2a0e8293d6177a9debdc44f392005264ca9c4ed9e695cdd7a81c7a3f
Sep 19 09:47:04.445549 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:04.445514    2579 generic.go:356] "Generic (PLEG): container finished" podID="19fcdaf2-72d9-460f-8f27-a7a94b349b68" containerID="f8186aa0748074282b699fdeefd8d14e5c8238c03aa11dfe75fec856c938df3d" exitCode=0
Sep 19 09:47:04.445923 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:04.445594    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn" event={"ID":"19fcdaf2-72d9-460f-8f27-a7a94b349b68","Type":"ContainerDied","Data":"f8186aa0748074282b699fdeefd8d14e5c8238c03aa11dfe75fec856c938df3d"}
Sep 19 09:47:04.445923 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:04.445650    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn" event={"ID":"19fcdaf2-72d9-460f-8f27-a7a94b349b68","Type":"ContainerStarted","Data":"2e9c5faa2a0e8293d6177a9debdc44f392005264ca9c4ed9e695cdd7a81c7a3f"}
Sep 19 09:47:05.582941 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:05.582921    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"
Sep 19 09:47:05.637352 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:05.637317    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fcdaf2-72d9-460f-8f27-a7a94b349b68-maas-api-service-ca\") pod \"19fcdaf2-72d9-460f-8f27-a7a94b349b68\" (UID: \"19fcdaf2-72d9-460f-8f27-a7a94b349b68\") "
Sep 19 09:47:05.637713 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:05.637687    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19fcdaf2-72d9-460f-8f27-a7a94b349b68-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "19fcdaf2-72d9-460f-8f27-a7a94b349b68" (UID: "19fcdaf2-72d9-460f-8f27-a7a94b349b68"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:47:05.738949 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:05.738863    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fcdaf2-72d9-460f-8f27-a7a94b349b68-maas-api-service-ca\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:47:06.460855 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:06.460821    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"
Sep 19 09:47:06.461078 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:06.460820    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn" event={"ID":"19fcdaf2-72d9-460f-8f27-a7a94b349b68","Type":"ContainerDied","Data":"2e9c5faa2a0e8293d6177a9debdc44f392005264ca9c4ed9e695cdd7a81c7a3f"}
Sep 19 09:47:06.461078 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:06.460956    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e9c5faa2a0e8293d6177a9debdc44f392005264ca9c4ed9e695cdd7a81c7a3f"
Sep 19 09:47:13.466116 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:13.466005    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"]
Sep 19 09:47:13.466566 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:13.466267    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc" podUID="1d2ac7fb-b554-49f5-bad8-940496af8ab4" containerName="payload-processing" containerID="cri-o://5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8" gracePeriod=30
Sep 19 09:47:13.656468 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:13.656431    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"]
Sep 19 09:47:13.659161 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:13.659124    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1afa13-rpvdn"]
Sep 19 09:47:13.725281 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:13.725222    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:47:13.816397 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:13.816363    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krlh6\" (UniqueName: \"kubernetes.io/projected/1d2ac7fb-b554-49f5-bad8-940496af8ab4-kube-api-access-krlh6\") pod \"1d2ac7fb-b554-49f5-bad8-940496af8ab4\" (UID: \"1d2ac7fb-b554-49f5-bad8-940496af8ab4\") "
Sep 19 09:47:13.816565 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:13.816471    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d2ac7fb-b554-49f5-bad8-940496af8ab4-plugins-config-volume\") pod \"1d2ac7fb-b554-49f5-bad8-940496af8ab4\" (UID: \"1d2ac7fb-b554-49f5-bad8-940496af8ab4\") "
Sep 19 09:47:13.816850 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:13.816824    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2ac7fb-b554-49f5-bad8-940496af8ab4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d2ac7fb-b554-49f5-bad8-940496af8ab4" (UID: "1d2ac7fb-b554-49f5-bad8-940496af8ab4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 09:47:13.818612 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:13.818588    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d2ac7fb-b554-49f5-bad8-940496af8ab4-kube-api-access-krlh6" (OuterVolumeSpecName: "kube-api-access-krlh6") pod "1d2ac7fb-b554-49f5-bad8-940496af8ab4" (UID: "1d2ac7fb-b554-49f5-bad8-940496af8ab4"). InnerVolumeSpecName "kube-api-access-krlh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 09:47:13.918152 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:13.918117    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krlh6\" (UniqueName: \"kubernetes.io/projected/1d2ac7fb-b554-49f5-bad8-940496af8ab4-kube-api-access-krlh6\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:47:13.918152 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:13.918143    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d2ac7fb-b554-49f5-bad8-940496af8ab4-plugins-config-volume\") on node \"ip-10-0-141-190.ec2.internal\" DevicePath \"\""
Sep 19 09:47:14.506132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:14.506097    2579 generic.go:356] "Generic (PLEG): container finished" podID="1d2ac7fb-b554-49f5-bad8-940496af8ab4" containerID="5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8" exitCode=0
Sep 19 09:47:14.506132 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:14.506136    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc" event={"ID":"1d2ac7fb-b554-49f5-bad8-940496af8ab4","Type":"ContainerDied","Data":"5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8"}
Sep 19 09:47:14.506581 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:14.506158    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"
Sep 19 09:47:14.506581 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:14.506202    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc" event={"ID":"1d2ac7fb-b554-49f5-bad8-940496af8ab4","Type":"ContainerDied","Data":"f63e123ed67b5ba8cc78e0d5c266674aa5089aa48faad56f3027e9c85a41e866"}
Sep 19 09:47:14.506581 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:14.506224    2579 scope.go:117] "RemoveContainer" containerID="5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8"
Sep 19 09:47:14.515212 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:14.515195    2579 scope.go:117] "RemoveContainer" containerID="5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8"
Sep 19 09:47:14.515487 ip-10-0-141-190 kubenswrapper[2579]: E0919 09:47:14.515468    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8\": container with ID starting with 5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8 not found: ID does not exist" containerID="5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8"
Sep 19 09:47:14.515537 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:14.515496    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8"} err="failed to get container status \"5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8\": rpc error: code = NotFound desc = could not find container \"5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8\": container with ID starting with 5697b0d2d3b81777572344d89a107e3ceb32c7c14d6fe17b7352dec81d7780b8 not found: ID does not exist"
Sep 19 09:47:14.528142 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:14.528091    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"]
Sep 19 09:47:14.531445 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:14.531403    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-1afa13-6c4c44cf79-gncrc"]
Sep 19 09:47:14.903825 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:14.903794    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19fcdaf2-72d9-460f-8f27-a7a94b349b68" path="/var/lib/kubelet/pods/19fcdaf2-72d9-460f-8f27-a7a94b349b68/volumes"
Sep 19 09:47:14.904173 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:47:14.904160    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d2ac7fb-b554-49f5-bad8-940496af8ab4" path="/var/lib/kubelet/pods/1d2ac7fb-b554-49f5-bad8-940496af8ab4/volumes"
Sep 19 09:50:59.467458 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:50:59.467426    2579 scope.go:117] "RemoveContainer" containerID="b70e9f6c9445fe5af75170e0534c134fc442e7b06da2c7318af686dca5d1e6c5"
Sep 19 09:51:59.102689 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:51:59.102657    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:51:59.103876 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:51:59.103858    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl6hn_03d6d2c6-8bc4-4757-aef3-99004ca362df/ovn-acl-logging/0.log"
Sep 19 09:51:59.490156 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:51:59.490071    2579 scope.go:117] "RemoveContainer" containerID="56a0b0a28bfbcec05a9bf4958cb01645409337debbaf6759c3f7e776f4b65ccc"
Sep 19 09:51:59.498242 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:51:59.498224    2579 scope.go:117] "RemoveContainer" containerID="a0d283ea1b9cc0bf7f6bc3c31cbffb92cc4caefb44433d22fe5c1502871bf72f"
Sep 19 09:51:59.506070 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:51:59.506046    2579 scope.go:117] "RemoveContainer" containerID="e74d7427cd9807029dc842024589e267a9d5f5a86753c810a7544e0cf504eee7"
Sep 19 09:52:59.535467 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:52:59.535362    2579 scope.go:117] "RemoveContainer" containerID="74340419d296037109b79f14e2d201f497785be22091fff36463c86176203927"
Sep 19 09:52:59.543664 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:52:59.543645    2579 scope.go:117] "RemoveContainer" containerID="842d84c965d68cdc0c2d75b68f4fd9adeb65fb0d7089860910b0fba3daa68fbb"
Sep 19 09:53:59.566258 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:53:59.566222    2579 scope.go:117] "RemoveContainer" containerID="f8186aa0748074282b699fdeefd8d14e5c8238c03aa11dfe75fec856c938df3d"
Sep 19 09:54:02.764126 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:02.764100    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-d4qgm_0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e/server/0.log"
Sep 19 09:54:02.880502 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:02.880474    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w28cp_8ad9cf84-5812-42ae-bfcf-1fc81183761e/manager/0.log"
Sep 19 09:54:02.990830 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:02.990808    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56479975c9-8zfz5_e357301b-2daf-48e0-b590-e4bb49b273dd/copy-manifests/0.log"
Sep 19 09:54:02.997535 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:02.997508    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56479975c9-8zfz5_e357301b-2daf-48e0-b590-e4bb49b273dd/manager/0.log"
Sep 19 09:54:03.786300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:03.786268    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29830170-sb8xf_db1b94b3-dd11-4828-952a-8856e080e2ab/cleanup/0.log"
Sep 19 09:54:03.892231 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:03.892195    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29830185-qk6hk_88cb9074-1566-4157-b96c-368e3dd2af3a/cleanup/0.log"
Sep 19 09:54:05.822598 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:05.822570    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg_75a5ec1f-78ee-4845-8243-6c0273c70e56/istio-proxy/0.log"
Sep 19 09:54:05.940618 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:05.940572    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8cfdp_9a11417a-8f88-49a5-8d2e-4e3df2a0763c/discovery/0.log"
Sep 19 09:54:06.270071 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:06.269955    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4fvmc_f9c91454-58cc-4999-8040-9e136429ef9a/istio-proxy/1.log"
Sep 19 09:54:06.379368 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:06.379340    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-mxqcf_dfbe6107-0ffa-4805-ab54-964f1afe2e64/payload-pre-processing/0.log"
Sep 19 09:54:06.490719 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:06.490691    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-w2qx6_6b21d1b6-4a79-4a72-827b-242b01e840d1/payload-processing/0.log"
Sep 19 09:54:07.057607 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:07.057580    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fsmbc_14ba9388-32ee-4f86-ba94-1c35b1740927/main/0.log"
Sep 19 09:54:07.388048 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:07.387949    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8tt55_9eda24c7-3c2d-45bc-a36b-ee584303f02b/main/0.log"
Sep 19 09:54:15.642735 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:15.642707    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zsz2b_680d6b24-fc31-40bd-942a-e1f3d3647be2/global-pull-secret-syncer/0.log"
Sep 19 09:54:15.848555 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:15.848526    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xqt5w_5799141e-22e4-471c-bba1-73f8782d6c46/konnectivity-agent/0.log"
Sep 19 09:54:15.912883 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:15.912800    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-190.ec2.internal_c80dc006f68abf1cd999156c6067d05e/haproxy/0.log"
Sep 19 09:54:22.007120 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.007086    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_83276d17-df85-475b-b372-1d1c3a51ae98/alertmanager/0.log"
Sep 19 09:54:22.062056 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.062034    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_83276d17-df85-475b-b372-1d1c3a51ae98/config-reloader/0.log"
Sep 19 09:54:22.089097 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.089078    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_83276d17-df85-475b-b372-1d1c3a51ae98/kube-rbac-proxy-web/0.log"
Sep 19 09:54:22.114466 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.114411    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_83276d17-df85-475b-b372-1d1c3a51ae98/kube-rbac-proxy/0.log"
Sep 19 09:54:22.137295 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.137274    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_83276d17-df85-475b-b372-1d1c3a51ae98/kube-rbac-proxy-metric/0.log"
Sep 19 09:54:22.161921 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.161898    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_83276d17-df85-475b-b372-1d1c3a51ae98/prom-label-proxy/0.log"
Sep 19 09:54:22.182870 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.182844    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_83276d17-df85-475b-b372-1d1c3a51ae98/init-config-reloader/0.log"
Sep 19 09:54:22.268745 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.268672    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tvl2b_3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3/kube-state-metrics/0.log"
Sep 19 09:54:22.286033 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.285992    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tvl2b_3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3/kube-rbac-proxy-main/0.log"
Sep 19 09:54:22.305841 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.305823    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tvl2b_3a0d9ee5-ae0c-4f21-a8cc-7acb844f32b3/kube-rbac-proxy-self/0.log"
Sep 19 09:54:22.332748 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.332728    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5c46bd4f-qr72n_7169c963-e65c-442f-8a6b-6b8828d784ea/metrics-server/0.log"
Sep 19 09:54:22.361673 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.361651    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-v49lk_0557957e-bee0-4a70-a2ba-a46c48493080/monitoring-plugin/0.log"
Sep 19 09:54:22.394627 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.394605    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qvmj_466b0243-1f61-4300-8b43-2f19fbc3f8be/node-exporter/0.log"
Sep 19 09:54:22.416767 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.416736    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qvmj_466b0243-1f61-4300-8b43-2f19fbc3f8be/kube-rbac-proxy/0.log"
Sep 19 09:54:22.442349 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.442326    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qvmj_466b0243-1f61-4300-8b43-2f19fbc3f8be/init-textfile/0.log"
Sep 19 09:54:22.630102 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.630078    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-c96z6_e47a1032-3ed2-4947-ab44-fa2738b3c65f/kube-rbac-proxy-main/0.log"
Sep 19 09:54:22.650085 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.650059    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-c96z6_e47a1032-3ed2-4947-ab44-fa2738b3c65f/kube-rbac-proxy-self/0.log"
Sep 19 09:54:22.671794 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.671777    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-c96z6_e47a1032-3ed2-4947-ab44-fa2738b3c65f/openshift-state-metrics/0.log"
Sep 19 09:54:22.734454 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.734429    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3d6c650-04b5-4457-a5f2-b61efed94647/prometheus/0.log"
Sep 19 09:54:22.760740 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.760690    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3d6c650-04b5-4457-a5f2-b61efed94647/config-reloader/0.log"
Sep 19 09:54:22.786538 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.786517    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3d6c650-04b5-4457-a5f2-b61efed94647/thanos-sidecar/0.log"
Sep 19 09:54:22.812409 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.812391    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3d6c650-04b5-4457-a5f2-b61efed94647/kube-rbac-proxy-web/0.log"
Sep 19 09:54:22.834166 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.834109    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3d6c650-04b5-4457-a5f2-b61efed94647/kube-rbac-proxy/0.log"
Sep 19 09:54:22.874966 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.874940    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3d6c650-04b5-4457-a5f2-b61efed94647/kube-rbac-proxy-thanos/0.log"
Sep 19 09:54:22.927850 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.927830    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3d6c650-04b5-4457-a5f2-b61efed94647/init-config-reloader/0.log"
Sep 19 09:54:22.989490 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:22.989458    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-r2w55_c432b742-a0fe-452a-918c-de06cfd479c2/prometheus-operator/0.log"
Sep 19 09:54:23.014311 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:23.014290    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-r2w55_c432b742-a0fe-452a-918c-de06cfd479c2/kube-rbac-proxy/0.log"
Sep 19 09:54:23.099101 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:23.099081    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b76778c4c-kvg7f_d820479e-9130-48e5-affd-1bbaf87efc72/telemeter-client/0.log"
Sep 19 09:54:23.138591 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:23.138568    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b76778c4c-kvg7f_d820479e-9130-48e5-affd-1bbaf87efc72/reload/0.log"
Sep 19 09:54:23.170994 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:23.170973    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b76778c4c-kvg7f_d820479e-9130-48e5-affd-1bbaf87efc72/kube-rbac-proxy/0.log"
Sep 19 09:54:23.223313 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:23.223286    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5475698868-8bl2n_c5516fa8-265c-4145-bf0e-72deb03cf7ac/thanos-query/0.log"
Sep 19 09:54:23.250903 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:23.250880    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5475698868-8bl2n_c5516fa8-265c-4145-bf0e-72deb03cf7ac/kube-rbac-proxy-web/0.log"
Sep 19 09:54:23.283284 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:23.283261    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5475698868-8bl2n_c5516fa8-265c-4145-bf0e-72deb03cf7ac/kube-rbac-proxy/0.log"
Sep 19 09:54:23.314297 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:23.314273    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5475698868-8bl2n_c5516fa8-265c-4145-bf0e-72deb03cf7ac/prom-label-proxy/0.log"
Sep 19 09:54:23.342592 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:23.342527    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5475698868-8bl2n_c5516fa8-265c-4145-bf0e-72deb03cf7ac/kube-rbac-proxy-rules/0.log"
Sep 19 09:54:23.366520 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:23.366503    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5475698868-8bl2n_c5516fa8-265c-4145-bf0e-72deb03cf7ac/kube-rbac-proxy-metrics/0.log"
Sep 19 09:54:25.904933 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.904903    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"]
Sep 19 09:54:25.905327 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.905302    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2ac7fb-b554-49f5-bad8-940496af8ab4" containerName="payload-processing"
Sep 19 09:54:25.905327 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.905313    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2ac7fb-b554-49f5-bad8-940496af8ab4" containerName="payload-processing"
Sep 19 09:54:25.905401 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.905337    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19fcdaf2-72d9-460f-8f27-a7a94b349b68" containerName="revoke-keys"
Sep 19 09:54:25.905401 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.905342    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="19fcdaf2-72d9-460f-8f27-a7a94b349b68" containerName="revoke-keys"
Sep 19 09:54:25.905401 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.905399    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="19fcdaf2-72d9-460f-8f27-a7a94b349b68" containerName="revoke-keys"
Sep 19 09:54:25.905490 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.905410    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d2ac7fb-b554-49f5-bad8-940496af8ab4" containerName="payload-processing"
Sep 19 09:54:25.909780 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.909760    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:25.912067 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.912045    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2bwqb\"/\"kube-root-ca.crt\""
Sep 19 09:54:25.912705 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.912685    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2bwqb\"/\"default-dockercfg-5g8bj\""
Sep 19 09:54:25.912831 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.912712    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2bwqb\"/\"openshift-service-ca.crt\""
Sep 19 09:54:25.922051 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.921997    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"]
Sep 19 09:54:25.978660 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.978615    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-proc\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:25.978859 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.978670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnmxh\" (UniqueName: \"kubernetes.io/projected/103422ee-3390-4e17-a630-6fbe5b6510bb-kube-api-access-vnmxh\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:25.978859 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.978730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-podres\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:25.978859 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.978763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-lib-modules\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:25.978859 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:25.978795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-sys\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.079366 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.079326    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-proc\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.079610 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.079382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmxh\" (UniqueName: \"kubernetes.io/projected/103422ee-3390-4e17-a630-6fbe5b6510bb-kube-api-access-vnmxh\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.079610 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.079425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-podres\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.079610 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.079452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-proc\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.079610 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.079461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-lib-modules\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.079610 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.079553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-sys\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.079610 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.079568    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-lib-modules\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.079610 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.079574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-podres\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.079854 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.079640    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/103422ee-3390-4e17-a630-6fbe5b6510bb-sys\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.087554 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.087525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnmxh\" (UniqueName: \"kubernetes.io/projected/103422ee-3390-4e17-a630-6fbe5b6510bb-kube-api-access-vnmxh\") pod \"perf-node-gather-daemonset-lvwrb\" (UID: \"103422ee-3390-4e17-a630-6fbe5b6510bb\") " pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.219082 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.218971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.491748 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.491725    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"]
Sep 19 09:54:26.494385 ip-10-0-141-190 kubenswrapper[2579]: W0919 09:54:26.494348    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod103422ee_3390_4e17_a630_6fbe5b6510bb.slice/crio-8415630546aa7567c2751935c84342df426e49f7dff1f245505b5a9f0ed8b8e6 WatchSource:0}: Error finding container 8415630546aa7567c2751935c84342df426e49f7dff1f245505b5a9f0ed8b8e6: Status 404 returned error can't find the container with id 8415630546aa7567c2751935c84342df426e49f7dff1f245505b5a9f0ed8b8e6
Sep 19 09:54:26.782722 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.782633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb" event={"ID":"103422ee-3390-4e17-a630-6fbe5b6510bb","Type":"ContainerStarted","Data":"159fd6dbdf7bfff1e3c612bcce825551fd0182a31493d04e1a41065a74162f3a"}
Sep 19 09:54:26.782722 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.782706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb" event={"ID":"103422ee-3390-4e17-a630-6fbe5b6510bb","Type":"ContainerStarted","Data":"8415630546aa7567c2751935c84342df426e49f7dff1f245505b5a9f0ed8b8e6"}
Sep 19 09:54:26.782935 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.782760    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:26.799687 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:26.799640    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb" podStartSLOduration=1.799626272 podStartE2EDuration="1.799626272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:54:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:54:26.797438767 +0000 UTC m=+2849.964633997" watchObservedRunningTime="2026-09-19 09:54:26.799626272 +0000 UTC m=+2849.966821540"
Sep 19 09:54:27.961025 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:27.960987    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mg5xq_277826a9-fb6b-4298-aa2e-0159598b5518/dns/0.log"
Sep 19 09:54:27.980817 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:27.980796    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mg5xq_277826a9-fb6b-4298-aa2e-0159598b5518/kube-rbac-proxy/0.log"
Sep 19 09:54:28.072634 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:28.072596    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7xjhg_41747fa9-438f-414d-8b1b-8a56fb5dc6d7/dns-node-resolver/0.log"
Sep 19 09:54:28.725654 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:28.725622    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n85bz_33065bce-502e-4912-9d83-7cb832c0b265/node-ca/0.log"
Sep 19 09:54:29.677358 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:29.677334    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg_75a5ec1f-78ee-4845-8243-6c0273c70e56/istio-proxy/0.log"
Sep 19 09:54:30.071163 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:30.071129    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8cfdp_9a11417a-8f88-49a5-8d2e-4e3df2a0763c/discovery/0.log"
Sep 19 09:54:30.186380 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:30.186341    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4fvmc_f9c91454-58cc-4999-8040-9e136429ef9a/istio-proxy/0.log"
Sep 19 09:54:30.188563 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:30.188542    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4fvmc_f9c91454-58cc-4999-8040-9e136429ef9a/istio-proxy/1.log"
Sep 19 09:54:30.227352 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:30.227324    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-mxqcf_dfbe6107-0ffa-4805-ab54-964f1afe2e64/payload-pre-processing/0.log"
Sep 19 09:54:30.293995 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:30.293967    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-w2qx6_6b21d1b6-4a79-4a72-827b-242b01e840d1/payload-processing/0.log"
Sep 19 09:54:31.283691 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:31.283665    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r6lgq_7dfc3b78-9bd0-4e7a-808e-498bc2e16e2e/serve-healthcheck-canary/0.log"
Sep 19 09:54:31.924451 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:31.924422    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jzksq_2f981b90-3fce-4b7d-977d-6b7b701aaeb7/kube-rbac-proxy/0.log"
Sep 19 09:54:31.945371 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:31.945347    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jzksq_2f981b90-3fce-4b7d-977d-6b7b701aaeb7/exporter/0.log"
Sep 19 09:54:31.965952 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:31.965928    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jzksq_2f981b90-3fce-4b7d-977d-6b7b701aaeb7/extractor/0.log"
Sep 19 09:54:32.799523 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:32.799496    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2bwqb/perf-node-gather-daemonset-lvwrb"
Sep 19 09:54:34.576587 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:34.576558    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-d4qgm_0f663d0f-ee4a-48b2-bfa6-ff7a4e0ff14e/server/0.log"
Sep 19 09:54:34.656051 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:34.656012    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w28cp_8ad9cf84-5812-42ae-bfcf-1fc81183761e/manager/0.log"
Sep 19 09:54:34.679385 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:34.679361    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56479975c9-8zfz5_e357301b-2daf-48e0-b590-e4bb49b273dd/manager/0.log"
Sep 19 09:54:34.700366 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:34.700347    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56479975c9-8zfz5_e357301b-2daf-48e0-b590-e4bb49b273dd/copy-manifests/0.log"
Sep 19 09:54:35.749742 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:35.749714    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg_75a5ec1f-78ee-4845-8243-6c0273c70e56/istio-proxy/0.log"
Sep 19 09:54:36.152302 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:36.152195    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8cfdp_9a11417a-8f88-49a5-8d2e-4e3df2a0763c/discovery/0.log"
Sep 19 09:54:36.184980 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:36.184956    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9b48b7f58-kgbvq_6c804249-d91c-43d8-bc2f-633afcf6c020/manager/0.log"
Sep 19 09:54:36.194796 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:36.194773    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4fvmc_f9c91454-58cc-4999-8040-9e136429ef9a/istio-proxy/0.log"
Sep 19 09:54:36.197625 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:36.197606    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4fvmc_f9c91454-58cc-4999-8040-9e136429ef9a/istio-proxy/1.log"
Sep 19 09:54:36.216911 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:36.216894    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-mxqcf_dfbe6107-0ffa-4805-ab54-964f1afe2e64/payload-pre-processing/0.log"
Sep 19 09:54:36.236351 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:36.236329    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-w2qx6_6b21d1b6-4a79-4a72-827b-242b01e840d1/payload-processing/0.log"
Sep 19 09:54:37.842182 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:37.842158    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-625qg_75a5ec1f-78ee-4845-8243-6c0273c70e56/istio-proxy/0.log"
Sep 19 09:54:38.226521 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:38.226491    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8cfdp_9a11417a-8f88-49a5-8d2e-4e3df2a0763c/discovery/0.log"
Sep 19 09:54:38.292437 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:38.292409    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4fvmc_f9c91454-58cc-4999-8040-9e136429ef9a/istio-proxy/0.log"
Sep 19 09:54:38.293256 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:38.293234    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4fvmc_f9c91454-58cc-4999-8040-9e136429ef9a/istio-proxy/1.log"
Sep 19 09:54:38.324386 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:38.324364    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-mxqcf_dfbe6107-0ffa-4805-ab54-964f1afe2e64/payload-pre-processing/0.log"
Sep 19 09:54:38.348513 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:38.348493    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-w2qx6_6b21d1b6-4a79-4a72-827b-242b01e840d1/payload-processing/0.log"
Sep 19 09:54:43.029437 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:43.029411    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh4cx_9e78dedf-d775-4f5e-aa81-eb8ad545778f/kube-multus-additional-cni-plugins/0.log"
Sep 19 09:54:43.049826 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:43.049801    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh4cx_9e78dedf-d775-4f5e-aa81-eb8ad545778f/egress-router-binary-copy/0.log"
Sep 19 09:54:43.067861 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:43.067837    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh4cx_9e78dedf-d775-4f5e-aa81-eb8ad545778f/cni-plugins/0.log"
Sep 19 09:54:43.085415 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:43.085389    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh4cx_9e78dedf-d775-4f5e-aa81-eb8ad545778f/bond-cni-plugin/0.log"
Sep 19 09:54:43.104187 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:43.104170    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh4cx_9e78dedf-d775-4f5e-aa81-eb8ad545778f/routeoverride-cni/0.log"
Sep 19 09:54:43.125619 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:43.125599    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh4cx_9e78dedf-d775-4f5e-aa81-eb8ad545778f/whereabouts-cni-bincopy/0.log"
Sep 19 09:54:43.144076 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:43.144044    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh4cx_9e78dedf-d775-4f5e-aa81-eb8ad545778f/whereabouts-cni/0.log"
Sep 19 09:54:43.186300 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:43.186275    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bg288_c3aaf3b2-8876-4116-a29c-0d048f54cb72/kube-multus/0.log"
Sep 19 09:54:43.351986 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:43.351961    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rv72r_7957c300-67ee-4732-a5c4-75ffc15fd793/network-metrics-daemon/0.log"
Sep 19 09:54:43.368483 ip-10-0-141-190 kubenswrapper[2579]: I0919 09:54:43.368458    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rv72r_7957c300-67ee-4732-a5c4-75ffc15fd793/kube-rbac-proxy/0.log"