Sep 08 15:08:59.311948 ip-10-0-138-20 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 15:08:59.688933 ip-10-0-138-20 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:08:59.688933 ip-10-0-138-20 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 15:08:59.688933 ip-10-0-138-20 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:08:59.688933 ip-10-0-138-20 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 15:08:59.688933 ip-10-0-138-20 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:08:59.689880 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.689792    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 15:08:59.696273 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696255    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:08:59.696273 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696273    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:08:59.696273 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696278    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696284    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696289    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696293    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696302    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696306    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696310    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696314    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696319    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696323    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696326    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696331    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696334    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696338    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696342    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696346    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696350    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696354    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696358    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696363    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:08:59.696453 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696367    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696371    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696375    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696379    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696384    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696388    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696392    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696397    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696401    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696405    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696409    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696413    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696418    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696422    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696427    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696434    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696441    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696447    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696451    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:08:59.697006 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696455    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696460    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696463    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696469    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696473    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696477    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696481    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696485    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696489    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696493    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696497    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696502    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696506    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696511    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696515    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696519    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696523    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696527    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696531    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696535    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:08:59.697457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696539    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696546    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696552    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696556    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696561    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696590    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696610    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696628    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696632    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696636    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696639    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696642    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696645    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696649    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696651    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696654    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696659    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696662    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696665    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:08:59.697946 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696668    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696670    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696673    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696676    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696678    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696681    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696685    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696689    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696692    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696695    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696698    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696701    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696703    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696706    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696708    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696711    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696714    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696716    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.696719    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697455    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:08:59.698399 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697462    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697466    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697468    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697471    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697474    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697476    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697479    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697482    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697484    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697487    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697489    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697492    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697494    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697497    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697499    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697501    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697504    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697509    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697513    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:08:59.698911 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697515    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697519    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697521    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697524    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697526    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697529    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697531    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697534    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697537    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697539    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697542    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697544    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697548    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697551    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697554    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697557    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697560    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697562    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697564    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697567    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:08:59.699384 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697570    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697572    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697575    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697577    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697580    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697582    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697585    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697587    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697590    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697592    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697595    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697597    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697600    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697602    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697605    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697607    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697610    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697613    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697632    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697635    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:08:59.699882 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697637    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697640    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697643    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697646    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697649    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697652    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697655    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697664    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697667    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697670    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697674    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697677    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697680    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697684    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697686    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697689    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697691    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697694    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697697    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:08:59.700359 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697699    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697702    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697704    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697707    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697709    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697711    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697715    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697718    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697720    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697723    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697726    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697728    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697731    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697735    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697742    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697745    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697748    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697751    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697754    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.697756    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:08:59.700840 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698163    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698168    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698171    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698173    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698176    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698179    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698182    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698185    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698187    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698190    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698192    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698195    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698197    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698200    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698202    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698205    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698207    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698210    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698212    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698215    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:08:59.701392 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698217    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698221    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698224    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698227    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698229    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698232    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698234    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698237    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698240    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698242    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698245    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698247    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698250    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698253    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698256    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698259    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698261    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698263    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698266    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698268    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:08:59.701890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698271    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698273    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698276    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698278    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698280    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698285    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698288    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698291    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698293    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698296    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698298    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698301    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698303    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698306    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698308    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698311    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698313    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698316    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698318    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698321    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:08:59.702365 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698324    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698326    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698329    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698333    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698337    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698340    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698344    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698347    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698350    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698353    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698355    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698358    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698360    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698363    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698366    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698368    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698371    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698375    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698378    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:08:59.702906 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698381    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698384    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698386    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698389    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698391    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698394    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698397    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698400    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698403    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698407    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698410    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698413    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698416    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698420    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698422    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698425    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698428    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698431    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698433    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.698436    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:08:59.703391 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698515    2566 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698552    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698558    2566 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698563    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698567    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698570    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698574    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698579    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698582    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698585    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698589    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698592    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698596    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698599    2566 flags.go:64] FLAG: --cgroup-root=""
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698601    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698604    2566 flags.go:64] FLAG: --client-ca-file=""
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698607    2566 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698610    2566 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698629    2566 flags.go:64] FLAG: --cluster-domain=""
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698633    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698636    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698639    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698642    2566 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698646    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 15:08:59.703919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698649    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698654    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698657    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698660    2566 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698663    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698666    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698669    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698672    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698676    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698680    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698683    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698686    2566 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698689    2566 flags.go:64] FLAG: --enable-server="true"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698692    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698696    2566 flags.go:64] FLAG: --event-burst="100"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698699    2566 flags.go:64] FLAG: --event-qps="50"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698702    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698705    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698708    2566 flags.go:64] FLAG: --eviction-hard=""
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698712    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698715    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698717    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698720    2566 flags.go:64] FLAG: --eviction-soft=""
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698723    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698726    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 15:08:59.704580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698729    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698732    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698735    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698738    2566 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698741    2566 flags.go:64] FLAG: --feature-gates=""
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698745    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698748    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698751    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698757    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698760    2566 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698763    2566 flags.go:64] FLAG: --help="false"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698766    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-138-20.ec2.internal"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698769    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698772    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698775    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698778    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698782    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698785    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698788    2566 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698791    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698793    2566 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698796    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698799    2566 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698802    2566 flags.go:64] FLAG: --kube-reserved=""
Sep 08 15:08:59.705225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698805    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698808    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698811    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698814    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698816    2566 flags.go:64] FLAG: --lock-file=""
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698819    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698822    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698825    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698830    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698833    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698835    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698839    2566 flags.go:64] FLAG: --logging-format="text"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698841    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698844    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698847    2566 flags.go:64] FLAG: --manifest-url=""
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698850    2566 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698860    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698863    2566 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698867    2566 flags.go:64] FLAG: --max-pods="110"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698870    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698873    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698876    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698879    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698882    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698885    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 15:08:59.705847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698888    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698896    2566 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698899    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698902    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698905    2566 flags.go:64] FLAG: --pod-cidr=""
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698908    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698913    2566 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698916    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698919    2566 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698922    2566 flags.go:64] FLAG: --port="10250"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698925    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698928    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-024e3de631c418f11"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698931    2566 flags.go:64] FLAG: --qos-reserved=""
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698934    2566 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698937    2566 flags.go:64] FLAG: --register-node="true"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698939    2566 flags.go:64] FLAG: --register-with-taints=""
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698943    2566 flags.go:64] FLAG: --registry-burst="10"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698946    2566 flags.go:64] FLAG: --registry-qps="5"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698949    2566 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698952    2566 flags.go:64] FLAG: --reserved-memory=""
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698956    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698959    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698962    2566 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698965    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698969    2566 flags.go:64] FLAG: --runonce="false"
Sep 08 15:08:59.706467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698972    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698975    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698977    2566 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698980    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698983    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698986    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698991    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698993    2566 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.698996    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699000    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699002    2566 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699005    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699008    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699011    2566 flags.go:64] FLAG: --system-cgroups=""
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699014    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699019    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699022    2566 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699025    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699029    2566 flags.go:64] FLAG: --tls-min-version=""
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699033    2566 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699035    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699038    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699041    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699044    2566 flags.go:64] FLAG: --v="2"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699048    2566 flags.go:64] FLAG: --version="false"
Sep 08 15:08:59.707085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699052    2566 flags.go:64] FLAG: --vmodule=""
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699056    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699059    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699171    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699175    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699178    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699183    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699185    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699188    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699191    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699194    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699196    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699199    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699203    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699205    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699208    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699210    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699213    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699216    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699218    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:08:59.707732 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699221    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699224    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699226    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699230    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699233    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699236    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699239    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699241    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699244    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699246    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699249    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699251    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699254    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699256    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699259    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699261    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699264    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699266    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699270    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699273    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:08:59.708226 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699275    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699279    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699282    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699289    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699295    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699303    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699306    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699309    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699313    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699316    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699319    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699322    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699325    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699328    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699331    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699333    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699336    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699339    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699341    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:08:59.708715 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699344    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699346    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699348    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699351    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699353    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699356    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699358    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699360    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699363    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699365    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699368    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699371    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699374    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699376    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699379    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699382    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699385    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699387    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699392    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699395    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:08:59.709194 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699397    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699400    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699402    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699405    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699411    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699413    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699416    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699418    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699420    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699423    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699425    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699428    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699430    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699432    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699435    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699437    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699439    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699442    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699444    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699447    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:08:59.709704 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699449    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699452    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.699456    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.699986    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.706810    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.706827    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.709107    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.709116    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709177    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709182    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709185    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709188    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709191    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709193    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:08:59.710191 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709196    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709199    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709203    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709207    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709211    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709214    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709217    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709220    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709223    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709225    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709228    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709230    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709233    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709236    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709238    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709241    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709243    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709247    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709249    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709251    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:08:59.710543 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709254    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709256    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709259    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709263    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709266    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709269    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709271    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709274    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709277    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709279    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709282    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709284    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709287    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709289    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709292    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709294    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709297    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709299    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709302    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709304    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:08:59.711261 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709307    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709310    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709312    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709315    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709317    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709319    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709322    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709325    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709327    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709330    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709332    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709335    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709337    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709339    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709342    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709346    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709349    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709351    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709354    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709356    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:08:59.711975 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709359    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709361    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709363    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709366    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709369    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709372    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709376    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709379    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709381    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709384    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709386    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709388    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709391    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709393    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709396    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709398    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709400    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709403    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709405    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:08:59.712467 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709409    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709412    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709415    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709418    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709420    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709423    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709425    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709428    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709432    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709435    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709438    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709441    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709443    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709446    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.709451    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:08:59.712970 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709567    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709572    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709575    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709578    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709581    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709583    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709586    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709588    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709591    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709593    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709596    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709598    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709602    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709605    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709608    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709611    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709613    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709634    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709636    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709639    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:08:59.713345 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709642    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709644    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709647    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709650    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709653    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709657    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709661    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709664    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709668    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709671    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709673    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709676    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709679    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709681    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709684    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709686    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709688    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709691    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709693    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709696    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:08:59.713927 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709698    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709701    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709703    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709706    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709709    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709711    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709714    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709717    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709720    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709722    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709725    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709727    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709730    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709732    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709735    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709737    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709739    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709742    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709745    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:08:59.714420 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709747    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709749    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709753    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709755    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709758    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709760    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709762    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709765    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709767    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709770    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709772    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709779    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709781    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709784    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709786    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709789    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709791    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709793    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709796    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709798    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:08:59.714888 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709801    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709804    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709806    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709809    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709811    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709814    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709816    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709818    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709821    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709823    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709826    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709828    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709831    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709834    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709838    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709841    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709844    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709846    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709849    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:08:59.715364 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:08:59.709851    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:08:59.715832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.709857    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:08:59.715832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.709970    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 15:08:59.715832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.714358    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 15:08:59.715832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.715175    2566 server.go:1019] "Starting client certificate rotation"
Sep 08 15:08:59.715832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.715273    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 15:08:59.715832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.715313    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 15:08:59.717240 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.717226    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 15:08:59.718430 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.718406    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 15:08:59.728124 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.728054    2566 log.go:25] "Validated CRI v1 runtime API"
Sep 08 15:08:59.731504 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.731486    2566 log.go:25] "Validated CRI v1 image API"
Sep 08 15:08:59.732356 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.732335    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 15:08:59.735271 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.735248    2566 fs.go:135] Filesystem UUIDs: map[3eda1689-f1d1-4c1b-b616-1deeef38971b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c95f5e25-08f8-4973-88fe-67ba616c8d74:/dev/nvme0n1p3]
Sep 08 15:08:59.735353 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.735271    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 15:08:59.740415 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.740296    2566 manager.go:216] Machine: {Timestamp:2026-09-08 15:08:59.738914791 +0000 UTC m=+0.310460823 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2965825 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d494f8e2293c5433cebeb73c820dd SystemUUID:ec2d494f-8e22-93c5-433c-ebeb73c820dd BootID:19c31cd0-acc7-4adc-b36c-a6bef6890a7b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:05:ad:36:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:05:ad:36:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:58:14:7c:f7:eb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 15:08:59.740415 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.740405    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 15:08:59.740549 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.740493    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 15:08:59.743395 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.743365    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 15:08:59.743535 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.743396    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-20.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 15:08:59.744554 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.744539    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 15:08:59.744612 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.744583    2566 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 15:08:59.744612 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.744599    2566 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 15:08:59.744612 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.744609    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 15:08:59.745203 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.745190    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 15:08:59.746347 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.746337    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 15:08:59.749815 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.749802    2566 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 15:08:59.749933 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.749924    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 15:08:59.749982 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.749961    2566 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 15:08:59.749982 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.749978    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 15:08:59.750066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.749997    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 15:08:59.750066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.750011    2566 kubelet.go:398] "Adding apiserver pod source"
Sep 08 15:08:59.750066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.750024    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 15:08:59.750418 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.750407    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 15:08:59.750448 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.750426    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 15:08:59.753405 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.753380    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 15:08:59.755671 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.755656    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 15:08:59.755730 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.755689    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 15:08:59.755859 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.755849    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 15:08:59.755892 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.755864    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 15:08:59.755892 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.755870    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 15:08:59.755892 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.755875    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 15:08:59.755892 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.755883    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 15:08:59.755892 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.755889    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 15:08:59.756339 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.756330    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 15:08:59.756374 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.756339    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 15:08:59.756374 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.756346    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 15:08:59.756374 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.756352    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 15:08:59.756374 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.756360    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 15:08:59.756374 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.756368    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 15:08:59.756941 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.756930    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 15:08:59.756984 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.756944    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 15:08:59.759299 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.759278    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-20.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 15:08:59.759668 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.759648    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-20.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 15:08:59.759717 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.759648    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 15:08:59.761677 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.761664    2566 server.go:1268] "Started kubelet"
Sep 08 15:08:59.761739 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.761709    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 15:08:59.761816 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.761766    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 15:08:59.761861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.761847    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 15:08:59.762473 ip-10-0-138-20 systemd[1]: Started Kubernetes Kubelet.
Sep 08 15:08:59.763360 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.763121    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 15:08:59.763760 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.763748    2566 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 15:08:59.766658 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.766613    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 15:08:59.766816 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.765975    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-20.ec2.internal.18d361025c3e4b5e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-20.ec2.internal,UID:ip-10-0-138-20.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-20.ec2.internal,},FirstTimestamp:2026-09-08 15:08:59.761634142 +0000 UTC m=+0.333180175,LastTimestamp:2026-09-08 15:08:59.761634142 +0000 UTC m=+0.333180175,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-20.ec2.internal,}"
Sep 08 15:08:59.766932 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.766913    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 15:08:59.766932 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.766920    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 15:08:59.767073 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.767030    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:08:59.767668 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.767651    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 15:08:59.767668 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.767668    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 15:08:59.767805 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.767651    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 15:08:59.767805 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.767759    2566 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 15:08:59.767805 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.767764    2566 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 15:08:59.768204 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.768186    2566 factory.go:55] Registering systemd factory
Sep 08 15:08:59.768288 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.768208    2566 factory.go:223] Registration of the systemd container factory successfully
Sep 08 15:08:59.768427 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.768416    2566 factory.go:153] Registering CRI-O factory
Sep 08 15:08:59.768427 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.768428    2566 factory.go:223] Registration of the crio container factory successfully
Sep 08 15:08:59.768530 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.768469    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 15:08:59.768530 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.768488    2566 factory.go:103] Registering Raw factory
Sep 08 15:08:59.768530 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.768502    2566 manager.go:1196] Started watching for new ooms in manager
Sep 08 15:08:59.768828 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.768818    2566 manager.go:349] Starting recovery of all containers
Sep 08 15:08:59.776740 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.776705    2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-20.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 15:08:59.776904 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.776830    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 15:08:59.778793 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.778767    2566 manager.go:354] Recovery completed
Sep 08 15:08:59.781307 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.781277    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 15:08:59.784751 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.784732    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:08:59.786739 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.786719    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:08:59.786810 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.786754    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:08:59.786810 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.786764    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:08:59.787349 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.787334    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 15:08:59.787349 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.787347    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 15:08:59.787471 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.787357    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:08:59.787471 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.787362    2566 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 15:08:59.788151 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.788135    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:08:59.788214 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.788163    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:08:59.788214 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.788173    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:08:59.789547 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.789537    2566 policy_none.go:49] "None policy: Start"
Sep 08 15:08:59.789588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.789554    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 15:08:59.789588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.789564    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 15:08:59.791592 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.791581    2566 policy_none.go:47] "Start"
Sep 08 15:08:59.795264 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.795192    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-20.ec2.internal.18d361025dbd5f8b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-20.ec2.internal,UID:ip-10-0-138-20.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-20.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-20.ec2.internal,},FirstTimestamp:2026-09-08 15:08:59.786739595 +0000 UTC m=+0.358285627,LastTimestamp:2026-09-08 15:08:59.786739595 +0000 UTC m=+0.358285627,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-20.ec2.internal,}"
Sep 08 15:08:59.800299 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.800236    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-20.ec2.internal.18d361025dbdaae9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-20.ec2.internal,UID:ip-10-0-138-20.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-20.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-20.ec2.internal,},FirstTimestamp:2026-09-08 15:08:59.786758889 +0000 UTC m=+0.358304921,LastTimestamp:2026-09-08 15:08:59.786758889 +0000 UTC m=+0.358304921,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-20.ec2.internal,}"
Sep 08 15:08:59.807415 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.807353    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-20.ec2.internal.18d361025dbdd0c5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-20.ec2.internal,UID:ip-10-0-138-20.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-20.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-20.ec2.internal,},FirstTimestamp:2026-09-08 15:08:59.786768581 +0000 UTC m=+0.358314614,LastTimestamp:2026-09-08 15:08:59.786768581 +0000 UTC m=+0.358314614,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-20.ec2.internal,}"
Sep 08 15:08:59.818034 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.817939    2566 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-20.ec2.internal.18d361025dbd5f8b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-20.ec2.internal.18d361025dbd5f8b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-20.ec2.internal,UID:ip-10-0-138-20.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-20.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-20.ec2.internal,},FirstTimestamp:2026-09-08 15:08:59.786739595 +0000 UTC m=+0.358285627,LastTimestamp:2026-09-08 15:08:59.788150645 +0000 UTC m=+0.359696677,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-20.ec2.internal,}"
Sep 08 15:08:59.832261 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.832184    2566 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-20.ec2.internal.18d361025dbdaae9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-20.ec2.internal.18d361025dbdaae9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-20.ec2.internal,UID:ip-10-0-138-20.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-20.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-20.ec2.internal,},FirstTimestamp:2026-09-08 15:08:59.786758889 +0000 UTC m=+0.358304921,LastTimestamp:2026-09-08 15:08:59.788167839 +0000 UTC m=+0.359713872,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-20.ec2.internal,}"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.833163    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5pjt9"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.835326    2566 manager.go:337] "Starting Device Plugin manager"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.835361    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.835371    2566 server.go:87] "Starting device plugin registration server"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.835841    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.835855    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.835957    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.836038    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.836046    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.836588    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.836647    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.840808    2566 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-20.ec2.internal.18d361025dbdd0c5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-20.ec2.internal.18d361025dbdd0c5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-20.ec2.internal,UID:ip-10-0-138-20.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-20.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-20.ec2.internal,},FirstTimestamp:2026-09-08 15:08:59.786768581 +0000 UTC m=+0.358314614,LastTimestamp:2026-09-08 15:08:59.788176573 +0000 UTC m=+0.359722606,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-20.ec2.internal,}"
Sep 08 15:08:59.856850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.851581    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5pjt9"
Sep 08 15:08:59.907467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.907432    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 15:08:59.907631 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.907494    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 15:08:59.907631 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.907517    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 15:08:59.907631 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.907561    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 15:08:59.910354 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.910333    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:08:59.936687 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.936656    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:08:59.937699 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.937678    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:08:59.937789 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.937711    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:08:59.937789 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.937720    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:08:59.937789 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.937741    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-20.ec2.internal"
Sep 08 15:08:59.949372 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:08:59.949290    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-20.ec2.internal"
Sep 08 15:08:59.949372 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.949315    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-20.ec2.internal\": node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:08:59.980361 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:08:59.980328    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:09:00.007940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.007906    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-20.ec2.internal"]
Sep 08 15:09:00.008093 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.007990    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:09:00.009517 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.009496    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:09:00.009588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.009531    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:09:00.009588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.009542    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:09:00.011741 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.011729    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:09:00.011856 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.011839    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.011897 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.011877    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:09:00.012595 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.012578    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:09:00.012703 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.012608    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:09:00.012703 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.012639    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:09:00.012703 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.012643    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:09:00.012900 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.012656    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:09:00.012900 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.012724    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:09:00.014806 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.014787    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.014905 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.014820    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:09:00.015590 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.015570    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:09:00.015671 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.015606    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:09:00.015671 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.015637    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:09:00.040519 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:00.040494    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-20.ec2.internal\" not found" node="ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.045196 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:00.045180    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-20.ec2.internal\" not found" node="ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.069508 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.069470    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67a7780455fba34453c0790784df5218-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal\" (UID: \"67a7780455fba34453c0790784df5218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.069508 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.069506    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67a7780455fba34453c0790784df5218-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal\" (UID: \"67a7780455fba34453c0790784df5218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.069706 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.069523    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7e569458af07a6378339a74ece7e2b0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-20.ec2.internal\" (UID: \"c7e569458af07a6378339a74ece7e2b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.080766 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:00.080730    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:09:00.170341 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.170311    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67a7780455fba34453c0790784df5218-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal\" (UID: \"67a7780455fba34453c0790784df5218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.170440 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.170346    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67a7780455fba34453c0790784df5218-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal\" (UID: \"67a7780455fba34453c0790784df5218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.170440 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.170373    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7e569458af07a6378339a74ece7e2b0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-20.ec2.internal\" (UID: \"c7e569458af07a6378339a74ece7e2b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.170440 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.170406    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7e569458af07a6378339a74ece7e2b0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-20.ec2.internal\" (UID: \"c7e569458af07a6378339a74ece7e2b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.170440 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.170429    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67a7780455fba34453c0790784df5218-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal\" (UID: \"67a7780455fba34453c0790784df5218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.170585 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.170406    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67a7780455fba34453c0790784df5218-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal\" (UID: \"67a7780455fba34453c0790784df5218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.180874 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:00.180838    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:09:00.281766 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:00.281701    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:09:00.342904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.342867    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.347861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.347677    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.382486 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:00.382456    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:09:00.483123 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:00.483085    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:09:00.583729 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:00.583700    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:09:00.684252 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:00.684213    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:09:00.715420 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.715381    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 15:09:00.715884 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.715567    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 15:09:00.784344 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:00.784321    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:09:00.855753 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.855657    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 15:04:00 +0000 UTC" deadline="2028-02-12 23:58:09.941934012 +0000 UTC"
Sep 08 15:09:00.855753 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.855694    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12536h49m9.08624347s"
Sep 08 15:09:00.856753 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.856736    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:09:00.858585 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.858568    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:09:00.858678 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.858600    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:09:00.858678 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.858634    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:09:00.885287 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:00.885262    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-20.ec2.internal\" not found"
Sep 08 15:09:00.893261 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.893235    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:09:00.928214 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.928182    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:09:00.967631 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.967579    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.980050 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.980026    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 15:09:00.981705 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.981688    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-20.ec2.internal"
Sep 08 15:09:00.992567 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:00.992548    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 15:09:01.077753 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:01.077719    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e569458af07a6378339a74ece7e2b0.slice/crio-45460716d23809b20ec6dc19a12ed72a96df3968d81ff42b7d683adb73d6d6fc WatchSource:0}: Error finding container 45460716d23809b20ec6dc19a12ed72a96df3968d81ff42b7d683adb73d6d6fc: Status 404 returned error can't find the container with id 45460716d23809b20ec6dc19a12ed72a96df3968d81ff42b7d683adb73d6d6fc
Sep 08 15:09:01.077927 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.077908    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:09:01.082785 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.082767    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:09:01.527886 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.527794    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:09:01.752835 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.752789    2566 apiserver.go:52] "Watching apiserver"
Sep 08 15:09:01.762116 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.762079    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 15:09:01.763061 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.763036    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-c4vjz","openshift-network-operator/iptables-alerter-5fs2q","kube-system/konnectivity-agent-xtwsp","kube-system/kube-apiserver-proxy-ip-10-0-138-20.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m","openshift-dns/node-resolver-qt79p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-gp6wz","kube-system/global-pull-secret-syncer-lpf2t","openshift-cluster-node-tuning-operator/tuned-h8xsm","openshift-image-registry/node-ca-bdl5b","openshift-multus/multus-additional-cni-plugins-8984m","openshift-multus/multus-mp72c","openshift-multus/network-metrics-daemon-fn4w2"]
Sep 08 15:09:01.767090 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.767070    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.768220 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.768199    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 15:09:01.769369 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.769338    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5fs2q"
Sep 08 15:09:01.771578 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.771556    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:01.772297 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.772276    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 15:09:01.772396 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.772382    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 15:09:01.772812 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.772792    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 15:09:01.773289 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.773273    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:09:01.773597 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.773577    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 15:09:01.773904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.773842    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 15:09:01.773976 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.773917    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:01.774038 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:01.773989    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:01.774285 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.774268    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7trxz\""
Sep 08 15:09:01.774350 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.774336    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8xm5w\""
Sep 08 15:09:01.774861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.774845    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 15:09:01.774946 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.774906    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gs57x\""
Sep 08 15:09:01.775013 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.774951    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 15:09:01.775071 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.775009    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 15:09:01.776234 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.776214    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.778597 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.778552    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qt79p"
Sep 08 15:09:01.778863 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.778847    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 15:09:01.778969 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.778951    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 15:09:01.779033 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.779013    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 15:09:01.779033 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.778955    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-thd27\""
Sep 08 15:09:01.780315 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780293    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6164d09-c086-489d-9020-0b035e79d421-cni-binary-copy\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780409 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780331    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-etc-kubernetes\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780409 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780358    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddm26\" (UniqueName: \"kubernetes.io/projected/e6164d09-c086-489d-9020-0b035e79d421-kube-api-access-ddm26\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780409 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780377    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-system-cni-dir\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780409 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780394    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-cnibin\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780622 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780446    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-multus-socket-dir-parent\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780622 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780498    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-run-k8s-cni-cncf-io\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780622 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780528    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-var-lib-cni-multus\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780622 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780550    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-run-multus-certs\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780622 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780566    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23233e46-0dc1-48f4-a8d0-81f853fdbf12-iptables-alerter-script\") pod \"iptables-alerter-5fs2q\" (UID: \"23233e46-0dc1-48f4-a8d0-81f853fdbf12\") " pod="openshift-network-operator/iptables-alerter-5fs2q"
Sep 08 15:09:01.780904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780643    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-multus-cni-dir\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780677    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-hostroot\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780702    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-multus-conf-dir\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23233e46-0dc1-48f4-a8d0-81f853fdbf12-host-slash\") pod \"iptables-alerter-5fs2q\" (UID: \"23233e46-0dc1-48f4-a8d0-81f853fdbf12\") " pod="openshift-network-operator/iptables-alerter-5fs2q"
Sep 08 15:09:01.780904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780787    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w6c5\" (UniqueName: \"kubernetes.io/projected/23233e46-0dc1-48f4-a8d0-81f853fdbf12-kube-api-access-6w6c5\") pod \"iptables-alerter-5fs2q\" (UID: \"23233e46-0dc1-48f4-a8d0-81f853fdbf12\") " pod="openshift-network-operator/iptables-alerter-5fs2q"
Sep 08 15:09:01.780904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780813    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-run-netns\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780855    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-var-lib-cni-bin\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.780904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780889    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-var-lib-kubelet\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.781311 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.780915    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6164d09-c086-489d-9020-0b035e79d421-multus-daemon-config\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.781311 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.781066    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:01.781311 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:01.781125    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:01.781311 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.781165    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 15:09:01.781311 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.781223    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 15:09:01.781647 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.781404    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cbxvm\""
Sep 08 15:09:01.783599 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.783583    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.784742 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.784725    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 15:09:01.786063 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.786045    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:01.786734 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.786547    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 15:09:01.786734 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.786562    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 15:09:01.786734 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:01.786634    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:01.787812 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.787168    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 15:09:01.787812 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.787595    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 15:09:01.789212 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.788654    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 15:09:01.789212 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.788928    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 15:09:01.789212 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.789141    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-shrg8\""
Sep 08 15:09:01.790724 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.790689    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.793142 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.793124    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bdl5b"
Sep 08 15:09:01.794283 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.794253    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:09:01.794381 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.794307    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 15:09:01.794472 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.794454    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cq9bf\""
Sep 08 15:09:01.795715 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.795680    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.796022 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.795881    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 15:09:01.796022 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.795986    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 15:09:01.796295 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.796280    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 15:09:01.796371 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.796286    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wkfsh\""
Sep 08 15:09:01.798780 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.798764    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 15:09:01.798894 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.798778    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 15:09:01.799247 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.799229    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6c75w\""
Sep 08 15:09:01.807384 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.807365    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9wpbd"
Sep 08 15:09:01.817127 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.817104    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9wpbd"
Sep 08 15:09:01.868647 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.868592    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 15:09:01.881976 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.881945    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-kubernetes\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.881976 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.881979    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-sys\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.882149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882000    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-systemd-units\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.882149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882016    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-run-systemd\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.882149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882033    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-run-ovn\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.882149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882048    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-cni-netd\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.882149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882086    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-registration-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.882149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882138    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-cnibin\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.882330 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882176    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-multus-socket-dir-parent\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.882330 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882244    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-multus-socket-dir-parent\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.882330 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882252    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-cnibin\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.882330 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882259    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23233e46-0dc1-48f4-a8d0-81f853fdbf12-iptables-alerter-script\") pod \"iptables-alerter-5fs2q\" (UID: \"23233e46-0dc1-48f4-a8d0-81f853fdbf12\") " pod="openshift-network-operator/iptables-alerter-5fs2q"
Sep 08 15:09:01.882330 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882294    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-tuned\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.882330 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882314    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-system-cni-dir\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.882565 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882354    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgxkm\" (UniqueName: \"kubernetes.io/projected/8ad071ef-333f-4eb3-a211-690a174bf23f-kube-api-access-qgxkm\") pod \"node-resolver-qt79p\" (UID: \"8ad071ef-333f-4eb3-a211-690a174bf23f\") " pod="openshift-dns/node-resolver-qt79p"
Sep 08 15:09:01.882565 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882376    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-kubelet\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.882565 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882392    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-run-openvswitch\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.882565 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882420    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-multus-cni-dir\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.882565 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882446    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w6c5\" (UniqueName: \"kubernetes.io/projected/23233e46-0dc1-48f4-a8d0-81f853fdbf12-kube-api-access-6w6c5\") pod \"iptables-alerter-5fs2q\" (UID: \"23233e46-0dc1-48f4-a8d0-81f853fdbf12\") " pod="openshift-network-operator/iptables-alerter-5fs2q"
Sep 08 15:09:01.882565 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882461    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-var-lib-kubelet\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.882565 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882505    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.882565 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882527    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.882565 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882542    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-socket-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.882565 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882559    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stbkt\" (UniqueName: \"kubernetes.io/projected/9140e370-2ac6-4555-9ecb-05e4d2550cd6-kube-api-access-stbkt\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882578    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-multus-cni-dir\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882582    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1932344-9198-44d7-a765-aa52cd8d5a6f-host\") pod \"node-ca-bdl5b\" (UID: \"d1932344-9198-44d7-a765-aa52cd8d5a6f\") " pod="openshift-image-registry/node-ca-bdl5b"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882648    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-var-lib-openvswitch\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882681    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-etc-selinux\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882721    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6164d09-c086-489d-9020-0b035e79d421-cni-binary-copy\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882758    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-etc-kubernetes\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882783    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddm26\" (UniqueName: \"kubernetes.io/projected/e6164d09-c086-489d-9020-0b035e79d421-kube-api-access-ddm26\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882814    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-etc-kubernetes\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882817    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcnv5\" (UniqueName: \"kubernetes.io/projected/d1932344-9198-44d7-a765-aa52cd8d5a6f-kube-api-access-wcnv5\") pod \"node-ca-bdl5b\" (UID: \"d1932344-9198-44d7-a765-aa52cd8d5a6f\") " pod="openshift-image-registry/node-ca-bdl5b"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882844    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ad071ef-333f-4eb3-a211-690a174bf23f-tmp-dir\") pod \"node-resolver-qt79p\" (UID: \"8ad071ef-333f-4eb3-a211-690a174bf23f\") " pod="openshift-dns/node-resolver-qt79p"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882879    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23233e46-0dc1-48f4-a8d0-81f853fdbf12-iptables-alerter-script\") pod \"iptables-alerter-5fs2q\" (UID: \"23233e46-0dc1-48f4-a8d0-81f853fdbf12\") " pod="openshift-network-operator/iptables-alerter-5fs2q"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882954    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-device-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.882982    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-cni-binary-copy\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883009    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-host\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883039    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t96nw\" (UniqueName: \"kubernetes.io/projected/9dfe2db7-aff1-41b8-a3c0-36575eee0515-kube-api-access-t96nw\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883063    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-slash\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.883114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883088    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-run-netns\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883116    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-var-lib-kubelet\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883138    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6164d09-c086-489d-9020-0b035e79d421-multus-daemon-config\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883154    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-sysctl-d\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883168    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ad071ef-333f-4eb3-a211-690a174bf23f-hosts-file\") pod \"node-resolver-qt79p\" (UID: \"8ad071ef-333f-4eb3-a211-690a174bf23f\") " pod="openshift-dns/node-resolver-qt79p"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883176    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-var-lib-kubelet\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883183    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-node-log\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883246    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13809022-91df-4661-99cc-5352dc510c27-env-overrides\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883266    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6164d09-c086-489d-9020-0b035e79d421-cni-binary-copy\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883268    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-sysconfig\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883309    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883336    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13809022-91df-4661-99cc-5352dc510c27-ovnkube-config\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883357    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-run-k8s-cni-cncf-io\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883380    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13809022-91df-4661-99cc-5352dc510c27-ovnkube-script-lib\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883413    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-run-k8s-cni-cncf-io\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883444    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a0981c28-3980-47f7-a24d-52f31707a907-konnectivity-ca\") pod \"konnectivity-agent-xtwsp\" (UID: \"a0981c28-3980-47f7-a24d-52f31707a907\") " pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:01.884058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883476    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-multus-conf-dir\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883513    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-multus-conf-dir\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883538    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23233e46-0dc1-48f4-a8d0-81f853fdbf12-host-slash\") pod \"iptables-alerter-5fs2q\" (UID: \"23233e46-0dc1-48f4-a8d0-81f853fdbf12\") " pod="openshift-network-operator/iptables-alerter-5fs2q"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-lib-modules\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883604    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23233e46-0dc1-48f4-a8d0-81f853fdbf12-host-slash\") pod \"iptables-alerter-5fs2q\" (UID: \"23233e46-0dc1-48f4-a8d0-81f853fdbf12\") " pod="openshift-network-operator/iptables-alerter-5fs2q"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883602    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn2d2\" (UniqueName: \"kubernetes.io/projected/d54a67aa-9f30-48b1-a625-895474ad38ae-kube-api-access-xn2d2\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883669    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1932344-9198-44d7-a765-aa52cd8d5a6f-serviceca\") pod \"node-ca-bdl5b\" (UID: \"d1932344-9198-44d7-a765-aa52cd8d5a6f\") " pod="openshift-image-registry/node-ca-bdl5b"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883696    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnpk5\" (UniqueName: \"kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5\") pod \"network-check-target-c4vjz\" (UID: \"447050b1-de0a-47f2-9b0f-e474f71aa8e4\") " pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883725    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883750    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-cnibin\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883776    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883805    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qffd5\" (UniqueName: \"kubernetes.io/projected/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-kube-api-access-qffd5\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883829    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-run-ovn-kubernetes\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883856    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4xm5\" (UniqueName: \"kubernetes.io/projected/13809022-91df-4661-99cc-5352dc510c27-kube-api-access-m4xm5\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883880    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-sysctl-conf\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883904    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-systemd\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.884588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883927    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-cni-bin\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883952    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13809022-91df-4661-99cc-5352dc510c27-ovn-node-metrics-cert\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.883977    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a0981c28-3980-47f7-a24d-52f31707a907-agent-certs\") pod \"konnectivity-agent-xtwsp\" (UID: \"a0981c28-3980-47f7-a24d-52f31707a907\") " pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884002    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-sys-fs\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884032    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bfcec937-90de-47bc-a648-6144b1c324fd-kubelet-config\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884064    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-system-cni-dir\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884097    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-var-lib-cni-multus\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884119    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6164d09-c086-489d-9020-0b035e79d421-multus-daemon-config\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884135    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-var-lib-cni-multus\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884160    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-system-cni-dir\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884167    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-run-multus-certs\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884189    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-run-multus-certs\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884193    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-modprobe-d\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884210    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884228    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-etc-openvswitch\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884243    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-log-socket\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884257    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bfcec937-90de-47bc-a648-6144b1c324fd-dbus\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:01.885074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884294    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-hostroot\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885568 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884309    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-run\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.885568 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884322    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54a67aa-9f30-48b1-a625-895474ad38ae-tmp\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.885568 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884337    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-run-netns\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885568 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884353    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-var-lib-cni-bin\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885568 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884365    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-hostroot\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885568 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884434    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-var-lib-cni-bin\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.885568 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.884470    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6164d09-c086-489d-9020-0b035e79d421-host-run-netns\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.892377 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.892354    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 15:09:01.896309 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.896179    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w6c5\" (UniqueName: \"kubernetes.io/projected/23233e46-0dc1-48f4-a8d0-81f853fdbf12-kube-api-access-6w6c5\") pod \"iptables-alerter-5fs2q\" (UID: \"23233e46-0dc1-48f4-a8d0-81f853fdbf12\") " pod="openshift-network-operator/iptables-alerter-5fs2q"
Sep 08 15:09:01.896660 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.896643    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddm26\" (UniqueName: \"kubernetes.io/projected/e6164d09-c086-489d-9020-0b035e79d421-kube-api-access-ddm26\") pod \"multus-mp72c\" (UID: \"e6164d09-c086-489d-9020-0b035e79d421\") " pod="openshift-multus/multus-mp72c"
Sep 08 15:09:01.913584 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.913528    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-20.ec2.internal" event={"ID":"c7e569458af07a6378339a74ece7e2b0","Type":"ContainerStarted","Data":"45460716d23809b20ec6dc19a12ed72a96df3968d81ff42b7d683adb73d6d6fc"}
Sep 08 15:09:01.984690 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984626    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-var-lib-kubelet\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.984690 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984683    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.984940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984708    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.984940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984733    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-socket-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.984940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984779    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-var-lib-kubelet\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.984940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984777    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.984940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984801    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.984940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984850    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stbkt\" (UniqueName: \"kubernetes.io/projected/9140e370-2ac6-4555-9ecb-05e4d2550cd6-kube-api-access-stbkt\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.984940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984872    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1932344-9198-44d7-a765-aa52cd8d5a6f-host\") pod \"node-ca-bdl5b\" (UID: \"d1932344-9198-44d7-a765-aa52cd8d5a6f\") " pod="openshift-image-registry/node-ca-bdl5b"
Sep 08 15:09:01.984940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-var-lib-openvswitch\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.984940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984913    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-etc-selinux\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.984940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984931    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-socket-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984940    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnv5\" (UniqueName: \"kubernetes.io/projected/d1932344-9198-44d7-a765-aa52cd8d5a6f-kube-api-access-wcnv5\") pod \"node-ca-bdl5b\" (UID: \"d1932344-9198-44d7-a765-aa52cd8d5a6f\") " pod="openshift-image-registry/node-ca-bdl5b"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984959    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1932344-9198-44d7-a765-aa52cd8d5a6f-host\") pod \"node-ca-bdl5b\" (UID: \"d1932344-9198-44d7-a765-aa52cd8d5a6f\") " pod="openshift-image-registry/node-ca-bdl5b"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984976    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ad071ef-333f-4eb3-a211-690a174bf23f-tmp-dir\") pod \"node-resolver-qt79p\" (UID: \"8ad071ef-333f-4eb3-a211-690a174bf23f\") " pod="openshift-dns/node-resolver-qt79p"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.984949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-var-lib-openvswitch\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985000    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-device-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985024    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-cni-binary-copy\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985047    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-host\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t96nw\" (UniqueName: \"kubernetes.io/projected/9dfe2db7-aff1-41b8-a3c0-36575eee0515-kube-api-access-t96nw\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985047    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-etc-selinux\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985099    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-slash\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985112    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-host\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985124    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-run-netns\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985157    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-run-netns\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985162    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-sysctl-d\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985155    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-slash\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985088    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-device-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.985416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985190    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ad071ef-333f-4eb3-a211-690a174bf23f-hosts-file\") pod \"node-resolver-qt79p\" (UID: \"8ad071ef-333f-4eb3-a211-690a174bf23f\") " pod="openshift-dns/node-resolver-qt79p"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985243    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-node-log\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985266    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13809022-91df-4661-99cc-5352dc510c27-env-overrides\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985291    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-sysconfig\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985296    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ad071ef-333f-4eb3-a211-690a174bf23f-hosts-file\") pod \"node-resolver-qt79p\" (UID: \"8ad071ef-333f-4eb3-a211-690a174bf23f\") " pod="openshift-dns/node-resolver-qt79p"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985298    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-node-log\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985299    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ad071ef-333f-4eb3-a211-690a174bf23f-tmp-dir\") pod \"node-resolver-qt79p\" (UID: \"8ad071ef-333f-4eb3-a211-690a174bf23f\") " pod="openshift-dns/node-resolver-qt79p"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:01.985350    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985378    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985342    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-sysconfig\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985309    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-sysctl-d\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:01.985428    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs podName:9dfe2db7-aff1-41b8-a3c0-36575eee0515 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:02.485401799 +0000 UTC m=+3.056947846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs") pod "network-metrics-daemon-fn4w2" (UID: "9dfe2db7-aff1-41b8-a3c0-36575eee0515") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985471    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13809022-91df-4661-99cc-5352dc510c27-ovnkube-config\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985510    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13809022-91df-4661-99cc-5352dc510c27-ovnkube-script-lib\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985538    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a0981c28-3980-47f7-a24d-52f31707a907-konnectivity-ca\") pod \"konnectivity-agent-xtwsp\" (UID: \"a0981c28-3980-47f7-a24d-52f31707a907\") " pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985568    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-lib-modules\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.986290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985594    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn2d2\" (UniqueName: \"kubernetes.io/projected/d54a67aa-9f30-48b1-a625-895474ad38ae-kube-api-access-xn2d2\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985620    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1932344-9198-44d7-a765-aa52cd8d5a6f-serviceca\") pod \"node-ca-bdl5b\" (UID: \"d1932344-9198-44d7-a765-aa52cd8d5a6f\") " pod="openshift-image-registry/node-ca-bdl5b"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985669    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpk5\" (UniqueName: \"kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5\") pod \"network-check-target-c4vjz\" (UID: \"447050b1-de0a-47f2-9b0f-e474f71aa8e4\") " pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985697    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985723    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-cnibin\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985755    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985786    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qffd5\" (UniqueName: \"kubernetes.io/projected/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-kube-api-access-qffd5\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985815    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-run-ovn-kubernetes\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985841    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4xm5\" (UniqueName: \"kubernetes.io/projected/13809022-91df-4661-99cc-5352dc510c27-kube-api-access-m4xm5\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985867    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-sysctl-conf\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985884    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13809022-91df-4661-99cc-5352dc510c27-env-overrides\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985894    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-systemd\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985920    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-cni-bin\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985947    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13809022-91df-4661-99cc-5352dc510c27-ovn-node-metrics-cert\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.985975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a0981c28-3980-47f7-a24d-52f31707a907-agent-certs\") pod \"konnectivity-agent-xtwsp\" (UID: \"a0981c28-3980-47f7-a24d-52f31707a907\") " pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986003    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-sys-fs\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986028    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bfcec937-90de-47bc-a648-6144b1c324fd-kubelet-config\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:01.987251 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986054    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13809022-91df-4661-99cc-5352dc510c27-ovnkube-config\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986059    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-modprobe-d\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986087    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986113    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-etc-openvswitch\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986138    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-log-socket\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986163    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bfcec937-90de-47bc-a648-6144b1c324fd-dbus\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986191    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-run\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986209    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a0981c28-3980-47f7-a24d-52f31707a907-konnectivity-ca\") pod \"konnectivity-agent-xtwsp\" (UID: \"a0981c28-3980-47f7-a24d-52f31707a907\") " pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986220    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54a67aa-9f30-48b1-a625-895474ad38ae-tmp\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986224    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-cni-binary-copy\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986271    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-cni-bin\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986280    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1932344-9198-44d7-a765-aa52cd8d5a6f-serviceca\") pod \"node-ca-bdl5b\" (UID: \"d1932344-9198-44d7-a765-aa52cd8d5a6f\") " pod="openshift-image-registry/node-ca-bdl5b"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986290    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-kubernetes\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986306    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13809022-91df-4661-99cc-5352dc510c27-ovnkube-script-lib\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986317    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-kubernetes\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986342    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-sys\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986396    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-systemd\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986405    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-modprobe-d\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.988346 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:01.986505    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986518    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-log-socket\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:01.986613    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret podName:bfcec937-90de-47bc-a648-6144b1c324fd nodeName:}" failed. No retries permitted until 2026-09-08 15:09:02.486597877 +0000 UTC m=+3.058143898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret") pod "global-pull-secret-syncer-lpf2t" (UID: "bfcec937-90de-47bc-a648-6144b1c324fd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986634    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-run-ovn-kubernetes\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986652    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bfcec937-90de-47bc-a648-6144b1c324fd-dbus\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986688    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986689    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986717    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-sys-fs\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986730    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-run\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986736    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-lib-modules\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986760    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-etc-openvswitch\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986843    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-sysctl-conf\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986883    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54a67aa-9f30-48b1-a625-895474ad38ae-sys\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986884    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bfcec937-90de-47bc-a648-6144b1c324fd-kubelet-config\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986884    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-cnibin\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986938    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-systemd-units\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986967    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-run-systemd\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.986992    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-run-ovn\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987020    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-cni-netd\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987023    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-systemd-units\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987047    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-run-systemd\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-registration-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987075    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-cni-netd\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987110    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-run-ovn\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987132    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9140e370-2ac6-4555-9ecb-05e4d2550cd6-registration-dir\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987145    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-tuned\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987181    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-system-cni-dir\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987396    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgxkm\" (UniqueName: \"kubernetes.io/projected/8ad071ef-333f-4eb3-a211-690a174bf23f-kube-api-access-qgxkm\") pod \"node-resolver-qt79p\" (UID: \"8ad071ef-333f-4eb3-a211-690a174bf23f\") " pod="openshift-dns/node-resolver-qt79p"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-kubelet\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987386    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987394    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-system-cni-dir\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987564    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-host-kubelet\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987651    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-run-openvswitch\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.987676    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13809022-91df-4661-99cc-5352dc510c27-run-openvswitch\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.989808 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.989142    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13809022-91df-4661-99cc-5352dc510c27-ovn-node-metrics-cert\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.990313 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.989146    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54a67aa-9f30-48b1-a625-895474ad38ae-tmp\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.990313 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.989450    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d54a67aa-9f30-48b1-a625-895474ad38ae-etc-tuned\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.990313 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.989565    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a0981c28-3980-47f7-a24d-52f31707a907-agent-certs\") pod \"konnectivity-agent-xtwsp\" (UID: \"a0981c28-3980-47f7-a24d-52f31707a907\") " pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:01.994929 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:01.994904    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:09:01.994929 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:01.994932    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:09:01.995106 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:01.994946    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wnpk5 for pod openshift-network-diagnostics/network-check-target-c4vjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:01.995106 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:01.995032    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5 podName:447050b1-de0a-47f2-9b0f-e474f71aa8e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:02.495012539 +0000 UTC m=+3.066558583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wnpk5" (UniqueName: "kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5") pod "network-check-target-c4vjz" (UID: "447050b1-de0a-47f2-9b0f-e474f71aa8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:01.995909 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.995879    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcnv5\" (UniqueName: \"kubernetes.io/projected/d1932344-9198-44d7-a765-aa52cd8d5a6f-kube-api-access-wcnv5\") pod \"node-ca-bdl5b\" (UID: \"d1932344-9198-44d7-a765-aa52cd8d5a6f\") " pod="openshift-image-registry/node-ca-bdl5b"
Sep 08 15:09:01.996393 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.996346    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stbkt\" (UniqueName: \"kubernetes.io/projected/9140e370-2ac6-4555-9ecb-05e4d2550cd6-kube-api-access-stbkt\") pod \"aws-ebs-csi-driver-node-hqx8m\" (UID: \"9140e370-2ac6-4555-9ecb-05e4d2550cd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:01.996930 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.996826    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t96nw\" (UniqueName: \"kubernetes.io/projected/9dfe2db7-aff1-41b8-a3c0-36575eee0515-kube-api-access-t96nw\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:01.998374 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.998348    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgxkm\" (UniqueName: \"kubernetes.io/projected/8ad071ef-333f-4eb3-a211-690a174bf23f-kube-api-access-qgxkm\") pod \"node-resolver-qt79p\" (UID: \"8ad071ef-333f-4eb3-a211-690a174bf23f\") " pod="openshift-dns/node-resolver-qt79p"
Sep 08 15:09:01.998610 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.998578    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn2d2\" (UniqueName: \"kubernetes.io/projected/d54a67aa-9f30-48b1-a625-895474ad38ae-kube-api-access-xn2d2\") pod \"tuned-h8xsm\" (UID: \"d54a67aa-9f30-48b1-a625-895474ad38ae\") " pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:01.998771 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.998755    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4xm5\" (UniqueName: \"kubernetes.io/projected/13809022-91df-4661-99cc-5352dc510c27-kube-api-access-m4xm5\") pod \"ovnkube-node-gp6wz\" (UID: \"13809022-91df-4661-99cc-5352dc510c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:01.998902 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:01.998882    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qffd5\" (UniqueName: \"kubernetes.io/projected/42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745-kube-api-access-qffd5\") pod \"multus-additional-cni-plugins-8984m\" (UID: \"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745\") " pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:02.077915 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.077884    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mp72c"
Sep 08 15:09:02.085816 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.085790    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5fs2q"
Sep 08 15:09:02.089836 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:02.089808    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6164d09_c086_489d_9020_0b035e79d421.slice/crio-4682e59960c7889cb26053336e5a177d0371477262bba02dac9481daaab5728c WatchSource:0}: Error finding container 4682e59960c7889cb26053336e5a177d0371477262bba02dac9481daaab5728c: Status 404 returned error can't find the container with id 4682e59960c7889cb26053336e5a177d0371477262bba02dac9481daaab5728c
Sep 08 15:09:02.095083 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.095064    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:02.095533 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:02.095514    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23233e46_0dc1_48f4_a8d0_81f853fdbf12.slice/crio-da4e6f0434aa3436f3f3f29317119919a194a078c54bdc982376327d9fe41a15 WatchSource:0}: Error finding container da4e6f0434aa3436f3f3f29317119919a194a078c54bdc982376327d9fe41a15: Status 404 returned error can't find the container with id da4e6f0434aa3436f3f3f29317119919a194a078c54bdc982376327d9fe41a15
Sep 08 15:09:02.101281 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.101258    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m"
Sep 08 15:09:02.105068 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.105043    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qt79p"
Sep 08 15:09:02.105154 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:02.105109    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0981c28_3980_47f7_a24d_52f31707a907.slice/crio-5ecc4a1855e63c1d4db0649a0667c89d6490fd9e1ba801e5dd3146602fbebce4 WatchSource:0}: Error finding container 5ecc4a1855e63c1d4db0649a0667c89d6490fd9e1ba801e5dd3146602fbebce4: Status 404 returned error can't find the container with id 5ecc4a1855e63c1d4db0649a0667c89d6490fd9e1ba801e5dd3146602fbebce4
Sep 08 15:09:02.111747 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.111700    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:02.112539 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:02.112519    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9140e370_2ac6_4555_9ecb_05e4d2550cd6.slice/crio-a1276a1e7d259e1898404d9e65aa8991fe1ddce9de1d8b0e5d1bf2b00a7a4996 WatchSource:0}: Error finding container a1276a1e7d259e1898404d9e65aa8991fe1ddce9de1d8b0e5d1bf2b00a7a4996: Status 404 returned error can't find the container with id a1276a1e7d259e1898404d9e65aa8991fe1ddce9de1d8b0e5d1bf2b00a7a4996
Sep 08 15:09:02.115875 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:02.115854    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad071ef_333f_4eb3_a211_690a174bf23f.slice/crio-0bfdf4ece13c0d018e90ce3c3169c7d9d2a185ccc055f70b05e6ff954f402539 WatchSource:0}: Error finding container 0bfdf4ece13c0d018e90ce3c3169c7d9d2a185ccc055f70b05e6ff954f402539: Status 404 returned error can't find the container with id 0bfdf4ece13c0d018e90ce3c3169c7d9d2a185ccc055f70b05e6ff954f402539
Sep 08 15:09:02.116895 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.116876    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8xsm"
Sep 08 15:09:02.123650 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.123628    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bdl5b"
Sep 08 15:09:02.124103 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:02.124083    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13809022_91df_4661_99cc_5352dc510c27.slice/crio-822b54a1fdb67ee571a8cb9e6c77d5797a670511cfbb4a85ecf51896d286df27 WatchSource:0}: Error finding container 822b54a1fdb67ee571a8cb9e6c77d5797a670511cfbb4a85ecf51896d286df27: Status 404 returned error can't find the container with id 822b54a1fdb67ee571a8cb9e6c77d5797a670511cfbb4a85ecf51896d286df27
Sep 08 15:09:02.127820 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.127784    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8984m"
Sep 08 15:09:02.129398 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:02.129376    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54a67aa_9f30_48b1_a625_895474ad38ae.slice/crio-1359972ac1123e04a8c27702cf89d97b32e5da830445bb4c06ac108cf6af1135 WatchSource:0}: Error finding container 1359972ac1123e04a8c27702cf89d97b32e5da830445bb4c06ac108cf6af1135: Status 404 returned error can't find the container with id 1359972ac1123e04a8c27702cf89d97b32e5da830445bb4c06ac108cf6af1135
Sep 08 15:09:02.135039 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:02.135018    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1932344_9198_44d7_a765_aa52cd8d5a6f.slice/crio-f715df36b6ac1b9115d0d5a75f01775d374486029eaa2c97e0b46b2b87c3da56 WatchSource:0}: Error finding container f715df36b6ac1b9115d0d5a75f01775d374486029eaa2c97e0b46b2b87c3da56: Status 404 returned error can't find the container with id f715df36b6ac1b9115d0d5a75f01775d374486029eaa2c97e0b46b2b87c3da56
Sep 08 15:09:02.138293 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:02.138269    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e9e6c7_8a07_4f8a_b81e_f28d3c8ae745.slice/crio-6be407ef3b56940846a1c9eb858d5b31d6e2baae69b1ec39fc7ee52fdad82ff5 WatchSource:0}: Error finding container 6be407ef3b56940846a1c9eb858d5b31d6e2baae69b1ec39fc7ee52fdad82ff5: Status 404 returned error can't find the container with id 6be407ef3b56940846a1c9eb858d5b31d6e2baae69b1ec39fc7ee52fdad82ff5
Sep 08 15:09:02.491520 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.491417    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:02.491520 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.491478    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:02.491780 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:02.491577    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:02.491780 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:02.491580    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:02.491780 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:02.491633    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret podName:bfcec937-90de-47bc-a648-6144b1c324fd nodeName:}" failed. No retries permitted until 2026-09-08 15:09:03.491619982 +0000 UTC m=+4.063166003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret") pod "global-pull-secret-syncer-lpf2t" (UID: "bfcec937-90de-47bc-a648-6144b1c324fd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:02.491780 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:02.491662    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs podName:9dfe2db7-aff1-41b8-a3c0-36575eee0515 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:03.491648536 +0000 UTC m=+4.063194571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs") pod "network-metrics-daemon-fn4w2" (UID: "9dfe2db7-aff1-41b8-a3c0-36575eee0515") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:02.592452 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.592410    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpk5\" (UniqueName: \"kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5\") pod \"network-check-target-c4vjz\" (UID: \"447050b1-de0a-47f2-9b0f-e474f71aa8e4\") " pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:02.592657 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:02.592618    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:09:02.592702 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:02.592662    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:09:02.592702 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:02.592675    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wnpk5 for pod openshift-network-diagnostics/network-check-target-c4vjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:02.592767 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:02.592734    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5 podName:447050b1-de0a-47f2-9b0f-e474f71aa8e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:03.592719231 +0000 UTC m=+4.164265256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnpk5" (UniqueName: "kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5") pod "network-check-target-c4vjz" (UID: "447050b1-de0a-47f2-9b0f-e474f71aa8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:02.816042 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:02.816001    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a7780455fba34453c0790784df5218.slice/crio-b78a656e8425c808ddf6bbbe1bc6e7526c2507d2d8499dee23d0978637ec3829 WatchSource:0}: Error finding container b78a656e8425c808ddf6bbbe1bc6e7526c2507d2d8499dee23d0978637ec3829: Status 404 returned error can't find the container with id b78a656e8425c808ddf6bbbe1bc6e7526c2507d2d8499dee23d0978637ec3829
Sep 08 15:09:02.820981 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.820926    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 15:04:02 +0000 UTC" deadline="2028-05-23 20:53:23.651388442 +0000 UTC"
Sep 08 15:09:02.821077 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.820982    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14957h44m20.830410373s"
Sep 08 15:09:02.909060 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.908517    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:02.909060 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:02.908679    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:02.918074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.917979    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8984m" event={"ID":"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745","Type":"ContainerStarted","Data":"6be407ef3b56940846a1c9eb858d5b31d6e2baae69b1ec39fc7ee52fdad82ff5"}
Sep 08 15:09:02.921442 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.921395    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bdl5b" event={"ID":"d1932344-9198-44d7-a765-aa52cd8d5a6f","Type":"ContainerStarted","Data":"f715df36b6ac1b9115d0d5a75f01775d374486029eaa2c97e0b46b2b87c3da56"}
Sep 08 15:09:02.923197 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.923165    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz" event={"ID":"13809022-91df-4661-99cc-5352dc510c27","Type":"ContainerStarted","Data":"822b54a1fdb67ee571a8cb9e6c77d5797a670511cfbb4a85ecf51896d286df27"}
Sep 08 15:09:02.925579 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.925548    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m" event={"ID":"9140e370-2ac6-4555-9ecb-05e4d2550cd6","Type":"ContainerStarted","Data":"a1276a1e7d259e1898404d9e65aa8991fe1ddce9de1d8b0e5d1bf2b00a7a4996"}
Sep 08 15:09:02.927245 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.927217    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xtwsp" event={"ID":"a0981c28-3980-47f7-a24d-52f31707a907","Type":"ContainerStarted","Data":"5ecc4a1855e63c1d4db0649a0667c89d6490fd9e1ba801e5dd3146602fbebce4"}
Sep 08 15:09:02.929263 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.929213    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal" event={"ID":"67a7780455fba34453c0790784df5218","Type":"ContainerStarted","Data":"b78a656e8425c808ddf6bbbe1bc6e7526c2507d2d8499dee23d0978637ec3829"}
Sep 08 15:09:02.931227 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.931163    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8xsm" event={"ID":"d54a67aa-9f30-48b1-a625-895474ad38ae","Type":"ContainerStarted","Data":"1359972ac1123e04a8c27702cf89d97b32e5da830445bb4c06ac108cf6af1135"}
Sep 08 15:09:02.934028 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.933967    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qt79p" event={"ID":"8ad071ef-333f-4eb3-a211-690a174bf23f","Type":"ContainerStarted","Data":"0bfdf4ece13c0d018e90ce3c3169c7d9d2a185ccc055f70b05e6ff954f402539"}
Sep 08 15:09:02.936969 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.936932    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5fs2q" event={"ID":"23233e46-0dc1-48f4-a8d0-81f853fdbf12","Type":"ContainerStarted","Data":"da4e6f0434aa3436f3f3f29317119919a194a078c54bdc982376327d9fe41a15"}
Sep 08 15:09:02.938677 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:02.938656    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mp72c" event={"ID":"e6164d09-c086-489d-9020-0b035e79d421","Type":"ContainerStarted","Data":"4682e59960c7889cb26053336e5a177d0371477262bba02dac9481daaab5728c"}
Sep 08 15:09:03.500626 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:03.499829    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:03.500626 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:03.499907    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:03.500626 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:03.500055    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:03.500626 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:03.500119    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret podName:bfcec937-90de-47bc-a648-6144b1c324fd nodeName:}" failed. No retries permitted until 2026-09-08 15:09:05.50010063 +0000 UTC m=+6.071646654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret") pod "global-pull-secret-syncer-lpf2t" (UID: "bfcec937-90de-47bc-a648-6144b1c324fd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:03.500626 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:03.500549    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:03.500626 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:03.500598    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs podName:9dfe2db7-aff1-41b8-a3c0-36575eee0515 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:05.500582896 +0000 UTC m=+6.072128921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs") pod "network-metrics-daemon-fn4w2" (UID: "9dfe2db7-aff1-41b8-a3c0-36575eee0515") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:03.601065 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:03.600377    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpk5\" (UniqueName: \"kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5\") pod \"network-check-target-c4vjz\" (UID: \"447050b1-de0a-47f2-9b0f-e474f71aa8e4\") " pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:03.601065 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:03.600573    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:09:03.601065 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:03.600598    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:09:03.601065 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:03.600613    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wnpk5 for pod openshift-network-diagnostics/network-check-target-c4vjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:03.601065 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:03.600701    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5 podName:447050b1-de0a-47f2-9b0f-e474f71aa8e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:05.600678925 +0000 UTC m=+6.172224964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnpk5" (UniqueName: "kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5") pod "network-check-target-c4vjz" (UID: "447050b1-de0a-47f2-9b0f-e474f71aa8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:03.822253 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:03.822146    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 15:04:02 +0000 UTC" deadline="2028-06-20 04:37:36.063513238 +0000 UTC"
Sep 08 15:09:03.822253 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:03.822197    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15613h28m32.241321859s"
Sep 08 15:09:03.908738 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:03.907909    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:03.908738 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:03.908042    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:03.909225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:03.909039    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:03.909225 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:03.909184    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:04.908163 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:04.908120    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:04.908750 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:04.908258    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:05.517384 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:05.517352    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:05.517564 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:05.517411    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:05.517564 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:05.517518    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:05.517564 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:05.517565    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret podName:bfcec937-90de-47bc-a648-6144b1c324fd nodeName:}" failed. No retries permitted until 2026-09-08 15:09:09.517551596 +0000 UTC m=+10.089097616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret") pod "global-pull-secret-syncer-lpf2t" (UID: "bfcec937-90de-47bc-a648-6144b1c324fd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:05.517925 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:05.517908    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:05.518007 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:05.517952    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs podName:9dfe2db7-aff1-41b8-a3c0-36575eee0515 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:09.517939749 +0000 UTC m=+10.089485769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs") pod "network-metrics-daemon-fn4w2" (UID: "9dfe2db7-aff1-41b8-a3c0-36575eee0515") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:05.618285 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:05.618241    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpk5\" (UniqueName: \"kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5\") pod \"network-check-target-c4vjz\" (UID: \"447050b1-de0a-47f2-9b0f-e474f71aa8e4\") " pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:05.618532 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:05.618469    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:09:05.618532 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:05.618493    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:09:05.618532 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:05.618505    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wnpk5 for pod openshift-network-diagnostics/network-check-target-c4vjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:05.618824 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:05.618562    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5 podName:447050b1-de0a-47f2-9b0f-e474f71aa8e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:09.618543315 +0000 UTC m=+10.190089338 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnpk5" (UniqueName: "kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5") pod "network-check-target-c4vjz" (UID: "447050b1-de0a-47f2-9b0f-e474f71aa8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:05.907914 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:05.907877    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:05.908105 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:05.908024    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:05.908105 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:05.908088    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:05.908229 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:05.908157    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:06.908345 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:06.908312    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:06.908848 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:06.908430    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:07.908722 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:07.908259    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:07.908722 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:07.908368    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:07.909193 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:07.908837    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:07.909193 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:07.908951    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:08.908367 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:08.907888    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:08.908367 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:08.908029    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:09.550329 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:09.550296    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:09.550832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:09.550351    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:09.550832 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:09.550461    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:09.550832 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:09.550466    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:09.550832 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:09.550518    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret podName:bfcec937-90de-47bc-a648-6144b1c324fd nodeName:}" failed. No retries permitted until 2026-09-08 15:09:17.550500311 +0000 UTC m=+18.122046349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret") pod "global-pull-secret-syncer-lpf2t" (UID: "bfcec937-90de-47bc-a648-6144b1c324fd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:09.550832 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:09.550532    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs podName:9dfe2db7-aff1-41b8-a3c0-36575eee0515 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:17.550525548 +0000 UTC m=+18.122071569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs") pod "network-metrics-daemon-fn4w2" (UID: "9dfe2db7-aff1-41b8-a3c0-36575eee0515") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:09.651390 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:09.651357    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpk5\" (UniqueName: \"kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5\") pod \"network-check-target-c4vjz\" (UID: \"447050b1-de0a-47f2-9b0f-e474f71aa8e4\") " pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:09.651574 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:09.651552    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:09:09.651668 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:09.651576    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:09:09.651668 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:09.651590    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wnpk5 for pod openshift-network-diagnostics/network-check-target-c4vjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:09.651668 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:09.651667    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5 podName:447050b1-de0a-47f2-9b0f-e474f71aa8e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:17.651647505 +0000 UTC m=+18.223193531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnpk5" (UniqueName: "kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5") pod "network-check-target-c4vjz" (UID: "447050b1-de0a-47f2-9b0f-e474f71aa8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:09.910370 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:09.910339    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:09.910537 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:09.910457    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:09.910868 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:09.910847    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:09.910986 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:09.910949    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:10.908530 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:10.908494    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:10.908981 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:10.908681    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:11.908870 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:11.908837    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:11.909318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:11.908838    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:11.909318 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:11.908973    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:11.909318 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:11.909038    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:12.908761 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:12.908725    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:12.908920 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:12.908833    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:13.908265 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:13.908225    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:13.908451 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:13.908335    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:13.908451 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:13.908424    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:13.908566 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:13.908543    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:14.908068 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:14.908028    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:14.908458 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:14.908163    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:15.908687 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:15.908649    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:15.909126 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:15.908787    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:15.909126 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:15.908837    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:15.909126 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:15.908936    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:16.908439 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:16.908399    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:16.908708 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:16.908513    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:17.605926 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:17.605889    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:17.605926 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:17.605935    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:17.606320 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:17.606036    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:17.606320 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:17.606037    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:17.606320 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:17.606093    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret podName:bfcec937-90de-47bc-a648-6144b1c324fd nodeName:}" failed. No retries permitted until 2026-09-08 15:09:33.606075861 +0000 UTC m=+34.177621897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret") pod "global-pull-secret-syncer-lpf2t" (UID: "bfcec937-90de-47bc-a648-6144b1c324fd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:17.606320 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:17.606108    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs podName:9dfe2db7-aff1-41b8-a3c0-36575eee0515 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:33.606100315 +0000 UTC m=+34.177646336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs") pod "network-metrics-daemon-fn4w2" (UID: "9dfe2db7-aff1-41b8-a3c0-36575eee0515") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:17.706421 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:17.706392    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpk5\" (UniqueName: \"kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5\") pod \"network-check-target-c4vjz\" (UID: \"447050b1-de0a-47f2-9b0f-e474f71aa8e4\") " pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:17.706571 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:17.706519    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:09:17.706571 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:17.706537    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:09:17.706571 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:17.706545    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wnpk5 for pod openshift-network-diagnostics/network-check-target-c4vjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:17.706690 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:17.706597    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5 podName:447050b1-de0a-47f2-9b0f-e474f71aa8e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:33.706580751 +0000 UTC m=+34.278126772 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnpk5" (UniqueName: "kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5") pod "network-check-target-c4vjz" (UID: "447050b1-de0a-47f2-9b0f-e474f71aa8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:17.907982 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:17.907889    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:17.907982 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:17.907939    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:17.908183 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:17.908025    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:17.908183 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:17.908118    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:18.908119 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:18.908086    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:18.908545 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:18.908207    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:19.908678 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:19.908645    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:19.908678 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:19.908689    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:19.909104 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:19.908757    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:19.909104 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:19.908870    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:20.908533 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:20.908496    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:20.908737 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:20.908609    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:21.908807 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:21.908595    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:21.909268 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:21.908925    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:21.909268 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:21.908725    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:21.909268 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:21.909021    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:22.047583 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:22.047512    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h8xsm" podStartSLOduration=2.332684909 podStartE2EDuration="22.047491081s" totalImagesPullingTime="19.714806172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:22.046940183 +0000 UTC m=+22.618486227" watchObservedRunningTime="2026-09-08 15:09:22.047491081 +0000 UTC m=+22.619037123"
Sep 08 15:09:22.908493 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:22.908454    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:22.908672 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:22.908595    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:23.026920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.026885    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8xsm" event={"ID":"d54a67aa-9f30-48b1-a625-895474ad38ae","Type":"ContainerStarted","Data":"d10e2feae1b3d5df9e52d700edc0ea74ead1076df0dd9485c9c92901617d4fbc"}
Sep 08 15:09:23.028323 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.028300    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qt79p" event={"ID":"8ad071ef-333f-4eb3-a211-690a174bf23f","Type":"ContainerStarted","Data":"7ffa3035f6bb53590723ba0b34eff4bfc6649e37188c45b0bb15ead56864a0ae"}
Sep 08 15:09:23.029758 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.029734    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mp72c" event={"ID":"e6164d09-c086-489d-9020-0b035e79d421","Type":"ContainerStarted","Data":"4d46842994c2019f7dd3d0666b3f1fce217519e2c42ad4dea2adf3a1d328e586"}
Sep 08 15:09:23.031125 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.031087    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-20.ec2.internal" event={"ID":"c7e569458af07a6378339a74ece7e2b0","Type":"ContainerStarted","Data":"3047285bb046ff003abcdfde0c88b86602d7365b256fec296737187dd8d3a2f6"}
Sep 08 15:09:23.035113 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.035087    2566 generic.go:356] "Generic (PLEG): container finished" podID="42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745" containerID="eb60369228513c04dfd5d0b429d3ae2f051ea9f30085842ad6e6437c609ac422" exitCode=0
Sep 08 15:09:23.035208 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.035139    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8984m" event={"ID":"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745","Type":"ContainerDied","Data":"eb60369228513c04dfd5d0b429d3ae2f051ea9f30085842ad6e6437c609ac422"}
Sep 08 15:09:23.036762 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.036739    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bdl5b" event={"ID":"d1932344-9198-44d7-a765-aa52cd8d5a6f","Type":"ContainerStarted","Data":"6eec106c13a6c2e782feccf5c69335b4c7862997b9aefb2978e8a0cc406b97f9"}
Sep 08 15:09:23.039863 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.039845    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz" event={"ID":"13809022-91df-4661-99cc-5352dc510c27","Type":"ContainerStarted","Data":"1e155a5a3ca05d2b665573e442b71f02b75c040d3a2b7c0901c8fe2d7a10666a"}
Sep 08 15:09:23.039951 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.039905    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz" event={"ID":"13809022-91df-4661-99cc-5352dc510c27","Type":"ContainerStarted","Data":"b66be585b6eed30efafdf8b0896ec802e2f76a2a7e8300ef75637a61934626a1"}
Sep 08 15:09:23.039951 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.039945    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz" event={"ID":"13809022-91df-4661-99cc-5352dc510c27","Type":"ContainerStarted","Data":"49cd416e3bd1699f5aaa577551f578596835eabe7fe366ec3403f55d9e717fe8"}
Sep 08 15:09:23.040028 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.039978    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz" event={"ID":"13809022-91df-4661-99cc-5352dc510c27","Type":"ContainerStarted","Data":"53377e2215c3decf5205fe85050eaf913cef242e14e25bb01dece8da24f092f5"}
Sep 08 15:09:23.040028 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.040006    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz" event={"ID":"13809022-91df-4661-99cc-5352dc510c27","Type":"ContainerStarted","Data":"e8ac627d9c6116b11b0c6ca0e6e20d436b13406169951f2ed111387d081abfdf"}
Sep 08 15:09:23.040096 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.040031    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz" event={"ID":"13809022-91df-4661-99cc-5352dc510c27","Type":"ContainerStarted","Data":"365d9b19274adb715eac42e5e69ff132e29f975da5b4eeb5bffd19e21da0fbd7"}
Sep 08 15:09:23.041174 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.041158    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m" event={"ID":"9140e370-2ac6-4555-9ecb-05e4d2550cd6","Type":"ContainerStarted","Data":"0f53e8ae5d9e623847660a97329ca492597bae774a8ad5b1a45e0853495b2526"}
Sep 08 15:09:23.042556 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.042533    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xtwsp" event={"ID":"a0981c28-3980-47f7-a24d-52f31707a907","Type":"ContainerStarted","Data":"8201b52674941277e43b1318259bd242ff8d79e67e7358d119f8dc76c8baa04e"}
Sep 08 15:09:23.043990 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.043972    2566 generic.go:356] "Generic (PLEG): container finished" podID="67a7780455fba34453c0790784df5218" containerID="7fff31837b1913b4c0fa6c0c45452dfc1aebc852c825c4b7da2b3bf8a74eac2a" exitCode=0
Sep 08 15:09:23.044071 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.043996    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal" event={"ID":"67a7780455fba34453c0790784df5218","Type":"ContainerDied","Data":"7fff31837b1913b4c0fa6c0c45452dfc1aebc852c825c4b7da2b3bf8a74eac2a"}
Sep 08 15:09:23.053780 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.053741    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qt79p" podStartSLOduration=3.319053941 podStartE2EDuration="23.053728535s" totalImagesPullingTime="19.734674594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:23.053326665 +0000 UTC m=+23.624872707" watchObservedRunningTime="2026-09-08 15:09:23.053728535 +0000 UTC m=+23.625274576"
Sep 08 15:09:23.074761 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.074723    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mp72c" podStartSLOduration=3.270311082 podStartE2EDuration="23.07470927s" totalImagesPullingTime="19.804398188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:23.074343016 +0000 UTC m=+23.645889058" watchObservedRunningTime="2026-09-08 15:09:23.07470927 +0000 UTC m=+23.646255313"
Sep 08 15:09:23.098585 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.098527    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xtwsp" podStartSLOduration=7.643231936 podStartE2EDuration="23.098505695s" totalImagesPullingTime="15.455273759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:23.097451629 +0000 UTC m=+23.668997671" watchObservedRunningTime="2026-09-08 15:09:23.098505695 +0000 UTC m=+23.670051733"
Sep 08 15:09:23.145572 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.145478    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bdl5b" podStartSLOduration=3.442322901 podStartE2EDuration="23.145461961s" totalImagesPullingTime="19.70313906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:23.117307835 +0000 UTC m=+23.688853876" watchObservedRunningTime="2026-09-08 15:09:23.145461961 +0000 UTC m=+23.717008005"
Sep 08 15:09:23.191525 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.191471    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-20.ec2.internal" podStartSLOduration=22.191454827 podStartE2EDuration="22.191454827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:23.1893998 +0000 UTC m=+23.760945841" watchObservedRunningTime="2026-09-08 15:09:23.191454827 +0000 UTC m=+23.763000868"
Sep 08 15:09:23.564959 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.564809    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 15:09:23.850150 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.850042    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T15:09:23.564953823Z","UUID":"c01f4f33-c0ef-43df-b4dc-6373f645dcc3","Handler":null,"Name":"","Endpoint":""}
Sep 08 15:09:23.851743 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.851723    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 15:09:23.851865 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.851769    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 15:09:23.908059 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.908025    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:23.908237 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:23.908025    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:23.908237 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:23.908176    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:23.908332 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:23.908238    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:24.048971 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:24.048926    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m" event={"ID":"9140e370-2ac6-4555-9ecb-05e4d2550cd6","Type":"ContainerStarted","Data":"f3888200bd37cc50c0ad213359393af198b540cbdef00bd7c7d1049b825e329c"}
Sep 08 15:09:24.051262 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:24.051217    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal" event={"ID":"67a7780455fba34453c0790784df5218","Type":"ContainerStarted","Data":"4b87fb06eae7824b2f183371ded6cc7a4475d49401f3c2d46a4465ae776f3620"}
Sep 08 15:09:24.053068 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:24.053037    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5fs2q" event={"ID":"23233e46-0dc1-48f4-a8d0-81f853fdbf12","Type":"ContainerStarted","Data":"d20bd587e3674cbf171b78c3deaa49fe5b9135b3e4aaa538f80b5e9faa1d8e9e"}
Sep 08 15:09:24.078368 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:24.078304    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-20.ec2.internal" podStartSLOduration=23.078284318 podStartE2EDuration="23.078284318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:24.077773842 +0000 UTC m=+24.649319885" watchObservedRunningTime="2026-09-08 15:09:24.078284318 +0000 UTC m=+24.649830361"
Sep 08 15:09:24.099708 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:24.099636    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5fs2q" podStartSLOduration=4.359144436 podStartE2EDuration="24.09960078s" totalImagesPullingTime="19.740456344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:24.099219056 +0000 UTC m=+24.670765099" watchObservedRunningTime="2026-09-08 15:09:24.09960078 +0000 UTC m=+24.671146823"
Sep 08 15:09:24.908644 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:24.908547    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:24.908821 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:24.908678    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:25.058299 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:25.058264    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz" event={"ID":"13809022-91df-4661-99cc-5352dc510c27","Type":"ContainerStarted","Data":"594118821ae3e4fa1a13a71c90ecbe986a867b5dbd010e9e5844858e56600e40"}
Sep 08 15:09:25.060480 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:25.060456    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m" event={"ID":"9140e370-2ac6-4555-9ecb-05e4d2550cd6","Type":"ContainerStarted","Data":"7a54b933cd3d42b4dbabaef55e2d3623066c2b3b39c4db4eb87ec5534b5511f2"}
Sep 08 15:09:25.084275 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:25.084216    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqx8m" podStartSLOduration=3.145013099 podStartE2EDuration="25.084193751s" totalImagesPullingTime="21.939180652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:25.083249538 +0000 UTC m=+25.654795580" watchObservedRunningTime="2026-09-08 15:09:25.084193751 +0000 UTC m=+25.655739796"
Sep 08 15:09:25.908035 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:25.908000    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:25.908212 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:25.908007    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:25.908212 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:25.908137    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:25.908212 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:25.908187    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:26.908125 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:26.908085    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:26.908546 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:26.908226    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:27.303861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:27.303827    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:27.304576 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:27.304552    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:27.908135 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:27.908102    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:27.908567 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:27.908112    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:27.908567 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:27.908224    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:27.908567 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:27.908363    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:28.072029 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:28.071893    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz" event={"ID":"13809022-91df-4661-99cc-5352dc510c27","Type":"ContainerStarted","Data":"23dbcfebdde7fe9670250ccf475d7bcb46ffba7eca7a6cecc20a15c95a2a517c"}
Sep 08 15:09:28.072424 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:28.072301    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:28.073022 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:28.072718    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xtwsp"
Sep 08 15:09:28.104817 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:28.104511    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz" podStartSLOduration=8.335441875 podStartE2EDuration="28.104494661s" totalImagesPullingTime="19.769052786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:28.103317056 +0000 UTC m=+28.674863099" watchObservedRunningTime="2026-09-08 15:09:28.104494661 +0000 UTC m=+28.676040685"
Sep 08 15:09:28.908102 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:28.907919    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:28.908282 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:28.908169    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:29.075322 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.075276    2566 generic.go:356] "Generic (PLEG): container finished" podID="42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745" containerID="1cbf9f4dda840c94cf6789dae9a0f8270ed30ecf15dba38cc031d6f83a00fcfd" exitCode=0
Sep 08 15:09:29.075472 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.075338    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8984m" event={"ID":"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745","Type":"ContainerDied","Data":"1cbf9f4dda840c94cf6789dae9a0f8270ed30ecf15dba38cc031d6f83a00fcfd"}
Sep 08 15:09:29.076123 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.075951    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:29.076123 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.076025    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:29.076123 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.076059    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:29.091346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.091318    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:29.091483 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.091449    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:09:29.909035 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.909005    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:29.909902 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.909070    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:29.909902 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:29.909088    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:29.909902 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:29.909152    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:29.956212 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.956087    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lpf2t"]
Sep 08 15:09:29.959242 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.956279    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:29.959242 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:29.956418    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:29.959242 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.958992    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c4vjz"]
Sep 08 15:09:29.960106 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:29.960083    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fn4w2"]
Sep 08 15:09:30.077950 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:30.077923    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:30.078130 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:30.078003    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:30.078401 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:30.078366    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:30.078478 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:30.078418    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:31.082680 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:31.082478    2566 generic.go:356] "Generic (PLEG): container finished" podID="42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745" containerID="c8350c6c313b8c7543d7b8fd51c07aa3b4cb3dbc2660d9370c38df7710f6e45e" exitCode=0
Sep 08 15:09:31.083049 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:31.082560    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8984m" event={"ID":"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745","Type":"ContainerDied","Data":"c8350c6c313b8c7543d7b8fd51c07aa3b4cb3dbc2660d9370c38df7710f6e45e"}
Sep 08 15:09:31.907885 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:31.907848    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:31.908025 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:31.907892    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:31.908025 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:31.907972    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:31.908025 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:31.907856    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:31.908140 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:31.908079    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:31.908186 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:31.908167    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:33.613575 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:33.613540    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:33.613964 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:33.613591    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:33.613964 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:33.613725    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:33.613964 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:33.613725    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:33.613964 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:33.613792    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs podName:9dfe2db7-aff1-41b8-a3c0-36575eee0515 nodeName:}" failed. No retries permitted until 2026-09-08 15:10:05.613776043 +0000 UTC m=+66.185322062 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs") pod "network-metrics-daemon-fn4w2" (UID: "9dfe2db7-aff1-41b8-a3c0-36575eee0515") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:09:33.613964 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:33.613807    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret podName:bfcec937-90de-47bc-a648-6144b1c324fd nodeName:}" failed. No retries permitted until 2026-09-08 15:10:05.613801473 +0000 UTC m=+66.185347493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret") pod "global-pull-secret-syncer-lpf2t" (UID: "bfcec937-90de-47bc-a648-6144b1c324fd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:09:33.714312 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:33.714222    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpk5\" (UniqueName: \"kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5\") pod \"network-check-target-c4vjz\" (UID: \"447050b1-de0a-47f2-9b0f-e474f71aa8e4\") " pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:33.714456 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:33.714377    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:09:33.714456 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:33.714396    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:09:33.714456 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:33.714405    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wnpk5 for pod openshift-network-diagnostics/network-check-target-c4vjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:33.714456 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:33.714456    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5 podName:447050b1-de0a-47f2-9b0f-e474f71aa8e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:10:05.714442154 +0000 UTC m=+66.285988173 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnpk5" (UniqueName: "kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5") pod "network-check-target-c4vjz" (UID: "447050b1-de0a-47f2-9b0f-e474f71aa8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:09:33.908550 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:33.908513    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:33.908760 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:33.908526    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:33.908760 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:33.908642    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpf2t" podUID="bfcec937-90de-47bc-a648-6144b1c324fd"
Sep 08 15:09:33.908760 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:33.908707    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4vjz" podUID="447050b1-de0a-47f2-9b0f-e474f71aa8e4"
Sep 08 15:09:33.908760 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:33.908739    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:33.908931 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:33.908826    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:09:34.659004 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.658976    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-20.ec2.internal" event="NodeReady"
Sep 08 15:09:34.659390 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.659116    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 15:09:34.743743 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.743707    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xxtfv"]
Sep 08 15:09:34.763872 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.763794    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7vqck"]
Sep 08 15:09:34.764026 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.763935    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:34.767257 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.767231    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cc4mw\""
Sep 08 15:09:34.767457 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.767445    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 15:09:34.767687 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.767674    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 15:09:34.789724 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.789694    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xxtfv"]
Sep 08 15:09:34.789861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.789734    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7vqck"]
Sep 08 15:09:34.789861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.789802    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7vqck"
Sep 08 15:09:34.792818 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.792801    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 15:09:34.792929 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.792827    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 15:09:34.792929 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.792859    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 15:09:34.792929 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.792832    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9rn4v\""
Sep 08 15:09:34.820836 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.820792    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-tmp-dir\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:34.820983 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.820876    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-config-volume\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:34.820983 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.820900    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:34.820983 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.820954    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gzx6\" (UniqueName: \"kubernetes.io/projected/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-kube-api-access-2gzx6\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:34.921970 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.921933    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-config-volume\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:34.922090 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.921974    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:34.922090 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.921995    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gzx6\" (UniqueName: \"kubernetes.io/projected/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-kube-api-access-2gzx6\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:34.922160 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:34.922097    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:09:34.922202 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.922154    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmt95\" (UniqueName: \"kubernetes.io/projected/efc545de-6c87-4145-9400-ea98638bd54f-kube-api-access-rmt95\") pod \"ingress-canary-7vqck\" (UID: \"efc545de-6c87-4145-9400-ea98638bd54f\") " pod="openshift-ingress-canary/ingress-canary-7vqck"
Sep 08 15:09:34.922202 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:34.922171    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls podName:ee258efd-c7f8-422c-8b15-8cb6e9a7b87b nodeName:}" failed. No retries permitted until 2026-09-08 15:09:35.42215549 +0000 UTC m=+35.993701510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls") pod "dns-default-xxtfv" (UID: "ee258efd-c7f8-422c-8b15-8cb6e9a7b87b") : secret "dns-default-metrics-tls" not found
Sep 08 15:09:34.922295 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.922249    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-tmp-dir\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:34.922330 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.922289    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc545de-6c87-4145-9400-ea98638bd54f-cert\") pod \"ingress-canary-7vqck\" (UID: \"efc545de-6c87-4145-9400-ea98638bd54f\") " pod="openshift-ingress-canary/ingress-canary-7vqck"
Sep 08 15:09:34.922568 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.922552    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-tmp-dir\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:34.922760 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.922524    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-config-volume\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:34.936663 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:34.936636    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gzx6\" (UniqueName: \"kubernetes.io/projected/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-kube-api-access-2gzx6\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:35.022848 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.022753    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc545de-6c87-4145-9400-ea98638bd54f-cert\") pod \"ingress-canary-7vqck\" (UID: \"efc545de-6c87-4145-9400-ea98638bd54f\") " pod="openshift-ingress-canary/ingress-canary-7vqck"
Sep 08 15:09:35.022848 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.022826    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmt95\" (UniqueName: \"kubernetes.io/projected/efc545de-6c87-4145-9400-ea98638bd54f-kube-api-access-rmt95\") pod \"ingress-canary-7vqck\" (UID: \"efc545de-6c87-4145-9400-ea98638bd54f\") " pod="openshift-ingress-canary/ingress-canary-7vqck"
Sep 08 15:09:35.025384 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.025359    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc545de-6c87-4145-9400-ea98638bd54f-cert\") pod \"ingress-canary-7vqck\" (UID: \"efc545de-6c87-4145-9400-ea98638bd54f\") " pod="openshift-ingress-canary/ingress-canary-7vqck"
Sep 08 15:09:35.031176 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.031154    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmt95\" (UniqueName: \"kubernetes.io/projected/efc545de-6c87-4145-9400-ea98638bd54f-kube-api-access-rmt95\") pod \"ingress-canary-7vqck\" (UID: \"efc545de-6c87-4145-9400-ea98638bd54f\") " pod="openshift-ingress-canary/ingress-canary-7vqck"
Sep 08 15:09:35.098312 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.098285    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7vqck"
Sep 08 15:09:35.418224 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.418190    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7vqck"]
Sep 08 15:09:35.422534 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:09:35.422510    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc545de_6c87_4145_9400_ea98638bd54f.slice/crio-86a862e4d6c113898d74803c42ba69fd578a8c092d052f6e9470a2e72556a579 WatchSource:0}: Error finding container 86a862e4d6c113898d74803c42ba69fd578a8c092d052f6e9470a2e72556a579: Status 404 returned error can't find the container with id 86a862e4d6c113898d74803c42ba69fd578a8c092d052f6e9470a2e72556a579
Sep 08 15:09:35.424909 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.424817    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:35.424983 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:35.424968    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:09:35.425029 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:35.425022    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls podName:ee258efd-c7f8-422c-8b15-8cb6e9a7b87b nodeName:}" failed. No retries permitted until 2026-09-08 15:09:36.425007637 +0000 UTC m=+36.996553656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls") pod "dns-default-xxtfv" (UID: "ee258efd-c7f8-422c-8b15-8cb6e9a7b87b") : secret "dns-default-metrics-tls" not found
Sep 08 15:09:35.907992 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.907956    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:09:35.908436 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.907960    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:09:35.908436 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.907965    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:09:35.911404 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.911381    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2q2k\""
Sep 08 15:09:35.912639 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.912601    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 15:09:35.912733 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.912658    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lf7xf\""
Sep 08 15:09:35.912733 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.912657    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 15:09:35.912847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.912664    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 15:09:35.912847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:35.912602    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 15:09:36.096238 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:36.096193    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7vqck" event={"ID":"efc545de-6c87-4145-9400-ea98638bd54f","Type":"ContainerStarted","Data":"86a862e4d6c113898d74803c42ba69fd578a8c092d052f6e9470a2e72556a579"}
Sep 08 15:09:36.432812 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:36.432610    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:36.432993 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:36.432760    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:09:36.432993 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:36.432920    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls podName:ee258efd-c7f8-422c-8b15-8cb6e9a7b87b nodeName:}" failed. No retries permitted until 2026-09-08 15:09:38.432902271 +0000 UTC m=+39.004448291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls") pod "dns-default-xxtfv" (UID: "ee258efd-c7f8-422c-8b15-8cb6e9a7b87b") : secret "dns-default-metrics-tls" not found
Sep 08 15:09:37.101214 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:37.101185    2566 generic.go:356] "Generic (PLEG): container finished" podID="42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745" containerID="39c2acee7d6e7f4d1285a007cf28df05a2fc2ec2ae5a8d94cae16e75318cd4bd" exitCode=0
Sep 08 15:09:37.101566 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:37.101247    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8984m" event={"ID":"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745","Type":"ContainerDied","Data":"39c2acee7d6e7f4d1285a007cf28df05a2fc2ec2ae5a8d94cae16e75318cd4bd"}
Sep 08 15:09:38.447634 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:38.447580    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:38.448120 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:38.447755    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:09:38.448120 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:38.447838    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls podName:ee258efd-c7f8-422c-8b15-8cb6e9a7b87b nodeName:}" failed. No retries permitted until 2026-09-08 15:09:42.44781654 +0000 UTC m=+43.019362582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls") pod "dns-default-xxtfv" (UID: "ee258efd-c7f8-422c-8b15-8cb6e9a7b87b") : secret "dns-default-metrics-tls" not found
Sep 08 15:09:42.479954 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:42.479928    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:42.480642 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:42.480091    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:09:42.480642 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:42.480161    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls podName:ee258efd-c7f8-422c-8b15-8cb6e9a7b87b nodeName:}" failed. No retries permitted until 2026-09-08 15:09:50.480141924 +0000 UTC m=+51.051687959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls") pod "dns-default-xxtfv" (UID: "ee258efd-c7f8-422c-8b15-8cb6e9a7b87b") : secret "dns-default-metrics-tls" not found
Sep 08 15:09:43.121507 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:43.121472    2566 generic.go:356] "Generic (PLEG): container finished" podID="42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745" containerID="380b4ce97e78c2c800c03706751fbf231251c2a8154dee642f5a1538bcdf5b49" exitCode=0
Sep 08 15:09:43.121727 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:43.121553    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8984m" event={"ID":"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745","Type":"ContainerDied","Data":"380b4ce97e78c2c800c03706751fbf231251c2a8154dee642f5a1538bcdf5b49"}
Sep 08 15:09:43.123086 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:43.123064    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7vqck" event={"ID":"efc545de-6c87-4145-9400-ea98638bd54f","Type":"ContainerStarted","Data":"2bf4f90355afd667ad246c43d5454fa6724be1d43f5f395bc9ae54865204a017"}
Sep 08 15:09:43.174337 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:43.174290    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7vqck" podStartSLOduration=2.215006063 podStartE2EDuration="9.174272391s" totalImagesPullingTime="6.959266328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:43.173701814 +0000 UTC m=+43.745247857" watchObservedRunningTime="2026-09-08 15:09:43.174272391 +0000 UTC m=+43.745818433"
Sep 08 15:09:44.127923 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:44.127883    2566 generic.go:356] "Generic (PLEG): container finished" podID="42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745" containerID="743f02a61e5403ba434e54612a4f4c50efb9df271920b27123f07c321f41d053" exitCode=0
Sep 08 15:09:44.128271 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:44.127977    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8984m" event={"ID":"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745","Type":"ContainerDied","Data":"743f02a61e5403ba434e54612a4f4c50efb9df271920b27123f07c321f41d053"}
Sep 08 15:09:45.133830 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:45.133796    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8984m" event={"ID":"42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745","Type":"ContainerStarted","Data":"a0c8faebab9bd973e0c395c507aa75e9a2aeaf3574c80434a51a8b59f9415b8e"}
Sep 08 15:09:45.161135 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:45.161050    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8984m" podStartSLOduration=8.283194871 podStartE2EDuration="45.161032759s" totalImagesPullingTime="36.877837888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:45.159834243 +0000 UTC m=+45.731380309" watchObservedRunningTime="2026-09-08 15:09:45.161032759 +0000 UTC m=+45.732578798"
Sep 08 15:09:50.532168 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:09:50.532108    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:09:50.532653 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:50.532236    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:09:50.532653 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:09:50.532291    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls podName:ee258efd-c7f8-422c-8b15-8cb6e9a7b87b nodeName:}" failed. No retries permitted until 2026-09-08 15:10:06.532277884 +0000 UTC m=+67.103823917 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls") pod "dns-default-xxtfv" (UID: "ee258efd-c7f8-422c-8b15-8cb6e9a7b87b") : secret "dns-default-metrics-tls" not found
Sep 08 15:10:01.093634 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:01.093594    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp6wz"
Sep 08 15:10:05.639734 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.639675    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:10:05.640122 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.639758    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:10:05.642719 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.642701    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 15:10:05.642762 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.642730    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 15:10:05.649944 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:10:05.649926    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 15:10:05.650040 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:10:05.649981    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs podName:9dfe2db7-aff1-41b8-a3c0-36575eee0515 nodeName:}" failed. No retries permitted until 2026-09-08 15:11:09.649964881 +0000 UTC m=+130.221510915 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs") pod "network-metrics-daemon-fn4w2" (UID: "9dfe2db7-aff1-41b8-a3c0-36575eee0515") : secret "metrics-daemon-secret" not found
Sep 08 15:10:05.652993 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.652974    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bfcec937-90de-47bc-a648-6144b1c324fd-original-pull-secret\") pod \"global-pull-secret-syncer-lpf2t\" (UID: \"bfcec937-90de-47bc-a648-6144b1c324fd\") " pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:10:05.740539 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.740509    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpk5\" (UniqueName: \"kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5\") pod \"network-check-target-c4vjz\" (UID: \"447050b1-de0a-47f2-9b0f-e474f71aa8e4\") " pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:10:05.744670 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.744651    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 15:10:05.753727 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.753712    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 15:10:05.764500 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.764480    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnpk5\" (UniqueName: \"kubernetes.io/projected/447050b1-de0a-47f2-9b0f-e474f71aa8e4-kube-api-access-wnpk5\") pod \"network-check-target-c4vjz\" (UID: \"447050b1-de0a-47f2-9b0f-e474f71aa8e4\") " pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:10:05.920497 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.920427    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lf7xf\""
Sep 08 15:10:05.927820 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.927807    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:10:05.927901 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:05.927819    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpf2t"
Sep 08 15:10:06.201080 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:06.200991    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lpf2t"]
Sep 08 15:10:06.204475 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:10:06.204443    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfcec937_90de_47bc_a648_6144b1c324fd.slice/crio-8003f3171bca397339611ca8d757fc005a401f2781e8f4e15a270a3278899eac WatchSource:0}: Error finding container 8003f3171bca397339611ca8d757fc005a401f2781e8f4e15a270a3278899eac: Status 404 returned error can't find the container with id 8003f3171bca397339611ca8d757fc005a401f2781e8f4e15a270a3278899eac
Sep 08 15:10:06.206822 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:06.206798    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c4vjz"]
Sep 08 15:10:06.209479 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:10:06.209459    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447050b1_de0a_47f2_9b0f_e474f71aa8e4.slice/crio-c4e584a563982f1e3755535e5363578a13ca236de4ba10c0459a8244e9c4bda9 WatchSource:0}: Error finding container c4e584a563982f1e3755535e5363578a13ca236de4ba10c0459a8244e9c4bda9: Status 404 returned error can't find the container with id c4e584a563982f1e3755535e5363578a13ca236de4ba10c0459a8244e9c4bda9
Sep 08 15:10:06.546374 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:06.546270    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:10:06.546605 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:10:06.546422    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:10:06.546605 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:10:06.546487    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls podName:ee258efd-c7f8-422c-8b15-8cb6e9a7b87b nodeName:}" failed. No retries permitted until 2026-09-08 15:10:38.546471616 +0000 UTC m=+99.118017636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls") pod "dns-default-xxtfv" (UID: "ee258efd-c7f8-422c-8b15-8cb6e9a7b87b") : secret "dns-default-metrics-tls" not found
Sep 08 15:10:07.190163 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:07.190123    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lpf2t" event={"ID":"bfcec937-90de-47bc-a648-6144b1c324fd","Type":"ContainerStarted","Data":"8003f3171bca397339611ca8d757fc005a401f2781e8f4e15a270a3278899eac"}
Sep 08 15:10:07.191109 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:07.191091    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c4vjz" event={"ID":"447050b1-de0a-47f2-9b0f-e474f71aa8e4","Type":"ContainerStarted","Data":"c4e584a563982f1e3755535e5363578a13ca236de4ba10c0459a8244e9c4bda9"}
Sep 08 15:10:10.200462 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:10.200419    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lpf2t" event={"ID":"bfcec937-90de-47bc-a648-6144b1c324fd","Type":"ContainerStarted","Data":"2851dd49481694d8f8c698ded0352b99dae36f9ef40b0985d20df53767b7a94b"}
Sep 08 15:10:14.212532 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:14.212492    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c4vjz" event={"ID":"447050b1-de0a-47f2-9b0f-e474f71aa8e4","Type":"ContainerStarted","Data":"670bcdf888ed86eeb887649b88b11b2de32275c46e2fd21479dd56e682129460"}
Sep 08 15:10:14.212930 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:14.212580    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:10:14.232115 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:14.232069    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c4vjz" podStartSLOduration=66.890822445 podStartE2EDuration="1m14.232055658s" totalImagesPullingTime="7.341233213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:10:14.231638341 +0000 UTC m=+74.803184374" watchObservedRunningTime="2026-09-08 15:10:14.232055658 +0000 UTC m=+74.803601696"
Sep 08 15:10:14.232387 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:14.232366    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lpf2t" podStartSLOduration=70.463951116 podStartE2EDuration="1m14.232360808s" totalImagesPullingTime="3.768409692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:10:10.221738376 +0000 UTC m=+70.793284419" watchObservedRunningTime="2026-09-08 15:10:14.232360808 +0000 UTC m=+74.803906850"
Sep 08 15:10:38.569984 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:38.569850    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:10:38.570454 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:10:38.570026    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:10:38.570454 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:10:38.570094    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls podName:ee258efd-c7f8-422c-8b15-8cb6e9a7b87b nodeName:}" failed. No retries permitted until 2026-09-08 15:11:42.570076869 +0000 UTC m=+163.141622906 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls") pod "dns-default-xxtfv" (UID: "ee258efd-c7f8-422c-8b15-8cb6e9a7b87b") : secret "dns-default-metrics-tls" not found
Sep 08 15:10:45.217202 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:10:45.217167    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c4vjz"
Sep 08 15:11:09.673151 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:11:09.673097    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:11:09.673691 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:11:09.673261    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 15:11:09.673691 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:11:09.673333    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs podName:9dfe2db7-aff1-41b8-a3c0-36575eee0515 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:11.673315242 +0000 UTC m=+252.244861262 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs") pod "network-metrics-daemon-fn4w2" (UID: "9dfe2db7-aff1-41b8-a3c0-36575eee0515") : secret "metrics-daemon-secret" not found
Sep 08 15:11:37.773778 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:11:37.773716    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xxtfv" podUID="ee258efd-c7f8-422c-8b15-8cb6e9a7b87b"
Sep 08 15:11:38.418286 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:11:38.418258    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:11:38.923548 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:11:38.923488    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fn4w2" podUID="9dfe2db7-aff1-41b8-a3c0-36575eee0515"
Sep 08 15:11:42.597920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:11:42.597872    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:11:42.598413 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:11:42.597994    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:11:42.598413 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:11:42.598047    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls podName:ee258efd-c7f8-422c-8b15-8cb6e9a7b87b nodeName:}" failed. No retries permitted until 2026-09-08 15:13:44.598034084 +0000 UTC m=+285.169580103 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls") pod "dns-default-xxtfv" (UID: "ee258efd-c7f8-422c-8b15-8cb6e9a7b87b") : secret "dns-default-metrics-tls" not found
Sep 08 15:11:51.907912 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:11:51.907830    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:12:51.535066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.535027    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"]
Sep 08 15:12:51.540594 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.540569    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"
Sep 08 15:12:51.544216 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.544194    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 08 15:12:51.544356 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.544338    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kzv9d\""
Sep 08 15:12:51.545467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.545445    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:12:51.545572 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.545499    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 08 15:12:51.545572 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.545452    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 08 15:12:51.550252 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.550233    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79d7c5f44b-s56g9"]
Sep 08 15:12:51.551912 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.551895    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.554442 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.554419    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 08 15:12:51.554658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.554643    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9zjch\""
Sep 08 15:12:51.554818 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.554806    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 08 15:12:51.555011 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.554993    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 15:12:51.555083 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.555051    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 08 15:12:51.555215 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.555199    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 08 15:12:51.555939 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.555923    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 15:12:51.560131 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.560112    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"]
Sep 08 15:12:51.578416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.578388    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79d7c5f44b-s56g9"]
Sep 08 15:12:51.598500 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.598470    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"]
Sep 08 15:12:51.600394 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.600372    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-9zwfw"]
Sep 08 15:12:51.600591 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.600491    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:12:51.602149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.602121    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c99dfcbc-wmr48"]
Sep 08 15:12:51.602258 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.602246    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-9zwfw"
Sep 08 15:12:51.603861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.603844    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.609263 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.609239    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 08 15:12:51.609382 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.609287    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:12:51.609382 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.609302    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 08 15:12:51.609689 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.609672    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 15:12:51.610635 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.610601    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 15:12:51.610712 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.610606    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 15:12:51.612282 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.612265    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dz2k5\""
Sep 08 15:12:51.612282 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.612275    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zvsjt\""
Sep 08 15:12:51.614192 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.614174    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2m6vp\""
Sep 08 15:12:51.616704 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.616684    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-9zwfw"]
Sep 08 15:12:51.616801 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.616685    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 15:12:51.623207 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.623187    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"]
Sep 08 15:12:51.631208 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.631174    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c99dfcbc-wmr48"]
Sep 08 15:12:51.666842 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.666811    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.666842 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.666847    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-stats-auth\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.667057 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.666864    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e859424-bb94-453e-8a24-af637d4d2ac7-config\") pod \"service-ca-operator-859f94c4b-kvf74\" (UID: \"4e859424-bb94-453e-8a24-af637d4d2ac7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"
Sep 08 15:12:51.667057 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.666882    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sqk4\" (UniqueName: \"kubernetes.io/projected/4e859424-bb94-453e-8a24-af637d4d2ac7-kube-api-access-7sqk4\") pod \"service-ca-operator-859f94c4b-kvf74\" (UID: \"4e859424-bb94-453e-8a24-af637d4d2ac7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"
Sep 08 15:12:51.667057 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.666979    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.667057 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.667002    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-default-certificate\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.667057 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.667019    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8rvv\" (UniqueName: \"kubernetes.io/projected/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-kube-api-access-q8rvv\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.667201 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.667062    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e859424-bb94-453e-8a24-af637d4d2ac7-serving-cert\") pod \"service-ca-operator-859f94c4b-kvf74\" (UID: \"4e859424-bb94-453e-8a24-af637d4d2ac7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"
Sep 08 15:12:51.767900 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.767854    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-stats-auth\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.767900 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.767900    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-trusted-ca\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.768159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.767920    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6krk\" (UniqueName: \"kubernetes.io/projected/638b30c7-71e7-42f5-bf76-7899b5c7cf53-kube-api-access-g6krk\") pod \"cluster-samples-operator-7cdcfcf76c-bf7cj\" (UID: \"638b30c7-71e7-42f5-bf76-7899b5c7cf53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:12:51.768159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.767941    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e859424-bb94-453e-8a24-af637d4d2ac7-config\") pod \"service-ca-operator-859f94c4b-kvf74\" (UID: \"4e859424-bb94-453e-8a24-af637d4d2ac7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"
Sep 08 15:12:51.768159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.767985    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sqk4\" (UniqueName: \"kubernetes.io/projected/4e859424-bb94-453e-8a24-af637d4d2ac7-kube-api-access-7sqk4\") pod \"service-ca-operator-859f94c4b-kvf74\" (UID: \"4e859424-bb94-453e-8a24-af637d4d2ac7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"
Sep 08 15:12:51.768159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768064    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-bound-sa-token\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.768159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768131    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.768159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768150    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-installation-pull-secrets\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.768438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768171    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-default-certificate\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.768438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768194    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8rvv\" (UniqueName: \"kubernetes.io/projected/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-kube-api-access-q8rvv\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.768438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768220    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzvnc\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-kube-api-access-pzvnc\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.768438 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:51.768258    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 15:12:51.768438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768263    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e859424-bb94-453e-8a24-af637d4d2ac7-serving-cert\") pod \"service-ca-operator-859f94c4b-kvf74\" (UID: \"4e859424-bb94-453e-8a24-af637d4d2ac7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"
Sep 08 15:12:51.768438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768291    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-image-registry-private-configuration\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.768438 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:51.768314    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs podName:cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:52.268294763 +0000 UTC m=+232.839840786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs") pod "router-default-79d7c5f44b-s56g9" (UID: "cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58") : secret "router-metrics-certs-default" not found
Sep 08 15:12:51.768438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768339    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.768438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768366    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-ca-trust-extracted\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.768438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768393    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-certificates\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.768438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768432    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bf7cj\" (UID: \"638b30c7-71e7-42f5-bf76-7899b5c7cf53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:12:51.768887 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768456    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzcqm\" (UniqueName: \"kubernetes.io/projected/b199bc61-d833-4e5a-9286-2969df7f5c32-kube-api-access-zzcqm\") pod \"network-check-source-685456655f-9zwfw\" (UID: \"b199bc61-d833-4e5a-9286-2969df7f5c32\") " pod="openshift-network-diagnostics/network-check-source-685456655f-9zwfw"
Sep 08 15:12:51.768887 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768488    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.768887 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.768555    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e859424-bb94-453e-8a24-af637d4d2ac7-config\") pod \"service-ca-operator-859f94c4b-kvf74\" (UID: \"4e859424-bb94-453e-8a24-af637d4d2ac7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"
Sep 08 15:12:51.768887 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:51.768652    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle podName:cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:52.268609894 +0000 UTC m=+232.840155914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle") pod "router-default-79d7c5f44b-s56g9" (UID: "cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58") : configmap references non-existent config key: service-ca.crt
Sep 08 15:12:51.770567 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.770540    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e859424-bb94-453e-8a24-af637d4d2ac7-serving-cert\") pod \"service-ca-operator-859f94c4b-kvf74\" (UID: \"4e859424-bb94-453e-8a24-af637d4d2ac7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"
Sep 08 15:12:51.770688 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.770611    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-stats-auth\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.770688 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.770654    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-default-certificate\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.777116 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.777082    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sqk4\" (UniqueName: \"kubernetes.io/projected/4e859424-bb94-453e-8a24-af637d4d2ac7-kube-api-access-7sqk4\") pod \"service-ca-operator-859f94c4b-kvf74\" (UID: \"4e859424-bb94-453e-8a24-af637d4d2ac7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"
Sep 08 15:12:51.777371 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.777350    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8rvv\" (UniqueName: \"kubernetes.io/projected/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-kube-api-access-q8rvv\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:51.849368 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.849334    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"
Sep 08 15:12:51.869470 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.869433    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzvnc\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-kube-api-access-pzvnc\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.869642 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.869517    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-image-registry-private-configuration\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.869692 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.869663    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.869735 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.869705    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-ca-trust-extracted\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.869735 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.869726    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-certificates\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.869822 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.869750    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bf7cj\" (UID: \"638b30c7-71e7-42f5-bf76-7899b5c7cf53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:12:51.869822 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:51.869767    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:12:51.869822 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.869776    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzcqm\" (UniqueName: \"kubernetes.io/projected/b199bc61-d833-4e5a-9286-2969df7f5c32-kube-api-access-zzcqm\") pod \"network-check-source-685456655f-9zwfw\" (UID: \"b199bc61-d833-4e5a-9286-2969df7f5c32\") " pod="openshift-network-diagnostics/network-check-source-685456655f-9zwfw"
Sep 08 15:12:51.869822 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:51.869787    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c99dfcbc-wmr48: secret "image-registry-tls" not found
Sep 08 15:12:51.869822 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.869814    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-trusted-ca\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.870059 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.869829    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6krk\" (UniqueName: \"kubernetes.io/projected/638b30c7-71e7-42f5-bf76-7899b5c7cf53-kube-api-access-g6krk\") pod \"cluster-samples-operator-7cdcfcf76c-bf7cj\" (UID: \"638b30c7-71e7-42f5-bf76-7899b5c7cf53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:12:51.870059 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:51.869851    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls podName:eba7be55-f28b-4c5a-9eee-a28f2ea34c74 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:52.369830233 +0000 UTC m=+232.941376273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls") pod "image-registry-c99dfcbc-wmr48" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74") : secret "image-registry-tls" not found
Sep 08 15:12:51.870059 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.869886    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-bound-sa-token\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.870059 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:51.869898    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 15:12:51.870059 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:51.869944    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls podName:638b30c7-71e7-42f5-bf76-7899b5c7cf53 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:52.369933145 +0000 UTC m=+232.941479168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bf7cj" (UID: "638b30c7-71e7-42f5-bf76-7899b5c7cf53") : secret "samples-operator-tls" not found
Sep 08 15:12:51.870059 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.869975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-installation-pull-secrets\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.870370 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.870199    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-ca-trust-extracted\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.870577 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.870556    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-certificates\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.871526 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.871500    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-trusted-ca\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.872363 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.872336    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-image-registry-private-configuration\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.872443 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.872426    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-installation-pull-secrets\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.878889 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.878846    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6krk\" (UniqueName: \"kubernetes.io/projected/638b30c7-71e7-42f5-bf76-7899b5c7cf53-kube-api-access-g6krk\") pod \"cluster-samples-operator-7cdcfcf76c-bf7cj\" (UID: \"638b30c7-71e7-42f5-bf76-7899b5c7cf53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:12:51.879153 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.879120    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-bound-sa-token\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.879606 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.879583    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzcqm\" (UniqueName: \"kubernetes.io/projected/b199bc61-d833-4e5a-9286-2969df7f5c32-kube-api-access-zzcqm\") pod \"network-check-source-685456655f-9zwfw\" (UID: \"b199bc61-d833-4e5a-9286-2969df7f5c32\") " pod="openshift-network-diagnostics/network-check-source-685456655f-9zwfw"
Sep 08 15:12:51.879606 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.879601    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzvnc\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-kube-api-access-pzvnc\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:51.916644 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:51.916600    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-9zwfw"
Sep 08 15:12:52.119239 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:52.119065    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74"]
Sep 08 15:12:52.121815 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:12:52.121786    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e859424_bb94_453e_8a24_af637d4d2ac7.slice/crio-33e4960c367b63763ad8fa930fc4d5e944c02bde17207d9d587ae352d39cddd8 WatchSource:0}: Error finding container 33e4960c367b63763ad8fa930fc4d5e944c02bde17207d9d587ae352d39cddd8: Status 404 returned error can't find the container with id 33e4960c367b63763ad8fa930fc4d5e944c02bde17207d9d587ae352d39cddd8
Sep 08 15:12:52.187908 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:52.187876    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-9zwfw"]
Sep 08 15:12:52.190977 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:12:52.190954    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb199bc61_d833_4e5a_9286_2969df7f5c32.slice/crio-4e599d589777379735af7f2fb807233d08ff8415243a8f4fa458bcff112fa3fa WatchSource:0}: Error finding container 4e599d589777379735af7f2fb807233d08ff8415243a8f4fa458bcff112fa3fa: Status 404 returned error can't find the container with id 4e599d589777379735af7f2fb807233d08ff8415243a8f4fa458bcff112fa3fa
Sep 08 15:12:52.272398 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:52.272359    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:52.272599 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:52.272440    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:52.272599 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:52.272553    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle podName:cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:53.272531903 +0000 UTC m=+233.844077939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle") pod "router-default-79d7c5f44b-s56g9" (UID: "cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58") : configmap references non-existent config key: service-ca.crt
Sep 08 15:12:52.272746 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:52.272644    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 15:12:52.272746 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:52.272717    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs podName:cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:53.272699268 +0000 UTC m=+233.844245307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs") pod "router-default-79d7c5f44b-s56g9" (UID: "cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58") : secret "router-metrics-certs-default" not found
Sep 08 15:12:52.373283 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:52.373188    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:52.373283 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:52.373244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bf7cj\" (UID: \"638b30c7-71e7-42f5-bf76-7899b5c7cf53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:12:52.373499 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:52.373367    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:12:52.373499 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:52.373376    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 15:12:52.373499 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:52.373391    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c99dfcbc-wmr48: secret "image-registry-tls" not found
Sep 08 15:12:52.373499 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:52.373437    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls podName:638b30c7-71e7-42f5-bf76-7899b5c7cf53 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:53.373422681 +0000 UTC m=+233.944968701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bf7cj" (UID: "638b30c7-71e7-42f5-bf76-7899b5c7cf53") : secret "samples-operator-tls" not found
Sep 08 15:12:52.373499 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:52.373456    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls podName:eba7be55-f28b-4c5a-9eee-a28f2ea34c74 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:53.373446599 +0000 UTC m=+233.944992624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls") pod "image-registry-c99dfcbc-wmr48" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74") : secret "image-registry-tls" not found
Sep 08 15:12:52.593577 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:52.593540    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-9zwfw" event={"ID":"b199bc61-d833-4e5a-9286-2969df7f5c32","Type":"ContainerStarted","Data":"a9899b712bab50dca73def33b6c437abfe58350b9d16698afdacd045dce4270e"}
Sep 08 15:12:52.594063 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:52.593599    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-9zwfw" event={"ID":"b199bc61-d833-4e5a-9286-2969df7f5c32","Type":"ContainerStarted","Data":"4e599d589777379735af7f2fb807233d08ff8415243a8f4fa458bcff112fa3fa"}
Sep 08 15:12:52.594760 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:52.594736    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74" event={"ID":"4e859424-bb94-453e-8a24-af637d4d2ac7","Type":"ContainerStarted","Data":"33e4960c367b63763ad8fa930fc4d5e944c02bde17207d9d587ae352d39cddd8"}
Sep 08 15:12:52.609662 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:52.609593    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-9zwfw" podStartSLOduration=1.609573912 podStartE2EDuration="1.609573912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:12:52.608998573 +0000 UTC m=+233.180544616" watchObservedRunningTime="2026-09-08 15:12:52.609573912 +0000 UTC m=+233.181119954"
Sep 08 15:12:53.281027 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:53.280983    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:53.281240 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:53.281069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:53.281240 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:53.281182    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 15:12:53.281240 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:53.281187    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle podName:cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:55.281164655 +0000 UTC m=+235.852710688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle") pod "router-default-79d7c5f44b-s56g9" (UID: "cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58") : configmap references non-existent config key: service-ca.crt
Sep 08 15:12:53.281659 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:53.281244    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs podName:cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:55.28122778 +0000 UTC m=+235.852773811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs") pod "router-default-79d7c5f44b-s56g9" (UID: "cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58") : secret "router-metrics-certs-default" not found
Sep 08 15:12:53.382032 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:53.381986    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:53.382032 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:53.382048    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bf7cj\" (UID: \"638b30c7-71e7-42f5-bf76-7899b5c7cf53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:12:53.382478 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:53.382169    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:12:53.382478 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:53.382176    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 15:12:53.382478 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:53.382193    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c99dfcbc-wmr48: secret "image-registry-tls" not found
Sep 08 15:12:53.382478 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:53.382255    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls podName:638b30c7-71e7-42f5-bf76-7899b5c7cf53 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:55.38223585 +0000 UTC m=+235.953781872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bf7cj" (UID: "638b30c7-71e7-42f5-bf76-7899b5c7cf53") : secret "samples-operator-tls" not found
Sep 08 15:12:53.382478 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:53.382273    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls podName:eba7be55-f28b-4c5a-9eee-a28f2ea34c74 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:55.382264386 +0000 UTC m=+235.953810412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls") pod "image-registry-c99dfcbc-wmr48" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74") : secret "image-registry-tls" not found
Sep 08 15:12:54.600652 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:54.600606    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74" event={"ID":"4e859424-bb94-453e-8a24-af637d4d2ac7","Type":"ContainerStarted","Data":"57c2bd040de40d44c1090ec6a030200149bb808891db6927b913f72b2d89e201"}
Sep 08 15:12:54.618614 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:54.618561    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74" podStartSLOduration=1.429835427 podStartE2EDuration="3.618542517s" totalImagesPullingTime="2.18870709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:12:54.617922762 +0000 UTC m=+235.189468804" watchObservedRunningTime="2026-09-08 15:12:54.618542517 +0000 UTC m=+235.190088558"
Sep 08 15:12:55.298462 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:55.298426    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:55.298676 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:55.298514    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:55.298676 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:55.298582    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 15:12:55.298676 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:55.298668    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs podName:cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:59.298653242 +0000 UTC m=+239.870199274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs") pod "router-default-79d7c5f44b-s56g9" (UID: "cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58") : secret "router-metrics-certs-default" not found
Sep 08 15:12:55.298790 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:55.298683    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle podName:cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:59.298677059 +0000 UTC m=+239.870223078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle") pod "router-default-79d7c5f44b-s56g9" (UID: "cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58") : configmap references non-existent config key: service-ca.crt
Sep 08 15:12:55.398999 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:55.398967    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:55.398999 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:55.399014    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bf7cj\" (UID: \"638b30c7-71e7-42f5-bf76-7899b5c7cf53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:12:55.399208 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:55.399114    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 15:12:55.399208 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:55.399117    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:12:55.399208 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:55.399136    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c99dfcbc-wmr48: secret "image-registry-tls" not found
Sep 08 15:12:55.399208 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:55.399169    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls podName:638b30c7-71e7-42f5-bf76-7899b5c7cf53 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:59.399151537 +0000 UTC m=+239.970697570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bf7cj" (UID: "638b30c7-71e7-42f5-bf76-7899b5c7cf53") : secret "samples-operator-tls" not found
Sep 08 15:12:55.399208 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:55.399182    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls podName:eba7be55-f28b-4c5a-9eee-a28f2ea34c74 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:59.399176533 +0000 UTC m=+239.970722552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls") pod "image-registry-c99dfcbc-wmr48" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74") : secret "image-registry-tls" not found
Sep 08 15:12:56.669585 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.669549    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v2gv7"]
Sep 08 15:12:56.671790 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.671773    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.674489 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.674466    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 15:12:56.674636 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.674486    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 15:12:56.674636 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.674543    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qrxjt\""
Sep 08 15:12:56.675525 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.675509    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 15:12:56.675639 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.675510    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 15:12:56.688647 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.688601    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v2gv7"]
Sep 08 15:12:56.707700 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.707666    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldgc4\" (UniqueName: \"kubernetes.io/projected/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-api-access-ldgc4\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.707881 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.707717    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-crio-socket\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.707881 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.707758    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-data-volume\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.707881 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.707793    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.708029 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.707887    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.808580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.808523    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldgc4\" (UniqueName: \"kubernetes.io/projected/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-api-access-ldgc4\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.808580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.808582    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-crio-socket\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.808860 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.808667    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-crio-socket\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.808860 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.808711    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-data-volume\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.808860 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.808746    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.808860 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.808813    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.809193 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:56.808915    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 15:12:56.809193 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:56.808937    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 15:12:56.809193 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:56.808966    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls podName:2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:57.308951825 +0000 UTC m=+237.880497845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v2gv7" (UID: "2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4") : secret "insights-runtime-extractor-tls" not found
Sep 08 15:12:56.809193 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:56.808986    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm podName:2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:57.308971563 +0000 UTC m=+237.880517585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v2gv7" (UID: "2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4") : configmap "kube-rbac-proxy" not found
Sep 08 15:12:56.809193 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.809077    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-data-volume\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:56.817462 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:56.817410    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldgc4\" (UniqueName: \"kubernetes.io/projected/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-api-access-ldgc4\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:57.312257 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:57.312197    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:57.312548 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:57.312298    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:57.312548 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:57.312351    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 15:12:57.312548 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:57.312384    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 15:12:57.312548 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:57.312424    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls podName:2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:58.312405006 +0000 UTC m=+238.883951050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v2gv7" (UID: "2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4") : secret "insights-runtime-extractor-tls" not found
Sep 08 15:12:57.312548 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:57.312440    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm podName:2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:58.312433513 +0000 UTC m=+238.883979532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v2gv7" (UID: "2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4") : configmap "kube-rbac-proxy" not found
Sep 08 15:12:58.319050 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.319009    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:58.319450 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.319069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:12:58.319450 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:58.319140    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 15:12:58.319450 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:58.319150    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 15:12:58.319450 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:58.319193    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm podName:2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:00.319179091 +0000 UTC m=+240.890725111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v2gv7" (UID: "2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4") : configmap "kube-rbac-proxy" not found
Sep 08 15:12:58.319450 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:58.319211    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls podName:2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:00.319197995 +0000 UTC m=+240.890744015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v2gv7" (UID: "2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4") : secret "insights-runtime-extractor-tls" not found
Sep 08 15:12:58.620449 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.620420    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qt79p_8ad071ef-333f-4eb3-a211-690a174bf23f/dns-node-resolver/0.log"
Sep 08 15:12:58.835294 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.835257    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-p2vqr"]
Sep 08 15:12:58.837229 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.837213    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-p2vqr"
Sep 08 15:12:58.840127 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.840100    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 08 15:12:58.840127 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.840117    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 08 15:12:58.840345 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.840181    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 08 15:12:58.841339 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.841316    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 08 15:12:58.841431 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.841389    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-x7vgg\""
Sep 08 15:12:58.847394 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.847371    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-p2vqr"]
Sep 08 15:12:58.923976 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.923875    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ab15a05-d326-4b77-a9eb-92750a88a1e9-signing-cabundle\") pod \"service-ca-75d99c484-p2vqr\" (UID: \"1ab15a05-d326-4b77-a9eb-92750a88a1e9\") " pod="openshift-service-ca/service-ca-75d99c484-p2vqr"
Sep 08 15:12:58.923976 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.923929    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2chg\" (UniqueName: \"kubernetes.io/projected/1ab15a05-d326-4b77-a9eb-92750a88a1e9-kube-api-access-f2chg\") pod \"service-ca-75d99c484-p2vqr\" (UID: \"1ab15a05-d326-4b77-a9eb-92750a88a1e9\") " pod="openshift-service-ca/service-ca-75d99c484-p2vqr"
Sep 08 15:12:58.924163 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:58.923995    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ab15a05-d326-4b77-a9eb-92750a88a1e9-signing-key\") pod \"service-ca-75d99c484-p2vqr\" (UID: \"1ab15a05-d326-4b77-a9eb-92750a88a1e9\") " pod="openshift-service-ca/service-ca-75d99c484-p2vqr"
Sep 08 15:12:59.025305 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.025257    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2chg\" (UniqueName: \"kubernetes.io/projected/1ab15a05-d326-4b77-a9eb-92750a88a1e9-kube-api-access-f2chg\") pod \"service-ca-75d99c484-p2vqr\" (UID: \"1ab15a05-d326-4b77-a9eb-92750a88a1e9\") " pod="openshift-service-ca/service-ca-75d99c484-p2vqr"
Sep 08 15:12:59.025481 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.025324    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ab15a05-d326-4b77-a9eb-92750a88a1e9-signing-key\") pod \"service-ca-75d99c484-p2vqr\" (UID: \"1ab15a05-d326-4b77-a9eb-92750a88a1e9\") " pod="openshift-service-ca/service-ca-75d99c484-p2vqr"
Sep 08 15:12:59.025481 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.025417    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ab15a05-d326-4b77-a9eb-92750a88a1e9-signing-cabundle\") pod \"service-ca-75d99c484-p2vqr\" (UID: \"1ab15a05-d326-4b77-a9eb-92750a88a1e9\") " pod="openshift-service-ca/service-ca-75d99c484-p2vqr"
Sep 08 15:12:59.026149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.026131    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ab15a05-d326-4b77-a9eb-92750a88a1e9-signing-cabundle\") pod \"service-ca-75d99c484-p2vqr\" (UID: \"1ab15a05-d326-4b77-a9eb-92750a88a1e9\") " pod="openshift-service-ca/service-ca-75d99c484-p2vqr"
Sep 08 15:12:59.027977 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.027960    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ab15a05-d326-4b77-a9eb-92750a88a1e9-signing-key\") pod \"service-ca-75d99c484-p2vqr\" (UID: \"1ab15a05-d326-4b77-a9eb-92750a88a1e9\") " pod="openshift-service-ca/service-ca-75d99c484-p2vqr"
Sep 08 15:12:59.034583 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.034548    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2chg\" (UniqueName: \"kubernetes.io/projected/1ab15a05-d326-4b77-a9eb-92750a88a1e9-kube-api-access-f2chg\") pod \"service-ca-75d99c484-p2vqr\" (UID: \"1ab15a05-d326-4b77-a9eb-92750a88a1e9\") " pod="openshift-service-ca/service-ca-75d99c484-p2vqr"
Sep 08 15:12:59.146760 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.146711    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-p2vqr"
Sep 08 15:12:59.329095 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.329058    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:59.329487 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.329157    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:12:59.329487 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:59.329237    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle podName:cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:07.329220066 +0000 UTC m=+247.900766109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle") pod "router-default-79d7c5f44b-s56g9" (UID: "cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58") : configmap references non-existent config key: service-ca.crt
Sep 08 15:12:59.329487 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:59.329253    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 15:12:59.329487 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:59.329292    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs podName:cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:07.329281164 +0000 UTC m=+247.900827197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs") pod "router-default-79d7c5f44b-s56g9" (UID: "cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58") : secret "router-metrics-certs-default" not found
Sep 08 15:12:59.410473 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.410443    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bdl5b_d1932344-9198-44d7-a765-aa52cd8d5a6f/node-ca/0.log"
Sep 08 15:12:59.422893 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.422864    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-p2vqr"]
Sep 08 15:12:59.426154 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:12:59.426128    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab15a05_d326_4b77_a9eb_92750a88a1e9.slice/crio-b051f1c58567ff4b48420ef161475b454a94b98952c07e5744e82e3d0381656e WatchSource:0}: Error finding container b051f1c58567ff4b48420ef161475b454a94b98952c07e5744e82e3d0381656e: Status 404 returned error can't find the container with id b051f1c58567ff4b48420ef161475b454a94b98952c07e5744e82e3d0381656e
Sep 08 15:12:59.429529 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.429492    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bf7cj\" (UID: \"638b30c7-71e7-42f5-bf76-7899b5c7cf53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:12:59.429658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.429590    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:12:59.429720 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:59.429686    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 15:12:59.429845 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:59.429721    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:12:59.429845 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:59.429738    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c99dfcbc-wmr48: secret "image-registry-tls" not found
Sep 08 15:12:59.429845 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:59.429770    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls podName:638b30c7-71e7-42f5-bf76-7899b5c7cf53 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:07.429747301 +0000 UTC m=+248.001293340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bf7cj" (UID: "638b30c7-71e7-42f5-bf76-7899b5c7cf53") : secret "samples-operator-tls" not found
Sep 08 15:12:59.429845 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:12:59.429791    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls podName:eba7be55-f28b-4c5a-9eee-a28f2ea34c74 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:07.429780571 +0000 UTC m=+248.001326597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls") pod "image-registry-c99dfcbc-wmr48" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74") : secret "image-registry-tls" not found
Sep 08 15:12:59.614741 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.614704    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-p2vqr" event={"ID":"1ab15a05-d326-4b77-a9eb-92750a88a1e9","Type":"ContainerStarted","Data":"08c423083a6e57cec32da6eea0c541938b2181070658c424b1b788f6fc206c4f"}
Sep 08 15:12:59.614916 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.614762    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-p2vqr" event={"ID":"1ab15a05-d326-4b77-a9eb-92750a88a1e9","Type":"ContainerStarted","Data":"b051f1c58567ff4b48420ef161475b454a94b98952c07e5744e82e3d0381656e"}
Sep 08 15:12:59.632232 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:12:59.632175    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-p2vqr" podStartSLOduration=1.632158997 podStartE2EDuration="1.632158997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:12:59.630920503 +0000 UTC m=+240.202466546" watchObservedRunningTime="2026-09-08 15:12:59.632158997 +0000 UTC m=+240.203705039"
Sep 08 15:13:00.214153 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:00.214120    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7vqck_efc545de-6c87-4145-9400-ea98638bd54f/serve-healthcheck-canary/0.log"
Sep 08 15:13:00.336609 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:00.336563    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:13:00.337216 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:00.336749    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 15:13:00.337744 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:00.337300    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls podName:2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:04.33727451 +0000 UTC m=+244.908820547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v2gv7" (UID: "2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4") : secret "insights-runtime-extractor-tls" not found
Sep 08 15:13:00.337835 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:00.337366    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 15:13:00.337835 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:00.337190    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:13:00.337945 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:00.337839    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm podName:2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:04.337795736 +0000 UTC m=+244.909341777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v2gv7" (UID: "2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4") : configmap "kube-rbac-proxy" not found
Sep 08 15:13:04.374447 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:04.374405    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:13:04.374858 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:04.374502    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:13:04.374858 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:04.374533    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 15:13:04.374858 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:04.374599    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 15:13:04.374858 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:04.374611    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm podName:2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:12.374595067 +0000 UTC m=+252.946141087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v2gv7" (UID: "2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4") : configmap "kube-rbac-proxy" not found
Sep 08 15:13:04.374858 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:04.374665    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls podName:2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:12.374653481 +0000 UTC m=+252.946199500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v2gv7" (UID: "2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4") : secret "insights-runtime-extractor-tls" not found
Sep 08 15:13:07.401909 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.401872    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:13:07.402313 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.401970    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:13:07.402519 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.402498    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-service-ca-bundle\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:13:07.404506 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.404476    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58-metrics-certs\") pod \"router-default-79d7c5f44b-s56g9\" (UID: \"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58\") " pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:13:07.463477 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.463440    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9zjch\""
Sep 08 15:13:07.471060 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.471024    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:13:07.503107 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.503049    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:13:07.503282 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.503195    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bf7cj\" (UID: \"638b30c7-71e7-42f5-bf76-7899b5c7cf53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:13:07.505770 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.505744    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/638b30c7-71e7-42f5-bf76-7899b5c7cf53-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bf7cj\" (UID: \"638b30c7-71e7-42f5-bf76-7899b5c7cf53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:13:07.505931 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.505794    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls\") pod \"image-registry-c99dfcbc-wmr48\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") " pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:13:07.513420 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.513370    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zvsjt\""
Sep 08 15:13:07.521214 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.520935    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"
Sep 08 15:13:07.525073 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.525048    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2m6vp\""
Sep 08 15:13:07.532837 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.532700    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:13:07.750510 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.750428    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79d7c5f44b-s56g9"]
Sep 08 15:13:07.753573 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:13:07.753542    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7f0cb8_0c66_4124_8bc4_60f2b3cfaa58.slice/crio-cc3680cdaebbf9ff0fd351c1937350be682cd7fbbe29382b359739b7296ff373 WatchSource:0}: Error finding container cc3680cdaebbf9ff0fd351c1937350be682cd7fbbe29382b359739b7296ff373: Status 404 returned error can't find the container with id cc3680cdaebbf9ff0fd351c1937350be682cd7fbbe29382b359739b7296ff373
Sep 08 15:13:07.800684 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.800662    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj"]
Sep 08 15:13:07.829863 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:07.829791    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c99dfcbc-wmr48"]
Sep 08 15:13:07.833356 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:13:07.833327    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba7be55_f28b_4c5a_9eee_a28f2ea34c74.slice/crio-850e34361e061e195ccdb1039c16a0e890dc664e6f87455d40d7d79fb4db344e WatchSource:0}: Error finding container 850e34361e061e195ccdb1039c16a0e890dc664e6f87455d40d7d79fb4db344e: Status 404 returned error can't find the container with id 850e34361e061e195ccdb1039c16a0e890dc664e6f87455d40d7d79fb4db344e
Sep 08 15:13:08.650695 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:08.650654    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj" event={"ID":"638b30c7-71e7-42f5-bf76-7899b5c7cf53","Type":"ContainerStarted","Data":"68adfe1e79024ffe98fff4e044a1419c3476d948647fa50728b10f4f1f8ba220"}
Sep 08 15:13:08.652499 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:08.652462    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79d7c5f44b-s56g9" event={"ID":"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58","Type":"ContainerStarted","Data":"90e98907e1944a7bd76956950d7ef1c7084f4d1cdf9fc00a8ad0892c0a2d587a"}
Sep 08 15:13:08.652679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:08.652516    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79d7c5f44b-s56g9" event={"ID":"cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58","Type":"ContainerStarted","Data":"cc3680cdaebbf9ff0fd351c1937350be682cd7fbbe29382b359739b7296ff373"}
Sep 08 15:13:08.654202 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:08.654172    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48" event={"ID":"eba7be55-f28b-4c5a-9eee-a28f2ea34c74","Type":"ContainerStarted","Data":"275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a"}
Sep 08 15:13:08.654312 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:08.654226    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48" event={"ID":"eba7be55-f28b-4c5a-9eee-a28f2ea34c74","Type":"ContainerStarted","Data":"850e34361e061e195ccdb1039c16a0e890dc664e6f87455d40d7d79fb4db344e"}
Sep 08 15:13:08.654312 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:08.654251    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:13:08.678517 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:08.678459    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79d7c5f44b-s56g9" podStartSLOduration=17.678442233 podStartE2EDuration="17.678442233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:08.677129825 +0000 UTC m=+249.248675871" watchObservedRunningTime="2026-09-08 15:13:08.678442233 +0000 UTC m=+249.249988274"
Sep 08 15:13:08.698442 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:08.698331    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48" podStartSLOduration=17.698309791 podStartE2EDuration="17.698309791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:08.698074968 +0000 UTC m=+249.269621013" watchObservedRunningTime="2026-09-08 15:13:08.698309791 +0000 UTC m=+249.269855834"
Sep 08 15:13:09.472061 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:09.472019    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:13:09.475035 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:09.475010    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:13:09.658658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:09.658577    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:13:09.659676 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:09.659654    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79d7c5f44b-s56g9"
Sep 08 15:13:10.663375 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:10.663336    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj" event={"ID":"638b30c7-71e7-42f5-bf76-7899b5c7cf53","Type":"ContainerStarted","Data":"3bde2e51c8ebfb6ccd7fa013f7169966e8da9c3e71a5bb1d6e1d866eca3c1c68"}
Sep 08 15:13:10.663792 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:10.663442    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj" event={"ID":"638b30c7-71e7-42f5-bf76-7899b5c7cf53","Type":"ContainerStarted","Data":"1bb226b58a268208a17464fad08bc5ed843299948a28139e023b4e9a5a046514"}
Sep 08 15:13:10.680566 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:10.680516    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bf7cj" podStartSLOduration=17.629933425 podStartE2EDuration="19.680501609s" totalImagesPullingTime="2.050568184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:10.679844159 +0000 UTC m=+251.251390200" watchObservedRunningTime="2026-09-08 15:13:10.680501609 +0000 UTC m=+251.252047650"
Sep 08 15:13:11.740531 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:11.740491    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:13:11.743027 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:11.743001    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dfe2db7-aff1-41b8-a3c0-36575eee0515-metrics-certs\") pod \"network-metrics-daemon-fn4w2\" (UID: \"9dfe2db7-aff1-41b8-a3c0-36575eee0515\") " pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:13:12.011613 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:12.011528    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2q2k\""
Sep 08 15:13:12.019006 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:12.018978    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn4w2"
Sep 08 15:13:12.288556 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:12.288471    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fn4w2"]
Sep 08 15:13:12.292002 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:13:12.291966    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dfe2db7_aff1_41b8_a3c0_36575eee0515.slice/crio-723022a0df0c9d3e98de1de6245018774e2ab3ab895fe8e1cdc98df2ad420fab WatchSource:0}: Error finding container 723022a0df0c9d3e98de1de6245018774e2ab3ab895fe8e1cdc98df2ad420fab: Status 404 returned error can't find the container with id 723022a0df0c9d3e98de1de6245018774e2ab3ab895fe8e1cdc98df2ad420fab
Sep 08 15:13:12.446201 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:12.446161    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:13:12.446201 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:12.446203    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:13:12.446716 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:12.446698    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:13:12.448746 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:12.448725    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2gv7\" (UID: \"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4\") " pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:13:12.583089 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:12.583058    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qrxjt\""
Sep 08 15:13:12.591297 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:12.591266    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v2gv7"
Sep 08 15:13:12.670968 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:12.670930    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fn4w2" event={"ID":"9dfe2db7-aff1-41b8-a3c0-36575eee0515","Type":"ContainerStarted","Data":"723022a0df0c9d3e98de1de6245018774e2ab3ab895fe8e1cdc98df2ad420fab"}
Sep 08 15:13:12.862436 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:12.862362    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v2gv7"]
Sep 08 15:13:12.865755 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:13:12.865729    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8a14d0_e4a6_4b9e_980b_bbc9c940b0e4.slice/crio-4f5a031e1ec08ff656b98c7f83f6cf4ccdedf566c30ed79b115958086e119d7d WatchSource:0}: Error finding container 4f5a031e1ec08ff656b98c7f83f6cf4ccdedf566c30ed79b115958086e119d7d: Status 404 returned error can't find the container with id 4f5a031e1ec08ff656b98c7f83f6cf4ccdedf566c30ed79b115958086e119d7d
Sep 08 15:13:13.678355 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:13.678317    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fn4w2" event={"ID":"9dfe2db7-aff1-41b8-a3c0-36575eee0515","Type":"ContainerStarted","Data":"8fa528d59a815c30703e3df7cd438954fef9b125b46198467ea2d689d36d8f14"}
Sep 08 15:13:13.680146 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:13.680116    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2gv7" event={"ID":"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4","Type":"ContainerStarted","Data":"a8ff31d5dc383894484a2236b4e4310ac47f07b59ca40e9dcd3bc0ca74777207"}
Sep 08 15:13:13.680231 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:13.680181    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2gv7" event={"ID":"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4","Type":"ContainerStarted","Data":"4f5a031e1ec08ff656b98c7f83f6cf4ccdedf566c30ed79b115958086e119d7d"}
Sep 08 15:13:14.688960 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:14.686091    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2gv7" event={"ID":"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4","Type":"ContainerStarted","Data":"335933dfab1a39a00133fbb5ca9dae04902b8d8b1a649deed5f21c58087a28b8"}
Sep 08 15:13:14.691367 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:14.691333    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fn4w2" event={"ID":"9dfe2db7-aff1-41b8-a3c0-36575eee0515","Type":"ContainerStarted","Data":"0ae618ef5ffaeb9e2487a758caeff6b6f811444367d2092c4c7c2b44f2fa9d15"}
Sep 08 15:13:14.708175 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:14.708110    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fn4w2" podStartSLOduration=253.557656985 podStartE2EDuration="4m14.708090767s" totalImagesPullingTime="1.150433782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:14.707442497 +0000 UTC m=+255.278988542" watchObservedRunningTime="2026-09-08 15:13:14.708090767 +0000 UTC m=+255.279636791"
Sep 08 15:13:15.696799 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:15.696759    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2gv7" event={"ID":"2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4","Type":"ContainerStarted","Data":"c288c2d39264dc74b0c18a94b52eb073f203ed6c97001cb5f85fa8abd4bd31ed"}
Sep 08 15:13:15.716171 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:15.716107    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v2gv7" podStartSLOduration=17.42768734 podStartE2EDuration="19.716092362s" totalImagesPullingTime="2.288405022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:15.714771592 +0000 UTC m=+256.286317634" watchObservedRunningTime="2026-09-08 15:13:15.716092362 +0000 UTC m=+256.287638402"
Sep 08 15:13:20.479244 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:20.479212    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l"]
Sep 08 15:13:20.483277 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:20.483240    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l"
Sep 08 15:13:20.486628 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:20.486591    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 15:13:20.487663 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:20.487647    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5sg9j\""
Sep 08 15:13:20.501321 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:20.501293    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l"]
Sep 08 15:13:20.511656 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:20.511590    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c99dfcbc-wmr48"]
Sep 08 15:13:20.608393 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:20.608354    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/84b6b9b8-8c2a-4f1b-be26-728e852f1564-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-gsr2l\" (UID: \"84b6b9b8-8c2a-4f1b-be26-728e852f1564\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l"
Sep 08 15:13:20.709278 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:20.709147    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/84b6b9b8-8c2a-4f1b-be26-728e852f1564-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-gsr2l\" (UID: \"84b6b9b8-8c2a-4f1b-be26-728e852f1564\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l"
Sep 08 15:13:20.711935 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:20.711911    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/84b6b9b8-8c2a-4f1b-be26-728e852f1564-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-gsr2l\" (UID: \"84b6b9b8-8c2a-4f1b-be26-728e852f1564\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l"
Sep 08 15:13:20.794117 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:20.794083    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l"
Sep 08 15:13:21.065742 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:21.065662    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l"]
Sep 08 15:13:21.068574 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:13:21.068546    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b6b9b8_8c2a_4f1b_be26_728e852f1564.slice/crio-f64484293171f6035d9183a37b812c7e2898576e48d94130b3c5ef4eb3b99a8d WatchSource:0}: Error finding container f64484293171f6035d9183a37b812c7e2898576e48d94130b3c5ef4eb3b99a8d: Status 404 returned error can't find the container with id f64484293171f6035d9183a37b812c7e2898576e48d94130b3c5ef4eb3b99a8d
Sep 08 15:13:21.718051 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:21.718010    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l" event={"ID":"84b6b9b8-8c2a-4f1b-be26-728e852f1564","Type":"ContainerStarted","Data":"f64484293171f6035d9183a37b812c7e2898576e48d94130b3c5ef4eb3b99a8d"}
Sep 08 15:13:22.722906 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:22.722867    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l" event={"ID":"84b6b9b8-8c2a-4f1b-be26-728e852f1564","Type":"ContainerStarted","Data":"0fb9c6c4071a04f8da5c6a7e0be705bd574194ae96fdaff97263f5e47b146cf8"}
Sep 08 15:13:22.723326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:22.723028    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l"
Sep 08 15:13:22.727823 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:22.727798    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l"
Sep 08 15:13:22.741373 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:22.741297    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gsr2l" podStartSLOduration=1.546261876 podStartE2EDuration="2.741274887s" totalImagesPullingTime="1.195013011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:22.741031516 +0000 UTC m=+263.312577559" watchObservedRunningTime="2026-09-08 15:13:22.741274887 +0000 UTC m=+263.312820929"
Sep 08 15:13:23.195277 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.195240    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-dtb22"]
Sep 08 15:13:23.198487 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.198470    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.202469 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.202435    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 15:13:23.202609 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.202467    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ggx5m\""
Sep 08 15:13:23.202609 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.202485    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 15:13:23.202609 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.202438    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 15:13:23.202609 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.202442    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 15:13:23.202609 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.202514    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 15:13:23.208071 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.208050    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-dtb22"]
Sep 08 15:13:23.330340 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.330306    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.330340 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.330348    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.330573 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.330366    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.330573 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.330400    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kztvj\" (UniqueName: \"kubernetes.io/projected/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-kube-api-access-kztvj\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.431097 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.431047    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kztvj\" (UniqueName: \"kubernetes.io/projected/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-kube-api-access-kztvj\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.431269 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.431112    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.431269 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.431145    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.431269 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.431165    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.432009 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.431940    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.433700 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.433680    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.433795 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.433777    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.439548 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.439522    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kztvj\" (UniqueName: \"kubernetes.io/projected/55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e-kube-api-access-kztvj\") pod \"prometheus-operator-6f4946db56-dtb22\" (UID: \"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.507713 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.507598    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22"
Sep 08 15:13:23.778394 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:23.778313    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-dtb22"]
Sep 08 15:13:23.781219 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:13:23.781191    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e1ad4d_bdb7_4a7d_87df_ffb10b82b28e.slice/crio-b060c4ecce7d5900327ef1e5d4e4e4adfca8b8641c4f962e0833d6d244579224 WatchSource:0}: Error finding container b060c4ecce7d5900327ef1e5d4e4e4adfca8b8641c4f962e0833d6d244579224: Status 404 returned error can't find the container with id b060c4ecce7d5900327ef1e5d4e4e4adfca8b8641c4f962e0833d6d244579224
Sep 08 15:13:24.730958 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:24.730921    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22" event={"ID":"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e","Type":"ContainerStarted","Data":"b060c4ecce7d5900327ef1e5d4e4e4adfca8b8641c4f962e0833d6d244579224"}
Sep 08 15:13:25.738356 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:25.738311    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22" event={"ID":"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e","Type":"ContainerStarted","Data":"5a7253572c290fd5230897b737fad79534608e334fd07043a91b8562892a9aed"}
Sep 08 15:13:25.738832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:25.738370    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22" event={"ID":"55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e","Type":"ContainerStarted","Data":"010814d6558a8dfa530f7cd30718bacc47aea49a99f0e2dad575769e1c8b7060"}
Sep 08 15:13:25.759224 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:25.759122    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-dtb22" podStartSLOduration=1.043512369 podStartE2EDuration="2.759106872s" totalImagesPullingTime="1.715594503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:25.757429241 +0000 UTC m=+266.328975282" watchObservedRunningTime="2026-09-08 15:13:25.759106872 +0000 UTC m=+266.330652914"
Sep 08 15:13:27.581544 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.581509    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8z8gs"]
Sep 08 15:13:27.585359 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.585335    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.587969 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.587945    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 15:13:27.588370 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.588350    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 15:13:27.588492 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.588470    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5v7mq\""
Sep 08 15:13:27.588563 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.588554    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 15:13:27.663271 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.663235    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-tls\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.663458 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.663281    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-wtmp\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.663458 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.663306    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.663458 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.663377    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.663458 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.663429    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-textfile\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.663674 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.663460    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-sys\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.663674 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.663511    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-root\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.663674 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.663550    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-metrics-client-ca\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.663674 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.663574    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t47x\" (UniqueName: \"kubernetes.io/projected/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-kube-api-access-4t47x\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764391 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764351    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-tls\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764586 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764403    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-wtmp\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764586 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764437    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764586 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764482    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764586 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764508    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-textfile\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764586 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:27.764520    2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 08 15:13:27.764586 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764533    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-sys\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764586 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764561    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-root\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764586 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:27.764587    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-tls podName:dbf022f8-6ab7-452d-bcac-6fb2a237d6f9 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:28.264563857 +0000 UTC m=+268.836109891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-tls") pod "node-exporter-8z8gs" (UID: "dbf022f8-6ab7-452d-bcac-6fb2a237d6f9") : secret "node-exporter-tls" not found
Sep 08 15:13:27.764992 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764613    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-wtmp\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764992 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764642    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-root\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764992 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764646    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-metrics-client-ca\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764992 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764688    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t47x\" (UniqueName: \"kubernetes.io/projected/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-kube-api-access-4t47x\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764992 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764873    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-sys\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.764992 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.764906    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-textfile\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.765266 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.765185    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.765266 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.765234    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-metrics-client-ca\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.767355 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.767326    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:27.774574 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:27.774536    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t47x\" (UniqueName: \"kubernetes.io/projected/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-kube-api-access-4t47x\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:28.269257 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.269223    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-tls\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:28.271734 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.271701    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbf022f8-6ab7-452d-bcac-6fb2a237d6f9-node-exporter-tls\") pod \"node-exporter-8z8gs\" (UID: \"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9\") " pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:28.497051 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.497011    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8z8gs"
Sep 08 15:13:28.512008 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:13:28.511976    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf022f8_6ab7_452d_bcac_6fb2a237d6f9.slice/crio-c54cf42c82afcd92adecabdcd56b092727d1e0ea703dd339630a2e9072d371de WatchSource:0}: Error finding container c54cf42c82afcd92adecabdcd56b092727d1e0ea703dd339630a2e9072d371de: Status 404 returned error can't find the container with id c54cf42c82afcd92adecabdcd56b092727d1e0ea703dd339630a2e9072d371de
Sep 08 15:13:28.624594 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.624555    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:13:28.631311 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.631280    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.634288 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.634263    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 15:13:28.634454 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.634259    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 15:13:28.634454 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.634263    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 15:13:28.634580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.634478    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 15:13:28.634580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.634289    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6nh8c\""
Sep 08 15:13:28.634580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.634315    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 15:13:28.634580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.634288    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 15:13:28.634580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.634323    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 15:13:28.634869 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.634334    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 15:13:28.634869 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.634323    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 15:13:28.643838 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.643814    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:13:28.754232 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.754189    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z8gs" event={"ID":"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9","Type":"ContainerStarted","Data":"c54cf42c82afcd92adecabdcd56b092727d1e0ea703dd339630a2e9072d371de"}
Sep 08 15:13:28.773591 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773556    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.773715 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773605    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-out\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.773715 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773680    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.773791 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773716    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.773791 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773752    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrfhc\" (UniqueName: \"kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-kube-api-access-jrfhc\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.773791 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773775    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.773882 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773825    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.773882 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773849    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.773882 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773869    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-web-config\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.773989 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773899    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.773989 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773939    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.773989 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773954    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.774080 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.773996    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875246 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875145    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875246 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875190    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-web-config\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875246 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875246 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875229    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875246 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875246    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875650 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875266    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875650 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875292    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875650 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875329    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-out\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875650 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875354    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875650 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875383    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875650 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875406    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrfhc\" (UniqueName: \"kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-kube-api-access-jrfhc\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875650 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875446    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.875650 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875494    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.876056 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.875881    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.876484 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.876457    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.877046 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.877022    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.878738 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.878715    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-web-config\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.878885 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.878735    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.879008 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.878902    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.879523 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.879245    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.879523 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.879338    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.879523 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.879480    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-out\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.880046 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.880025    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.880165 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.880142    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.880466 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.880449    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.885534 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.885507    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrfhc\" (UniqueName: \"kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-kube-api-access-jrfhc\") pod \"alertmanager-main-0\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:28.941546 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:28.941508    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:13:29.229774 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:29.229692    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:13:29.233599 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:13:29.233563    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9f630c_8c1a_4895_bb0b_e74586e4dce3.slice/crio-ee05311c05d072c41ea45a445ebc66dacbad29c614435906e0aecaf3c300f65c WatchSource:0}: Error finding container ee05311c05d072c41ea45a445ebc66dacbad29c614435906e0aecaf3c300f65c: Status 404 returned error can't find the container with id ee05311c05d072c41ea45a445ebc66dacbad29c614435906e0aecaf3c300f65c
Sep 08 15:13:29.759015 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:29.758978    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerStarted","Data":"ee05311c05d072c41ea45a445ebc66dacbad29c614435906e0aecaf3c300f65c"}
Sep 08 15:13:29.760552 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:29.760525    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z8gs" event={"ID":"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9","Type":"ContainerStarted","Data":"9730af48aa53180e954d045d34a88f92ffb56a102928f26ed163d721879aead7"}
Sep 08 15:13:30.517966 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:30.517931    2566 patch_prober.go:28] interesting pod/image-registry-c99dfcbc-wmr48 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 08 15:13:30.518136 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:30.517992    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48" podUID="eba7be55-f28b-4c5a-9eee-a28f2ea34c74" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:13:30.765718 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:30.765680    2566 generic.go:356] "Generic (PLEG): container finished" podID="dbf022f8-6ab7-452d-bcac-6fb2a237d6f9" containerID="9730af48aa53180e954d045d34a88f92ffb56a102928f26ed163d721879aead7" exitCode=0
Sep 08 15:13:30.765718 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:30.765721    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z8gs" event={"ID":"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9","Type":"ContainerDied","Data":"9730af48aa53180e954d045d34a88f92ffb56a102928f26ed163d721879aead7"}
Sep 08 15:13:31.771778 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:31.771742    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z8gs" event={"ID":"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9","Type":"ContainerStarted","Data":"ec923564e0256cf5e159f0515879ddcbf203d845ead866aaca71fdf7190377a2"}
Sep 08 15:13:31.772176 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:31.771797    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z8gs" event={"ID":"dbf022f8-6ab7-452d-bcac-6fb2a237d6f9","Type":"ContainerStarted","Data":"5be279f6066151fdd1b1d2a32192822c7d1b813e8a39a5be31b75d3bbd4e5bd6"}
Sep 08 15:13:31.794967 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:31.794912    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8z8gs" podStartSLOduration=3.5394104779999997 podStartE2EDuration="4.794892226s" totalImagesPullingTime="1.183091003s" totalInitContainerRuntime="72.390745ms" isStatefulPod=true podCreationTimestamp="2026-09-08 15:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:31.792853191 +0000 UTC m=+272.364399257" watchObservedRunningTime="2026-09-08 15:13:31.794892226 +0000 UTC m=+272.366438313"
Sep 08 15:13:32.314172 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:32.314138    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"]
Sep 08 15:13:32.317587 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:32.317563    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"
Sep 08 15:13:32.320196 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:32.320172    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 08 15:13:32.320481 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:32.320465    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jz7zj\""
Sep 08 15:13:32.329758 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:32.329729    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"]
Sep 08 15:13:32.404725 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:32.404678    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8042fb04-b8de-4bd9-9704-c3763f426e01-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-kf4st\" (UID: \"8042fb04-b8de-4bd9-9704-c3763f426e01\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"
Sep 08 15:13:32.404725 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:32.404720    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dts2\" (UniqueName: \"kubernetes.io/projected/8042fb04-b8de-4bd9-9704-c3763f426e01-kube-api-access-4dts2\") pod \"monitoring-plugin-85bbbbbf4-kf4st\" (UID: \"8042fb04-b8de-4bd9-9704-c3763f426e01\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"
Sep 08 15:13:32.505268 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:32.505224    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8042fb04-b8de-4bd9-9704-c3763f426e01-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-kf4st\" (UID: \"8042fb04-b8de-4bd9-9704-c3763f426e01\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"
Sep 08 15:13:32.505268 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:32.505266    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dts2\" (UniqueName: \"kubernetes.io/projected/8042fb04-b8de-4bd9-9704-c3763f426e01-kube-api-access-4dts2\") pod \"monitoring-plugin-85bbbbbf4-kf4st\" (UID: \"8042fb04-b8de-4bd9-9704-c3763f426e01\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"
Sep 08 15:13:32.505491 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:32.505422    2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 08 15:13:32.505532 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:32.505516    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8042fb04-b8de-4bd9-9704-c3763f426e01-monitoring-plugin-cert podName:8042fb04-b8de-4bd9-9704-c3763f426e01 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:33.005493038 +0000 UTC m=+273.577039071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8042fb04-b8de-4bd9-9704-c3763f426e01-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-kf4st" (UID: "8042fb04-b8de-4bd9-9704-c3763f426e01") : secret "monitoring-plugin-cert" not found
Sep 08 15:13:32.516080 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:32.516049    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dts2\" (UniqueName: \"kubernetes.io/projected/8042fb04-b8de-4bd9-9704-c3763f426e01-kube-api-access-4dts2\") pod \"monitoring-plugin-85bbbbbf4-kf4st\" (UID: \"8042fb04-b8de-4bd9-9704-c3763f426e01\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"
Sep 08 15:13:33.010016 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:33.009977    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8042fb04-b8de-4bd9-9704-c3763f426e01-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-kf4st\" (UID: \"8042fb04-b8de-4bd9-9704-c3763f426e01\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"
Sep 08 15:13:33.016164 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:33.016138    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8042fb04-b8de-4bd9-9704-c3763f426e01-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-kf4st\" (UID: \"8042fb04-b8de-4bd9-9704-c3763f426e01\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"
Sep 08 15:13:33.226417 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:33.226381    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"
Sep 08 15:13:33.501135 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:33.501096    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"]
Sep 08 15:13:33.505121 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:13:33.505090    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8042fb04_b8de_4bd9_9704_c3763f426e01.slice/crio-af5834945ddc467163ed3e3b442bbcb5886436bab7d1d995cde74bbfb2e61bab WatchSource:0}: Error finding container af5834945ddc467163ed3e3b442bbcb5886436bab7d1d995cde74bbfb2e61bab: Status 404 returned error can't find the container with id af5834945ddc467163ed3e3b442bbcb5886436bab7d1d995cde74bbfb2e61bab
Sep 08 15:13:33.781398 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:33.780806    2566 generic.go:356] "Generic (PLEG): container finished" podID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerID="fd3ced3233f70384a95ff5cc689579aded40575394d94c5dd5439d661f3727d4" exitCode=0
Sep 08 15:13:33.781606 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:33.781430    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerDied","Data":"fd3ced3233f70384a95ff5cc689579aded40575394d94c5dd5439d661f3727d4"}
Sep 08 15:13:33.782933 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:33.782877    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st" event={"ID":"8042fb04-b8de-4bd9-9704-c3763f426e01","Type":"ContainerStarted","Data":"af5834945ddc467163ed3e3b442bbcb5886436bab7d1d995cde74bbfb2e61bab"}
Sep 08 15:13:35.795468 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:35.795342    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"
Sep 08 15:13:35.797168 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:35.797142    2566 patch_prober.go:28] interesting pod/monitoring-plugin-85bbbbbf4-kf4st container/monitoring-plugin namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.133.0.18:9443/health\": dial tcp 10.133.0.18:9443: connect: connection refused" start-of-body=
Sep 08 15:13:35.797292 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:35.797185    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st" podUID="8042fb04-b8de-4bd9-9704-c3763f426e01" containerName="monitoring-plugin" probeResult="failure" output="Get \"https://10.133.0.18:9443/health\": dial tcp 10.133.0.18:9443: connect: connection refused"
Sep 08 15:13:35.811787 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:35.811714    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st" podStartSLOduration=1.599172458 podStartE2EDuration="3.811693778s" totalImagesPullingTime="2.21252132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:35.810886072 +0000 UTC m=+276.382432127" watchObservedRunningTime="2026-09-08 15:13:35.811693778 +0000 UTC m=+276.383239823"
Sep 08 15:13:36.802056 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:36.802013    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerStarted","Data":"79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef"}
Sep 08 15:13:36.802455 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:36.802093    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerStarted","Data":"1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62"}
Sep 08 15:13:36.802455 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:36.802123    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerStarted","Data":"dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb"}
Sep 08 15:13:36.802455 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:36.802149    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerStarted","Data":"8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a"}
Sep 08 15:13:36.802455 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:36.802173    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerStarted","Data":"a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86"}
Sep 08 15:13:36.803536 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:36.803505    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st" event={"ID":"8042fb04-b8de-4bd9-9704-c3763f426e01","Type":"ContainerStarted","Data":"eba3a79b40a77d044ffaf308ad328468f2c9e9aaeafe12bd752f482d2012c1e0"}
Sep 08 15:13:36.807389 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:36.807369    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-kf4st"
Sep 08 15:13:37.811103 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:37.811061    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerStarted","Data":"e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6"}
Sep 08 15:13:37.837716 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:37.837665    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.990581456 podStartE2EDuration="9.837647318s" totalImagesPullingTime="6.832692458s" totalInitContainerRuntime="14.373404ms" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:37.837357142 +0000 UTC m=+278.408903186" watchObservedRunningTime="2026-09-08 15:13:37.837647318 +0000 UTC m=+278.409193361"
Sep 08 15:13:40.516038 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:40.515996    2566 patch_prober.go:28] interesting pod/image-registry-c99dfcbc-wmr48 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 08 15:13:40.516414 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:40.516050    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48" podUID="eba7be55-f28b-4c5a-9eee-a28f2ea34c74" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:13:41.419543 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:41.419482    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xxtfv" podUID="ee258efd-c7f8-422c-8b15-8cb6e9a7b87b"
Sep 08 15:13:41.827327 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:41.827297    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:13:44.611048 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:44.611004    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:13:44.614318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:44.613744    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee258efd-c7f8-422c-8b15-8cb6e9a7b87b-metrics-tls\") pod \"dns-default-xxtfv\" (UID: \"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b\") " pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:13:44.830678 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:44.830644    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cc4mw\""
Sep 08 15:13:44.838643 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:44.838594    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:13:45.119872 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.119846    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xxtfv"]
Sep 08 15:13:45.122321 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:13:45.122289    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee258efd_c7f8_422c_8b15_8cb6e9a7b87b.slice/crio-2cbabc3630db9c2a5c6f3c8c5bbd2fdb86b643d336416f2f939e92a284a28f07 WatchSource:0}: Error finding container 2cbabc3630db9c2a5c6f3c8c5bbd2fdb86b643d336416f2f939e92a284a28f07: Status 404 returned error can't find the container with id 2cbabc3630db9c2a5c6f3c8c5bbd2fdb86b643d336416f2f939e92a284a28f07
Sep 08 15:13:45.533112 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.533066    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48" podUID="eba7be55-f28b-4c5a-9eee-a28f2ea34c74" containerName="registry" containerID="cri-o://275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a" gracePeriod=30
Sep 08 15:13:45.795921 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.795854    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:13:45.844507 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.844459    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxtfv" event={"ID":"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b","Type":"ContainerStarted","Data":"2cbabc3630db9c2a5c6f3c8c5bbd2fdb86b643d336416f2f939e92a284a28f07"}
Sep 08 15:13:45.846042 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.846015    2566 generic.go:356] "Generic (PLEG): container finished" podID="eba7be55-f28b-4c5a-9eee-a28f2ea34c74" containerID="275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a" exitCode=0
Sep 08 15:13:45.846192 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.846062    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48" event={"ID":"eba7be55-f28b-4c5a-9eee-a28f2ea34c74","Type":"ContainerDied","Data":"275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a"}
Sep 08 15:13:45.846192 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.846065    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48"
Sep 08 15:13:45.846192 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.846101    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c99dfcbc-wmr48" event={"ID":"eba7be55-f28b-4c5a-9eee-a28f2ea34c74","Type":"ContainerDied","Data":"850e34361e061e195ccdb1039c16a0e890dc664e6f87455d40d7d79fb4db344e"}
Sep 08 15:13:45.846192 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.846127    2566 scope.go:117] "RemoveContainer" containerID="275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a"
Sep 08 15:13:45.856461 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.856441    2566 scope.go:117] "RemoveContainer" containerID="275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a"
Sep 08 15:13:45.856915 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:13:45.856892    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a\": container with ID starting with 275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a not found: ID does not exist" containerID="275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a"
Sep 08 15:13:45.857007 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.856927    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a"} err="failed to get container status \"275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a\": rpc error: code = NotFound desc = could not find container \"275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a\": container with ID starting with 275d07802c5cefde01bb307410f9389e410ea0323fb2155f5349d8df7c4ce13a not found: ID does not exist"
Sep 08 15:13:45.923326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.923290    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-trusted-ca\") pod \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") "
Sep 08 15:13:45.923326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.923329    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-image-registry-private-configuration\") pod \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") "
Sep 08 15:13:45.923573 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.923390    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-certificates\") pod \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") "
Sep 08 15:13:45.923573 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.923416    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-bound-sa-token\") pod \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") "
Sep 08 15:13:45.923573 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.923450    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls\") pod \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") "
Sep 08 15:13:45.923573 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.923493    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-ca-trust-extracted\") pod \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") "
Sep 08 15:13:45.923573 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.923548    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-installation-pull-secrets\") pod \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") "
Sep 08 15:13:45.923860 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.923577    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzvnc\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-kube-api-access-pzvnc\") pod \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\" (UID: \"eba7be55-f28b-4c5a-9eee-a28f2ea34c74\") "
Sep 08 15:13:45.923860 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.923813    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "eba7be55-f28b-4c5a-9eee-a28f2ea34c74" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:45.924037 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.924010    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "eba7be55-f28b-4c5a-9eee-a28f2ea34c74" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:45.926200 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.926143    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "eba7be55-f28b-4c5a-9eee-a28f2ea34c74" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:13:45.926470 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.926433    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "eba7be55-f28b-4c5a-9eee-a28f2ea34c74" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:45.926470 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.926451    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eba7be55-f28b-4c5a-9eee-a28f2ea34c74" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:45.926641 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.926580    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "eba7be55-f28b-4c5a-9eee-a28f2ea34c74" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:13:45.926641 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.926609    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-kube-api-access-pzvnc" (OuterVolumeSpecName: "kube-api-access-pzvnc") pod "eba7be55-f28b-4c5a-9eee-a28f2ea34c74" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74"). InnerVolumeSpecName "kube-api-access-pzvnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:45.932028 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:45.931998    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "eba7be55-f28b-4c5a-9eee-a28f2ea34c74" (UID: "eba7be55-f28b-4c5a-9eee-a28f2ea34c74"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:46.024443 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:46.024401    2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-certificates\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:13:46.024443 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:46.024443    2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-bound-sa-token\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:13:46.024443 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:46.024454    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-registry-tls\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:13:46.024781 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:46.024463    2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-ca-trust-extracted\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:13:46.024781 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:46.024471    2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-installation-pull-secrets\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:13:46.024781 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:46.024480    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzvnc\" (UniqueName: \"kubernetes.io/projected/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-kube-api-access-pzvnc\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:13:46.024781 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:46.024488    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-trusted-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:13:46.024781 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:46.024498    2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eba7be55-f28b-4c5a-9eee-a28f2ea34c74-image-registry-private-configuration\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:13:46.168172 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:46.168139    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c99dfcbc-wmr48"]
Sep 08 15:13:46.171852 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:46.171824    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c99dfcbc-wmr48"]
Sep 08 15:13:46.856521 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:46.856480    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxtfv" event={"ID":"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b","Type":"ContainerStarted","Data":"2af79f750e573649cd224eae4214ddf493b519cc1dbe8b745db2acd1631d9aa4"}
Sep 08 15:13:47.018077 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.017992    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-fvn57"]
Sep 08 15:13:47.018308 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.018293    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eba7be55-f28b-4c5a-9eee-a28f2ea34c74" containerName="registry"
Sep 08 15:13:47.018362 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.018313    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eba7be55-f28b-4c5a-9eee-a28f2ea34c74" containerName="registry"
Sep 08 15:13:47.018393 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.018369    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="eba7be55-f28b-4c5a-9eee-a28f2ea34c74" containerName="registry"
Sep 08 15:13:47.021231 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.021214    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-fvn57"
Sep 08 15:13:47.023963 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.023942    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 15:13:47.024076 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.023967    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 15:13:47.024076 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.023942    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bnnsr\""
Sep 08 15:13:47.034375 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.034350    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-fvn57"]
Sep 08 15:13:47.133144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.133104    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrpmv\" (UniqueName: \"kubernetes.io/projected/9f7ab5a3-dbbb-4130-8d68-c499e9c8c93a-kube-api-access-wrpmv\") pod \"downloads-85d98c998f-fvn57\" (UID: \"9f7ab5a3-dbbb-4130-8d68-c499e9c8c93a\") " pod="openshift-console/downloads-85d98c998f-fvn57"
Sep 08 15:13:47.234323 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.234285    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrpmv\" (UniqueName: \"kubernetes.io/projected/9f7ab5a3-dbbb-4130-8d68-c499e9c8c93a-kube-api-access-wrpmv\") pod \"downloads-85d98c998f-fvn57\" (UID: \"9f7ab5a3-dbbb-4130-8d68-c499e9c8c93a\") " pod="openshift-console/downloads-85d98c998f-fvn57"
Sep 08 15:13:47.243950 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.243918    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrpmv\" (UniqueName: \"kubernetes.io/projected/9f7ab5a3-dbbb-4130-8d68-c499e9c8c93a-kube-api-access-wrpmv\") pod \"downloads-85d98c998f-fvn57\" (UID: \"9f7ab5a3-dbbb-4130-8d68-c499e9c8c93a\") " pod="openshift-console/downloads-85d98c998f-fvn57"
Sep 08 15:13:47.330083 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.330053    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-fvn57"
Sep 08 15:13:47.604276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.604212    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-fvn57"]
Sep 08 15:13:47.606688 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:13:47.606661    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f7ab5a3_dbbb_4130_8d68_c499e9c8c93a.slice/crio-505708281ed1e1b421b734d785f066acc62e9f6d025a0383ee1527f5e55a9696 WatchSource:0}: Error finding container 505708281ed1e1b421b734d785f066acc62e9f6d025a0383ee1527f5e55a9696: Status 404 returned error can't find the container with id 505708281ed1e1b421b734d785f066acc62e9f6d025a0383ee1527f5e55a9696
Sep 08 15:13:47.861936 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.861841    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-fvn57" event={"ID":"9f7ab5a3-dbbb-4130-8d68-c499e9c8c93a","Type":"ContainerStarted","Data":"505708281ed1e1b421b734d785f066acc62e9f6d025a0383ee1527f5e55a9696"}
Sep 08 15:13:47.863596 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.863575    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxtfv" event={"ID":"ee258efd-c7f8-422c-8b15-8cb6e9a7b87b","Type":"ContainerStarted","Data":"bc5f4de742791562326b728546ad852fb751e632313a2c651a1765c08928b9d3"}
Sep 08 15:13:47.863741 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.863730    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:13:47.903145 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.903097    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xxtfv" podStartSLOduration=252.306322905 podStartE2EDuration="4m13.90308134s" totalImagesPullingTime="1.596758435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:47.902977631 +0000 UTC m=+288.474523673" watchObservedRunningTime="2026-09-08 15:13:47.90308134 +0000 UTC m=+288.474627381"
Sep 08 15:13:47.913168 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:47.913138    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eba7be55-f28b-4c5a-9eee-a28f2ea34c74" path="/var/lib/kubelet/pods/eba7be55-f28b-4c5a-9eee-a28f2ea34c74/volumes"
Sep 08 15:13:57.870785 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:57.870749    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xxtfv"
Sep 08 15:13:59.377136 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.377096    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c6977d54b-74nlr"]
Sep 08 15:13:59.382292 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.382265    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.385255 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.385224    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 15:13:59.385255 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.385244    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 15:13:59.385451 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.385279    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 15:13:59.386345 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.386252    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 15:13:59.386345 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.386329    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tnv7f\""
Sep 08 15:13:59.386539 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.386523    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 15:13:59.393528 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.393499    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6977d54b-74nlr"]
Sep 08 15:13:59.424653 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.424602    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wdpl\" (UniqueName: \"kubernetes.io/projected/227ef7c4-09da-4335-869f-95a3b66147e2-kube-api-access-7wdpl\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.424653 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.424662    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-oauth-serving-cert\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.424848 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.424695    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-serving-cert\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.424848 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.424713    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-oauth-config\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.424848 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.424734    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-service-ca\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.424848 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.424778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-console-config\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.526074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.526035    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wdpl\" (UniqueName: \"kubernetes.io/projected/227ef7c4-09da-4335-869f-95a3b66147e2-kube-api-access-7wdpl\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.526278 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.526093    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-oauth-serving-cert\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.526278 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.526139    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-serving-cert\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.526278 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.526164    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-oauth-config\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.526278 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.526197    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-service-ca\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.526278 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.526229    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-console-config\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.529066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.527647    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-oauth-serving-cert\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.529066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.527663    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-service-ca\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.529066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.528108    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-console-config\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.533284 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.531442    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-oauth-config\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.534750 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.534726    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-serving-cert\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.536440 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.536417    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wdpl\" (UniqueName: \"kubernetes.io/projected/227ef7c4-09da-4335-869f-95a3b66147e2-kube-api-access-7wdpl\") pod \"console-5c6977d54b-74nlr\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") " pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:13:59.694745 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:13:59.694654    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:14:03.634723 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:03.634686    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xxtfv_ee258efd-c7f8-422c-8b15-8cb6e9a7b87b/dns/0.log"
Sep 08 15:14:03.783774 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:03.783758    2566 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 15:14:03.832671 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:03.832645    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xxtfv_ee258efd-c7f8-422c-8b15-8cb6e9a7b87b/kube-rbac-proxy/0.log"
Sep 08 15:14:03.931093 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:03.931011    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-fvn57" event={"ID":"9f7ab5a3-dbbb-4130-8d68-c499e9c8c93a","Type":"ContainerStarted","Data":"0b8af9f39aa90cd309218eb7a1255689fdf710d437346a7ceb890ac62c7c9735"}
Sep 08 15:14:03.931270 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:03.931247    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-fvn57"
Sep 08 15:14:03.932538 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:03.932518    2566 patch_prober.go:28] interesting pod/downloads-85d98c998f-fvn57 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.19:8080/\": dial tcp 10.133.0.19:8080: connect: connection refused" start-of-body=
Sep 08 15:14:03.932590 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:03.932563    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-fvn57" podUID="9f7ab5a3-dbbb-4130-8d68-c499e9c8c93a" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.19:8080/\": dial tcp 10.133.0.19:8080: connect: connection refused"
Sep 08 15:14:03.951563 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:03.951511    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-fvn57" podStartSLOduration=1.74082246 podStartE2EDuration="17.951495229s" totalImagesPullingTime="16.210672769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:03.951009775 +0000 UTC m=+304.522555818" watchObservedRunningTime="2026-09-08 15:14:03.951495229 +0000 UTC m=+304.523041280"
Sep 08 15:14:04.005083 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:04.005010    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6977d54b-74nlr"]
Sep 08 15:14:04.008493 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:14:04.008456    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod227ef7c4_09da_4335_869f_95a3b66147e2.slice/crio-f73eeef6bf90355ff4f03e18aad63926442b393cc3640738f354b4c61a1c3d9c WatchSource:0}: Error finding container f73eeef6bf90355ff4f03e18aad63926442b393cc3640738f354b4c61a1c3d9c: Status 404 returned error can't find the container with id f73eeef6bf90355ff4f03e18aad63926442b393cc3640738f354b4c61a1c3d9c
Sep 08 15:14:04.011199 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:04.011170    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:14:04.232135 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:04.232055    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qt79p_8ad071ef-333f-4eb3-a211-690a174bf23f/dns-node-resolver/0.log"
Sep 08 15:14:04.938537 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:04.938478    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6977d54b-74nlr" event={"ID":"227ef7c4-09da-4335-869f-95a3b66147e2","Type":"ContainerStarted","Data":"f73eeef6bf90355ff4f03e18aad63926442b393cc3640738f354b4c61a1c3d9c"}
Sep 08 15:14:04.953057 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:04.953008    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-fvn57"
Sep 08 15:14:05.032674 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:05.031896    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bdl5b_d1932344-9198-44d7-a765-aa52cd8d5a6f/node-ca/0.log"
Sep 08 15:14:05.633179 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:05.633145    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d7c5f44b-s56g9_cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58/router/0.log"
Sep 08 15:14:05.832084 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:05.832053    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7vqck_efc545de-6c87-4145-9400-ea98638bd54f/serve-healthcheck-canary/0.log"
Sep 08 15:14:08.956691 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:08.956653    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6977d54b-74nlr" event={"ID":"227ef7c4-09da-4335-869f-95a3b66147e2","Type":"ContainerStarted","Data":"5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836"}
Sep 08 15:14:08.980533 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:08.980482    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c6977d54b-74nlr" podStartSLOduration=6.142748323 podStartE2EDuration="9.980465818s" totalImagesPullingTime="3.837717495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:08.980201463 +0000 UTC m=+309.551747506" watchObservedRunningTime="2026-09-08 15:14:08.980465818 +0000 UTC m=+309.552011859"
Sep 08 15:14:09.501678 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.501604    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5644f859f-68h4r"]
Sep 08 15:14:09.529857 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.529821    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5644f859f-68h4r"]
Sep 08 15:14:09.530054 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.529899    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.542253 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.542224    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 15:14:09.622131 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.622088    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-console-config\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.622394 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.622362    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-trusted-ca-bundle\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.622536 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.622443    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfql6\" (UniqueName: \"kubernetes.io/projected/b786d126-a754-41b5-9346-b3722dfa9561-kube-api-access-wfql6\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.622536 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.622477    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-oauth-config\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.622536 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.622500    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-serving-cert\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.622751 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.622535    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-oauth-serving-cert\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.622751 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.622676    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-service-ca\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.695600 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.695566    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:14:09.697064 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.697038    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:14:09.701605 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.701579    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:14:09.723456 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.723400    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-service-ca\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.723679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.723461    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-console-config\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.723679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.723490    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-trusted-ca-bundle\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.723679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.723545    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfql6\" (UniqueName: \"kubernetes.io/projected/b786d126-a754-41b5-9346-b3722dfa9561-kube-api-access-wfql6\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.723679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.723577    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-oauth-config\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.723679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.723603    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-serving-cert\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.723679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.723662    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-oauth-serving-cert\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.725165 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.724307    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-console-config\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.725165 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.724337    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-oauth-serving-cert\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.725165 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.724312    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-service-ca\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.725165 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.725112    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-trusted-ca-bundle\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.727355 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.727330    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-serving-cert\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.727525 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.727351    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-oauth-config\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.743749 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.743712    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfql6\" (UniqueName: \"kubernetes.io/projected/b786d126-a754-41b5-9346-b3722dfa9561-kube-api-access-wfql6\") pod \"console-5644f859f-68h4r\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") " pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.844969 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.844932    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:09.969902 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:09.969841    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:14:10.150178 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:10.150091    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5644f859f-68h4r"]
Sep 08 15:14:10.154260 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:14:10.154229    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb786d126_a754_41b5_9346_b3722dfa9561.slice/crio-b07eb789ed1ff4cb3726c44d319897e08750ef7053230eeb612023e8eafd7e4f WatchSource:0}: Error finding container b07eb789ed1ff4cb3726c44d319897e08750ef7053230eeb612023e8eafd7e4f: Status 404 returned error can't find the container with id b07eb789ed1ff4cb3726c44d319897e08750ef7053230eeb612023e8eafd7e4f
Sep 08 15:14:10.969773 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:10.969730    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5644f859f-68h4r" event={"ID":"b786d126-a754-41b5-9346-b3722dfa9561","Type":"ContainerStarted","Data":"bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328"}
Sep 08 15:14:10.969966 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:10.969791    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5644f859f-68h4r" event={"ID":"b786d126-a754-41b5-9346-b3722dfa9561","Type":"ContainerStarted","Data":"b07eb789ed1ff4cb3726c44d319897e08750ef7053230eeb612023e8eafd7e4f"}
Sep 08 15:14:10.997892 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:10.997833    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5644f859f-68h4r" podStartSLOduration=1.9978139179999999 podStartE2EDuration="1.997813918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:10.995745404 +0000 UTC m=+311.567291449" watchObservedRunningTime="2026-09-08 15:14:10.997813918 +0000 UTC m=+311.569359960"
Sep 08 15:14:15.994363 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:15.994328    2566 generic.go:356] "Generic (PLEG): container finished" podID="4e859424-bb94-453e-8a24-af637d4d2ac7" containerID="57c2bd040de40d44c1090ec6a030200149bb808891db6927b913f72b2d89e201" exitCode=0
Sep 08 15:14:15.994902 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:15.994366    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74" event={"ID":"4e859424-bb94-453e-8a24-af637d4d2ac7","Type":"ContainerDied","Data":"57c2bd040de40d44c1090ec6a030200149bb808891db6927b913f72b2d89e201"}
Sep 08 15:14:15.994902 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:15.994775    2566 scope.go:117] "RemoveContainer" containerID="57c2bd040de40d44c1090ec6a030200149bb808891db6927b913f72b2d89e201"
Sep 08 15:14:17.001403 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:17.001367    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kvf74" event={"ID":"4e859424-bb94-453e-8a24-af637d4d2ac7","Type":"ContainerStarted","Data":"e5c02aabfa2b0545351fcae159e25b6d55e82d16839041e32eebe45e33c1aee8"}
Sep 08 15:14:19.845076 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:19.845043    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:19.845562 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:19.845110    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:19.850087 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:19.850058    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:20.020718 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:20.020689    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:14:20.082394 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:20.082356    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6977d54b-74nlr"]
Sep 08 15:14:45.103824 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.103780    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c6977d54b-74nlr" podUID="227ef7c4-09da-4335-869f-95a3b66147e2" containerName="console" containerID="cri-o://5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836" gracePeriod=15
Sep 08 15:14:45.376229 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.376129    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:14:45.540043 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.540006    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-serving-cert\") pod \"227ef7c4-09da-4335-869f-95a3b66147e2\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") "
Sep 08 15:14:45.540043 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.540047    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-service-ca\") pod \"227ef7c4-09da-4335-869f-95a3b66147e2\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") "
Sep 08 15:14:45.540302 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.540083    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-console-config\") pod \"227ef7c4-09da-4335-869f-95a3b66147e2\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") "
Sep 08 15:14:45.540302 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.540107    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-oauth-config\") pod \"227ef7c4-09da-4335-869f-95a3b66147e2\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") "
Sep 08 15:14:45.540302 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.540149    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-oauth-serving-cert\") pod \"227ef7c4-09da-4335-869f-95a3b66147e2\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") "
Sep 08 15:14:45.540302 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.540210    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wdpl\" (UniqueName: \"kubernetes.io/projected/227ef7c4-09da-4335-869f-95a3b66147e2-kube-api-access-7wdpl\") pod \"227ef7c4-09da-4335-869f-95a3b66147e2\" (UID: \"227ef7c4-09da-4335-869f-95a3b66147e2\") "
Sep 08 15:14:45.540494 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.540463    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-service-ca" (OuterVolumeSpecName: "service-ca") pod "227ef7c4-09da-4335-869f-95a3b66147e2" (UID: "227ef7c4-09da-4335-869f-95a3b66147e2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:14:45.540494 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.540479    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-console-config" (OuterVolumeSpecName: "console-config") pod "227ef7c4-09da-4335-869f-95a3b66147e2" (UID: "227ef7c4-09da-4335-869f-95a3b66147e2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:14:45.540584 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.540562    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "227ef7c4-09da-4335-869f-95a3b66147e2" (UID: "227ef7c4-09da-4335-869f-95a3b66147e2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:14:45.542546 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.542518    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "227ef7c4-09da-4335-869f-95a3b66147e2" (UID: "227ef7c4-09da-4335-869f-95a3b66147e2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:14:45.542546 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.542533    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "227ef7c4-09da-4335-869f-95a3b66147e2" (UID: "227ef7c4-09da-4335-869f-95a3b66147e2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:14:45.542726 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.542562    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/227ef7c4-09da-4335-869f-95a3b66147e2-kube-api-access-7wdpl" (OuterVolumeSpecName: "kube-api-access-7wdpl") pod "227ef7c4-09da-4335-869f-95a3b66147e2" (UID: "227ef7c4-09da-4335-869f-95a3b66147e2"). InnerVolumeSpecName "kube-api-access-7wdpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:14:45.641679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.641572    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wdpl\" (UniqueName: \"kubernetes.io/projected/227ef7c4-09da-4335-869f-95a3b66147e2-kube-api-access-7wdpl\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:45.641679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.641605    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-serving-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:45.641679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.641614    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:45.641679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.641646    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-console-config\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:45.641679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.641654    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/227ef7c4-09da-4335-869f-95a3b66147e2-console-oauth-config\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:45.641679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:45.641661    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/227ef7c4-09da-4335-869f-95a3b66147e2-oauth-serving-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:46.123784 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:46.123752    2566 generic.go:356] "Generic (PLEG): container finished" podID="227ef7c4-09da-4335-869f-95a3b66147e2" containerID="5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836" exitCode=0
Sep 08 15:14:46.124250 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:46.123801    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6977d54b-74nlr"
Sep 08 15:14:46.124250 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:46.123844    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6977d54b-74nlr" event={"ID":"227ef7c4-09da-4335-869f-95a3b66147e2","Type":"ContainerDied","Data":"5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836"}
Sep 08 15:14:46.124250 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:46.123906    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6977d54b-74nlr" event={"ID":"227ef7c4-09da-4335-869f-95a3b66147e2","Type":"ContainerDied","Data":"f73eeef6bf90355ff4f03e18aad63926442b393cc3640738f354b4c61a1c3d9c"}
Sep 08 15:14:46.124250 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:46.123940    2566 scope.go:117] "RemoveContainer" containerID="5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836"
Sep 08 15:14:46.132467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:46.132449    2566 scope.go:117] "RemoveContainer" containerID="5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836"
Sep 08 15:14:46.132796 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:14:46.132777    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836\": container with ID starting with 5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836 not found: ID does not exist" containerID="5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836"
Sep 08 15:14:46.132873 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:46.132807    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836"} err="failed to get container status \"5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836\": rpc error: code = NotFound desc = could not find container \"5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836\": container with ID starting with 5d85dc09b5ba0cfdaffe1ffa0ad7850ae50926289d5077fb2bb92749c2f73836 not found: ID does not exist"
Sep 08 15:14:46.140709 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:46.140613    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6977d54b-74nlr"]
Sep 08 15:14:46.144632 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:46.144595    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c6977d54b-74nlr"]
Sep 08 15:14:47.848570 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:47.848536    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:14:47.849026 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:47.848840    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="alertmanager" containerID="cri-o://79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef" gracePeriod=120
Sep 08 15:14:47.849026 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:47.848921    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy-metric" containerID="cri-o://1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62" gracePeriod=120
Sep 08 15:14:47.849026 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:47.848945    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="prom-label-proxy" containerID="cri-o://e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6" gracePeriod=120
Sep 08 15:14:47.849026 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:47.849001    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="config-reloader" containerID="cri-o://a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86" gracePeriod=120
Sep 08 15:14:47.849026 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:47.848951    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy-web" containerID="cri-o://8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a" gracePeriod=120
Sep 08 15:14:47.849293 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:47.849011    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy" containerID="cri-o://dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb" gracePeriod=120
Sep 08 15:14:47.917741 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:47.915252    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="227ef7c4-09da-4335-869f-95a3b66147e2" path="/var/lib/kubelet/pods/227ef7c4-09da-4335-869f-95a3b66147e2/volumes"
Sep 08 15:14:48.137264 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:48.137185    2566 generic.go:356] "Generic (PLEG): container finished" podID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerID="e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6" exitCode=0
Sep 08 15:14:48.137264 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:48.137210    2566 generic.go:356] "Generic (PLEG): container finished" podID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerID="1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62" exitCode=0
Sep 08 15:14:48.137264 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:48.137217    2566 generic.go:356] "Generic (PLEG): container finished" podID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerID="dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb" exitCode=0
Sep 08 15:14:48.137264 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:48.137223    2566 generic.go:356] "Generic (PLEG): container finished" podID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerID="a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86" exitCode=0
Sep 08 15:14:48.137264 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:48.137228    2566 generic.go:356] "Generic (PLEG): container finished" podID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerID="79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef" exitCode=0
Sep 08 15:14:48.137525 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:48.137262    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerDied","Data":"e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6"}
Sep 08 15:14:48.137525 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:48.137329    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerDied","Data":"1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62"}
Sep 08 15:14:48.137525 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:48.137356    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerDied","Data":"dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb"}
Sep 08 15:14:48.137525 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:48.137379    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerDied","Data":"a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86"}
Sep 08 15:14:48.137525 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:48.137403    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerDied","Data":"79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef"}
Sep 08 15:14:49.127385 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.127351    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.144576 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.144546    2566 generic.go:356] "Generic (PLEG): container finished" podID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerID="8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a" exitCode=0
Sep 08 15:14:49.144766 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.144597    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerDied","Data":"8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a"}
Sep 08 15:14:49.144766 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.144636    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.144766 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.144692    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a9f630c-8c1a-4895-bb0b-e74586e4dce3","Type":"ContainerDied","Data":"ee05311c05d072c41ea45a445ebc66dacbad29c614435906e0aecaf3c300f65c"}
Sep 08 15:14:49.144766 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.144728    2566 scope.go:117] "RemoveContainer" containerID="e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6"
Sep 08 15:14:49.152136 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.152118    2566 scope.go:117] "RemoveContainer" containerID="1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62"
Sep 08 15:14:49.160177 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.160151    2566 scope.go:117] "RemoveContainer" containerID="dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb"
Sep 08 15:14:49.168958 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.168907    2566 scope.go:117] "RemoveContainer" containerID="8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a"
Sep 08 15:14:49.169551 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.169526    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-main-tls\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.169697 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.169578    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-volume\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.169697 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.169638    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrfhc\" (UniqueName: \"kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-kube-api-access-jrfhc\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.169697 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.169667    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-web\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.169869 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.169709    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.169869 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.169852    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.169968 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.169899    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-metrics-client-ca\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.169968 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.169940    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-out\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.169968 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.169965    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-tls-assets\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.170112 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.169998    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-web-config\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.170112 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.170025    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-cluster-tls-config\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.170112 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.170087    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-main-db\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.170235 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.170111    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-trusted-ca-bundle\") pod \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\" (UID: \"0a9f630c-8c1a-4895-bb0b-e74586e4dce3\") "
Sep 08 15:14:49.171260 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.171120    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:14:49.171937 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.171912    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:14:49.173951 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.173926    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:14:49.179784 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.179592    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:14:49.179784 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.179677    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:14:49.179784 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.179612    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-out" (OuterVolumeSpecName: "config-out") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:14:49.180727 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.180698    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:14:49.181525 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.181471    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:14:49.181649 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.181582    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:14:49.183373 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.183344    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-volume" (OuterVolumeSpecName: "config-volume") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:14:49.183555 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.183423    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-kube-api-access-jrfhc" (OuterVolumeSpecName: "kube-api-access-jrfhc") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "kube-api-access-jrfhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:14:49.183914 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.183890    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:14:49.190644 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.190603    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-web-config" (OuterVolumeSpecName: "web-config") pod "0a9f630c-8c1a-4895-bb0b-e74586e4dce3" (UID: "0a9f630c-8c1a-4895-bb0b-e74586e4dce3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:14:49.196437 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.196415    2566 scope.go:117] "RemoveContainer" containerID="a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86"
Sep 08 15:14:49.204435 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.204414    2566 scope.go:117] "RemoveContainer" containerID="79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef"
Sep 08 15:14:49.212837 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.212808    2566 scope.go:117] "RemoveContainer" containerID="fd3ced3233f70384a95ff5cc689579aded40575394d94c5dd5439d661f3727d4"
Sep 08 15:14:49.220142 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.220120    2566 scope.go:117] "RemoveContainer" containerID="e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6"
Sep 08 15:14:49.220521 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:14:49.220504    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6\": container with ID starting with e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6 not found: ID does not exist" containerID="e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6"
Sep 08 15:14:49.220569 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.220532    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6"} err="failed to get container status \"e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6\": rpc error: code = NotFound desc = could not find container \"e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6\": container with ID starting with e12042801eb6a2044c48a4f5e0a6098494c66ecafc82a49e4f3e3d948e1711b6 not found: ID does not exist"
Sep 08 15:14:49.220569 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.220552    2566 scope.go:117] "RemoveContainer" containerID="1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62"
Sep 08 15:14:49.220840 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:14:49.220822    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62\": container with ID starting with 1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62 not found: ID does not exist" containerID="1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62"
Sep 08 15:14:49.220894 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.220848    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62"} err="failed to get container status \"1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62\": rpc error: code = NotFound desc = could not find container \"1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62\": container with ID starting with 1bb6d183dd58e0d2f6c002cc3037b9f4b0f596b5480b9bc2d26fec150b677b62 not found: ID does not exist"
Sep 08 15:14:49.220894 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.220863    2566 scope.go:117] "RemoveContainer" containerID="dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb"
Sep 08 15:14:49.221133 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:14:49.221118    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb\": container with ID starting with dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb not found: ID does not exist" containerID="dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb"
Sep 08 15:14:49.221188 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.221134    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb"} err="failed to get container status \"dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb\": rpc error: code = NotFound desc = could not find container \"dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb\": container with ID starting with dd18023d78b2a28f0ed3ba14eb29da62ef593c72738275e24c246b73539898eb not found: ID does not exist"
Sep 08 15:14:49.221188 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.221146    2566 scope.go:117] "RemoveContainer" containerID="8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a"
Sep 08 15:14:49.221377 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:14:49.221360    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a\": container with ID starting with 8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a not found: ID does not exist" containerID="8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a"
Sep 08 15:14:49.221417 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.221383    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a"} err="failed to get container status \"8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a\": rpc error: code = NotFound desc = could not find container \"8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a\": container with ID starting with 8177ae6dcbb1bea1a04b0d8c72c4ee359c7c90d81e07f6f6fdacdcf80695023a not found: ID does not exist"
Sep 08 15:14:49.221417 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.221396    2566 scope.go:117] "RemoveContainer" containerID="a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86"
Sep 08 15:14:49.221746 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:14:49.221732    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86\": container with ID starting with a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86 not found: ID does not exist" containerID="a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86"
Sep 08 15:14:49.221801 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.221749    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86"} err="failed to get container status \"a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86\": rpc error: code = NotFound desc = could not find container \"a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86\": container with ID starting with a7d1c8554765b107ef91dd6ceeacb0de5866d4d4b09e5b03cadced2908acdf86 not found: ID does not exist"
Sep 08 15:14:49.221801 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.221762    2566 scope.go:117] "RemoveContainer" containerID="79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef"
Sep 08 15:14:49.222019 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:14:49.222002    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef\": container with ID starting with 79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef not found: ID does not exist" containerID="79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef"
Sep 08 15:14:49.222073 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.222024    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef"} err="failed to get container status \"79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef\": rpc error: code = NotFound desc = could not find container \"79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef\": container with ID starting with 79ad67de690c856c4acbbf08ff5abfdc23b7559dba3b7cd1952ce0f1065f55ef not found: ID does not exist"
Sep 08 15:14:49.222073 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.222042    2566 scope.go:117] "RemoveContainer" containerID="fd3ced3233f70384a95ff5cc689579aded40575394d94c5dd5439d661f3727d4"
Sep 08 15:14:49.222320 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:14:49.222304    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd3ced3233f70384a95ff5cc689579aded40575394d94c5dd5439d661f3727d4\": container with ID starting with fd3ced3233f70384a95ff5cc689579aded40575394d94c5dd5439d661f3727d4 not found: ID does not exist" containerID="fd3ced3233f70384a95ff5cc689579aded40575394d94c5dd5439d661f3727d4"
Sep 08 15:14:49.222359 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.222323    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd3ced3233f70384a95ff5cc689579aded40575394d94c5dd5439d661f3727d4"} err="failed to get container status \"fd3ced3233f70384a95ff5cc689579aded40575394d94c5dd5439d661f3727d4\": rpc error: code = NotFound desc = could not find container \"fd3ced3233f70384a95ff5cc689579aded40575394d94c5dd5439d661f3727d4\": container with ID starting with fd3ced3233f70384a95ff5cc689579aded40575394d94c5dd5439d661f3727d4 not found: ID does not exist"
Sep 08 15:14:49.270965 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.270926    2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-web-config\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.270965 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.270960    2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-cluster-tls-config\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.270965 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.270971    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-main-db\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.271217 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.270982    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.271217 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.270993    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-main-tls\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.271217 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.271001    2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.271217 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.271009    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrfhc\" (UniqueName: \"kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-kube-api-access-jrfhc\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.271217 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.271017    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.271217 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.271026    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.271217 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.271036    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.271217 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.271046    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-metrics-client-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.271217 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.271053    2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-config-out\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.271217 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.271060    2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a9f630c-8c1a-4895-bb0b-e74586e4dce3-tls-assets\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:14:49.469845 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.469809    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:14:49.474190 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.474165    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:14:49.500579 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500548    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:14:49.500879 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500861    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy"
Sep 08 15:14:49.500920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500882    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy"
Sep 08 15:14:49.500920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500893    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="init-config-reloader"
Sep 08 15:14:49.500920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500899    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="init-config-reloader"
Sep 08 15:14:49.500920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500911    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy-metric"
Sep 08 15:14:49.500920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500917    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy-metric"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500924    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="config-reloader"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500930    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="config-reloader"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500939    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="alertmanager"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500949    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="alertmanager"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500956    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy-web"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500962    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy-web"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500968    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="prom-label-proxy"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500974    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="prom-label-proxy"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500981    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="227ef7c4-09da-4335-869f-95a3b66147e2" containerName="console"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.500985    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="227ef7c4-09da-4335-869f-95a3b66147e2" containerName="console"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.501040    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="prom-label-proxy"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.501048    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="alertmanager"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.501054    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.501060    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="227ef7c4-09da-4335-869f-95a3b66147e2" containerName="console"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.501065    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy-web"
Sep 08 15:14:49.501066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.501070    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="config-reloader"
Sep 08 15:14:49.501546 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.501074    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" containerName="kube-rbac-proxy-metric"
Sep 08 15:14:49.534629 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.534598    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:14:49.534802 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.534752    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.537392 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.537369    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 15:14:49.537685 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.537668    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 15:14:49.537832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.537687    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 15:14:49.537832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.537695    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 15:14:49.537832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.537689    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 15:14:49.538069 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.538027    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 15:14:49.538265 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.538250    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 15:14:49.538421 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.538403    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 15:14:49.539267 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.539251    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6nh8c\""
Sep 08 15:14:49.542788 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.542768    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 15:14:49.572265 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572231    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572265 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572276    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572486 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572302    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572486 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572326    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572486 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572356    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-config-out\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572486 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572376    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572486 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572409    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wcds\" (UniqueName: \"kubernetes.io/projected/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-kube-api-access-2wcds\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572486 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572463    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572700 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572493    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572700 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572525    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572700 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572581    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572700 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572609    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-web-config\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.572700 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.572645    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673119 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673076    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673119 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673124    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-config-out\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673366 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673229    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673366 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673262    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wcds\" (UniqueName: \"kubernetes.io/projected/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-kube-api-access-2wcds\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673366 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673298    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673366 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673326    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673578 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673578 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673422    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673578 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673447    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-web-config\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673578 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673472    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673578 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673513    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673578 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673539    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.673578 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673565    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.674097 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.673708    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.674448 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.674386    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.675378 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.675348    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.676579 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.676552    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.676725 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.676706    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-web-config\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.676782 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.676769    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.676871 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.676856    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-config-out\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.677314 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.677289    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.677314 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.677308    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.677523 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.677342    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.677523 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.677490    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.678553 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.678535    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.682485 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.682459    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wcds\" (UniqueName: \"kubernetes.io/projected/a545d7a4-a6b5-4329-af4e-9bf3a6064d8d-kube-api-access-2wcds\") pod \"alertmanager-main-0\" (UID: \"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.844201 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.844167    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 15:14:49.914755 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:49.914716    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a9f630c-8c1a-4895-bb0b-e74586e4dce3" path="/var/lib/kubelet/pods/0a9f630c-8c1a-4895-bb0b-e74586e4dce3/volumes"
Sep 08 15:14:50.157311 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:50.157239    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 15:14:50.160353 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:14:50.160326    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda545d7a4_a6b5_4329_af4e_9bf3a6064d8d.slice/crio-eea60e9b200e69d1824f3a219a0e6655959f39aba6042b2a98b5d7094e11d1c5 WatchSource:0}: Error finding container eea60e9b200e69d1824f3a219a0e6655959f39aba6042b2a98b5d7094e11d1c5: Status 404 returned error can't find the container with id eea60e9b200e69d1824f3a219a0e6655959f39aba6042b2a98b5d7094e11d1c5
Sep 08 15:14:51.155102 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.155070    2566 generic.go:356] "Generic (PLEG): container finished" podID="a545d7a4-a6b5-4329-af4e-9bf3a6064d8d" containerID="167751d24888f60c64ab120203883275f54f14601ae0ad9d11c33285a827e1f0" exitCode=0
Sep 08 15:14:51.155309 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.155139    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d","Type":"ContainerDied","Data":"167751d24888f60c64ab120203883275f54f14601ae0ad9d11c33285a827e1f0"}
Sep 08 15:14:51.155309 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.155224    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d","Type":"ContainerStarted","Data":"eea60e9b200e69d1824f3a219a0e6655959f39aba6042b2a98b5d7094e11d1c5"}
Sep 08 15:14:51.930268 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.930228    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"]
Sep 08 15:14:51.933400 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.933373    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:51.936405 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.936381    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 08 15:14:51.936405 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.936400    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 08 15:14:51.936602 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.936400    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 08 15:14:51.936916 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.936898    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-q5kwf\""
Sep 08 15:14:51.937005 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.936950    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 08 15:14:51.937005 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.936898    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 08 15:14:51.941986 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.941959    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 08 15:14:51.949454 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.949426    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"]
Sep 08 15:14:51.992530 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.992490    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-secret-telemeter-client\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:51.992530 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.992533    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7d784e1-8a27-49b9-93c3-11675720c306-metrics-client-ca\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:51.992814 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.992664    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-federate-client-tls\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:51.992814 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.992729    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-telemeter-client-tls\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:51.992814 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.992749    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:51.992814 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.992782    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7d784e1-8a27-49b9-93c3-11675720c306-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:51.992814 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.992808    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftp78\" (UniqueName: \"kubernetes.io/projected/e7d784e1-8a27-49b9-93c3-11675720c306-kube-api-access-ftp78\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:51.993059 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:51.992841    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7d784e1-8a27-49b9-93c3-11675720c306-serving-certs-ca-bundle\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.093910 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.093872    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7d784e1-8a27-49b9-93c3-11675720c306-serving-certs-ca-bundle\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.093910 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.093915    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-secret-telemeter-client\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.094144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.093938    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7d784e1-8a27-49b9-93c3-11675720c306-metrics-client-ca\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.094144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.093967    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-federate-client-tls\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.094144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.093996    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-telemeter-client-tls\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.094144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.094012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.094144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.094042    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7d784e1-8a27-49b9-93c3-11675720c306-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.094144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.094069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftp78\" (UniqueName: \"kubernetes.io/projected/e7d784e1-8a27-49b9-93c3-11675720c306-kube-api-access-ftp78\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.094935 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.094809    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7d784e1-8a27-49b9-93c3-11675720c306-serving-certs-ca-bundle\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.095107 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.095082    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7d784e1-8a27-49b9-93c3-11675720c306-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.095301 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.095195    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7d784e1-8a27-49b9-93c3-11675720c306-metrics-client-ca\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.096749 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.096722    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.096921 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.096902    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-secret-telemeter-client\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.096965 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.096941    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-federate-client-tls\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.097002 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.096973    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e7d784e1-8a27-49b9-93c3-11675720c306-telemeter-client-tls\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.109570 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.109539    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftp78\" (UniqueName: \"kubernetes.io/projected/e7d784e1-8a27-49b9-93c3-11675720c306-kube-api-access-ftp78\") pod \"telemeter-client-5669fb68ff-2n5rc\" (UID: \"e7d784e1-8a27-49b9-93c3-11675720c306\") " pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.167877 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.167832    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d","Type":"ContainerStarted","Data":"53d7d375bfbfd4691476000bde07d25bd9a0a3763f41224cdf40924603cfa09f"}
Sep 08 15:14:52.168083 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.167929    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d","Type":"ContainerStarted","Data":"dd5e4aded3ecdf6753a67224998a96dcb819d7d2b0dd2ef72f06dbc4f5ec42a4"}
Sep 08 15:14:52.168083 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.167976    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d","Type":"ContainerStarted","Data":"d24877117a2c692460f126764f6168f0d41ce3be9397bcf6cd1b0e4c049db954"}
Sep 08 15:14:52.168083 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.168020    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d","Type":"ContainerStarted","Data":"65a8c0851a407f89379cb948fa0d6236022097803d11cf9646dedd34253003b3"}
Sep 08 15:14:52.168083 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.168061    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d","Type":"ContainerStarted","Data":"c8f9f0b5cf113a21fc9b1f84edab630617f262615543109f28b5ba6d82db32f3"}
Sep 08 15:14:52.168346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.168103    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a545d7a4-a6b5-4329-af4e-9bf3a6064d8d","Type":"ContainerStarted","Data":"1da47acbd9f704071a0b1f0d5d51ea6724035b7a42c02d3841d14d1842420a6c"}
Sep 08 15:14:52.203437 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.203310    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.182297884 podStartE2EDuration="3.203288043s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.990159ms" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:52.201598111 +0000 UTC m=+352.773144144" watchObservedRunningTime="2026-09-08 15:14:52.203288043 +0000 UTC m=+352.774834086"
Sep 08 15:14:52.256557 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.256515    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"
Sep 08 15:14:52.543849 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:52.543765    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5669fb68ff-2n5rc"]
Sep 08 15:14:52.547480 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:14:52.547452    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d784e1_8a27_49b9_93c3_11675720c306.slice/crio-71338cc93c0d8eefa1b941e671995327bfadfca1b38f66608615498a8ad9bc76 WatchSource:0}: Error finding container 71338cc93c0d8eefa1b941e671995327bfadfca1b38f66608615498a8ad9bc76: Status 404 returned error can't find the container with id 71338cc93c0d8eefa1b941e671995327bfadfca1b38f66608615498a8ad9bc76
Sep 08 15:14:53.178534 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:53.178493    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc" event={"ID":"e7d784e1-8a27-49b9-93c3-11675720c306","Type":"ContainerStarted","Data":"71338cc93c0d8eefa1b941e671995327bfadfca1b38f66608615498a8ad9bc76"}
Sep 08 15:14:56.192847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.192760    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc" event={"ID":"e7d784e1-8a27-49b9-93c3-11675720c306","Type":"ContainerStarted","Data":"7bd046788386d165a7b61cd1d14a9d6ef739872e1dba606d3458afd7c552a537"}
Sep 08 15:14:56.192847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.192815    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc" event={"ID":"e7d784e1-8a27-49b9-93c3-11675720c306","Type":"ContainerStarted","Data":"5c7e2960e0cea1043c8d40602d9f10a58a1478faadf629b0926822c5a6fd0521"}
Sep 08 15:14:56.192847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.192833    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc" event={"ID":"e7d784e1-8a27-49b9-93c3-11675720c306","Type":"ContainerStarted","Data":"2673c0ada5661b5c5d2f74c490ebbdf666cb0295dfd8ea11db7b96e69da47eea"}
Sep 08 15:14:56.219731 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.219684    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5669fb68ff-2n5rc" podStartSLOduration=1.879119623 podStartE2EDuration="5.219668256s" totalImagesPullingTime="3.340548633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:56.217939116 +0000 UTC m=+356.789485168" watchObservedRunningTime="2026-09-08 15:14:56.219668256 +0000 UTC m=+356.791214328"
Sep 08 15:14:56.312856 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.312818    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86689cd86-2kz84"]
Sep 08 15:14:56.315097 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.315075    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.327727 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.327696    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86689cd86-2kz84"]
Sep 08 15:14:56.330341 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.330318    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-trusted-ca-bundle\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.330492 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.330351    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-config\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.330492 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.330384    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-service-ca\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.330492 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.330479    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-oauth-serving-cert\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.330649 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.330508    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knggg\" (UniqueName: \"kubernetes.io/projected/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-kube-api-access-knggg\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.330649 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.330535    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-serving-cert\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.330649 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.330591    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-oauth-config\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.431139 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.431094    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-oauth-serving-cert\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.431339 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.431156    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knggg\" (UniqueName: \"kubernetes.io/projected/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-kube-api-access-knggg\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.431339 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.431184    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-serving-cert\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.431339 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.431205    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-oauth-config\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.431339 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.431249    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-trusted-ca-bundle\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.431339 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.431272    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-config\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.431339 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.431305    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-service-ca\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.431980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.431947    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-oauth-serving-cert\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.432094 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.431982    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-config\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.432094 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.432083    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-service-ca\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.432372 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.432152    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-trusted-ca-bundle\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.433770 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.433752    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-oauth-config\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.433972 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.433955    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-serving-cert\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.439841 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.439771    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knggg\" (UniqueName: \"kubernetes.io/projected/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-kube-api-access-knggg\") pod \"console-86689cd86-2kz84\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") " pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.624731 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.624694    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:14:56.897594 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:56.897517    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86689cd86-2kz84"]
Sep 08 15:14:56.901152 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:14:56.901116    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c1c7ab_f57e_4d13_9c87_ec877efc1fa4.slice/crio-22e4a5b1f990be260bf981d3fe1bf9fe170a836342ea616d21de6c8dc4c3a08b WatchSource:0}: Error finding container 22e4a5b1f990be260bf981d3fe1bf9fe170a836342ea616d21de6c8dc4c3a08b: Status 404 returned error can't find the container with id 22e4a5b1f990be260bf981d3fe1bf9fe170a836342ea616d21de6c8dc4c3a08b
Sep 08 15:14:57.199487 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:57.199365    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86689cd86-2kz84" event={"ID":"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4","Type":"ContainerStarted","Data":"6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85"}
Sep 08 15:14:57.199487 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:57.199426    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86689cd86-2kz84" event={"ID":"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4","Type":"ContainerStarted","Data":"22e4a5b1f990be260bf981d3fe1bf9fe170a836342ea616d21de6c8dc4c3a08b"}
Sep 08 15:14:57.220760 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:14:57.220675    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86689cd86-2kz84" podStartSLOduration=1.220654444 podStartE2EDuration="1.220654444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:57.219076852 +0000 UTC m=+357.790622894" watchObservedRunningTime="2026-09-08 15:14:57.220654444 +0000 UTC m=+357.792200486"
Sep 08 15:15:06.625850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:06.625796    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:15:06.625850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:06.625874    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:15:06.630829 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:06.630804    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:15:07.241800 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:07.241764    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:15:07.291943 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:07.291907    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5644f859f-68h4r"]
Sep 08 15:15:32.314373 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.314307    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5644f859f-68h4r" podUID="b786d126-a754-41b5-9346-b3722dfa9561" containerName="console" containerID="cri-o://bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328" gracePeriod=15
Sep 08 15:15:32.550359 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.550332    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:15:32.647689 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.647647    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-oauth-config\") pod \"b786d126-a754-41b5-9346-b3722dfa9561\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") "
Sep 08 15:15:32.647864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.647701    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfql6\" (UniqueName: \"kubernetes.io/projected/b786d126-a754-41b5-9346-b3722dfa9561-kube-api-access-wfql6\") pod \"b786d126-a754-41b5-9346-b3722dfa9561\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") "
Sep 08 15:15:32.647864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.647728    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-console-config\") pod \"b786d126-a754-41b5-9346-b3722dfa9561\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") "
Sep 08 15:15:32.647864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.647754    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-oauth-serving-cert\") pod \"b786d126-a754-41b5-9346-b3722dfa9561\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") "
Sep 08 15:15:32.647864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.647833    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-trusted-ca-bundle\") pod \"b786d126-a754-41b5-9346-b3722dfa9561\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") "
Sep 08 15:15:32.647864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.647857    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-serving-cert\") pod \"b786d126-a754-41b5-9346-b3722dfa9561\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") "
Sep 08 15:15:32.648115 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.647883    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-service-ca\") pod \"b786d126-a754-41b5-9346-b3722dfa9561\" (UID: \"b786d126-a754-41b5-9346-b3722dfa9561\") "
Sep 08 15:15:32.648222 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.648172    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-console-config" (OuterVolumeSpecName: "console-config") pod "b786d126-a754-41b5-9346-b3722dfa9561" (UID: "b786d126-a754-41b5-9346-b3722dfa9561"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:15:32.648324 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.648277    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b786d126-a754-41b5-9346-b3722dfa9561" (UID: "b786d126-a754-41b5-9346-b3722dfa9561"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:15:32.648324 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.648179    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b786d126-a754-41b5-9346-b3722dfa9561" (UID: "b786d126-a754-41b5-9346-b3722dfa9561"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:15:32.648425 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.648391    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-service-ca" (OuterVolumeSpecName: "service-ca") pod "b786d126-a754-41b5-9346-b3722dfa9561" (UID: "b786d126-a754-41b5-9346-b3722dfa9561"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:15:32.650077 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.650047    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b786d126-a754-41b5-9346-b3722dfa9561" (UID: "b786d126-a754-41b5-9346-b3722dfa9561"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:15:32.650077 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.650059    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b786d126-a754-41b5-9346-b3722dfa9561" (UID: "b786d126-a754-41b5-9346-b3722dfa9561"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:15:32.650077 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.650063    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b786d126-a754-41b5-9346-b3722dfa9561-kube-api-access-wfql6" (OuterVolumeSpecName: "kube-api-access-wfql6") pod "b786d126-a754-41b5-9346-b3722dfa9561" (UID: "b786d126-a754-41b5-9346-b3722dfa9561"). InnerVolumeSpecName "kube-api-access-wfql6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:15:32.748719 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.748681    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-console-config\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:15:32.748719 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.748715    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-oauth-serving-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:15:32.748719 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.748725    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-trusted-ca-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:15:32.748956 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.748734    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-serving-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:15:32.748956 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.748742    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b786d126-a754-41b5-9346-b3722dfa9561-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:15:32.748956 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.748750    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b786d126-a754-41b5-9346-b3722dfa9561-console-oauth-config\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:15:32.748956 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:32.748758    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfql6\" (UniqueName: \"kubernetes.io/projected/b786d126-a754-41b5-9346-b3722dfa9561-kube-api-access-wfql6\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:15:33.341736 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:33.341701    2566 generic.go:356] "Generic (PLEG): container finished" podID="b786d126-a754-41b5-9346-b3722dfa9561" containerID="bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328" exitCode=0
Sep 08 15:15:33.342120 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:33.341745    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5644f859f-68h4r"
Sep 08 15:15:33.342120 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:33.341784    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5644f859f-68h4r" event={"ID":"b786d126-a754-41b5-9346-b3722dfa9561","Type":"ContainerDied","Data":"bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328"}
Sep 08 15:15:33.342120 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:33.341833    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5644f859f-68h4r" event={"ID":"b786d126-a754-41b5-9346-b3722dfa9561","Type":"ContainerDied","Data":"b07eb789ed1ff4cb3726c44d319897e08750ef7053230eeb612023e8eafd7e4f"}
Sep 08 15:15:33.342120 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:33.341853    2566 scope.go:117] "RemoveContainer" containerID="bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328"
Sep 08 15:15:33.352659 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:33.352609    2566 scope.go:117] "RemoveContainer" containerID="bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328"
Sep 08 15:15:33.353036 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:15:33.353015    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328\": container with ID starting with bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328 not found: ID does not exist" containerID="bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328"
Sep 08 15:15:33.353122 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:33.353045    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328"} err="failed to get container status \"bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328\": rpc error: code = NotFound desc = could not find container \"bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328\": container with ID starting with bd7a381755c526256fa23022d929b97473f575f15699d768c15f73a580fb9328 not found: ID does not exist"
Sep 08 15:15:33.367351 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:33.367320    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5644f859f-68h4r"]
Sep 08 15:15:33.371303 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:33.371275    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5644f859f-68h4r"]
Sep 08 15:15:33.913302 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:15:33.913270    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b786d126-a754-41b5-9346-b3722dfa9561" path="/var/lib/kubelet/pods/b786d126-a754-41b5-9346-b3722dfa9561/volumes"
Sep 08 15:16:10.400128 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.400091    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-759df99f5d-qkjs5"]
Sep 08 15:16:10.400563 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.400439    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b786d126-a754-41b5-9346-b3722dfa9561" containerName="console"
Sep 08 15:16:10.400563 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.400452    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b786d126-a754-41b5-9346-b3722dfa9561" containerName="console"
Sep 08 15:16:10.400563 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.400508    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b786d126-a754-41b5-9346-b3722dfa9561" containerName="console"
Sep 08 15:16:10.404601 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.404578    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.420520 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.420488    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759df99f5d-qkjs5"]
Sep 08 15:16:10.444283 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.444243    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-oauth-config\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.444283 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.444289    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-serving-cert\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.444527 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.444308    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-trusted-ca-bundle\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.444527 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.444354    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-oauth-serving-cert\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.444527 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.444391    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-console-config\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.444527 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.444451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-service-ca\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.444527 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.444483    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp4bn\" (UniqueName: \"kubernetes.io/projected/face309c-709a-4f77-9859-3499c55b2c57-kube-api-access-tp4bn\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.545641 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.545577    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-service-ca\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.545853 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.545656    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp4bn\" (UniqueName: \"kubernetes.io/projected/face309c-709a-4f77-9859-3499c55b2c57-kube-api-access-tp4bn\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.545853 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.545687    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-oauth-config\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.545853 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.545707    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-serving-cert\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.545853 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.545723    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-trusted-ca-bundle\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.545853 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.545738    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-oauth-serving-cert\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.545853 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.545757    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-console-config\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.546455 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.546430    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-oauth-serving-cert\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.546455 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.546444    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-service-ca\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.546652 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.546510    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-console-config\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.546920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.546900    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-trusted-ca-bundle\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.548306 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.548286    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-oauth-config\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.548520 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.548501    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-serving-cert\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.555254 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.555225    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp4bn\" (UniqueName: \"kubernetes.io/projected/face309c-709a-4f77-9859-3499c55b2c57-kube-api-access-tp4bn\") pod \"console-759df99f5d-qkjs5\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") " pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.714448 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.714347    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:10.992956 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:10.992868    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759df99f5d-qkjs5"]
Sep 08 15:16:10.995957 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:16:10.995928    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podface309c_709a_4f77_9859_3499c55b2c57.slice/crio-676fe6187f38718c1d6c459a432a45cf209dfcbad7a1c54b8998da4b9d2e5f5e WatchSource:0}: Error finding container 676fe6187f38718c1d6c459a432a45cf209dfcbad7a1c54b8998da4b9d2e5f5e: Status 404 returned error can't find the container with id 676fe6187f38718c1d6c459a432a45cf209dfcbad7a1c54b8998da4b9d2e5f5e
Sep 08 15:16:11.496773 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:11.496716    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759df99f5d-qkjs5" event={"ID":"face309c-709a-4f77-9859-3499c55b2c57","Type":"ContainerStarted","Data":"9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a"}
Sep 08 15:16:11.497187 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:11.496847    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759df99f5d-qkjs5" event={"ID":"face309c-709a-4f77-9859-3499c55b2c57","Type":"ContainerStarted","Data":"676fe6187f38718c1d6c459a432a45cf209dfcbad7a1c54b8998da4b9d2e5f5e"}
Sep 08 15:16:11.517856 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:11.517803    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-759df99f5d-qkjs5" podStartSLOduration=1.5177869899999998 podStartE2EDuration="1.51778699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:16:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:16:11.51736359 +0000 UTC m=+432.088909632" watchObservedRunningTime="2026-09-08 15:16:11.51778699 +0000 UTC m=+432.089333028"
Sep 08 15:16:20.714770 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:20.714665    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:20.714770 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:20.714743    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:20.720581 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:20.720546    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:21.540446 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:21.540409    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:16:21.587223 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:21.587179    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86689cd86-2kz84"]
Sep 08 15:16:46.610537 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.610463    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86689cd86-2kz84" podUID="37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" containerName="console" containerID="cri-o://6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85" gracePeriod=15
Sep 08 15:16:46.852299 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.852273    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:16:46.955365 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.955269    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-trusted-ca-bundle\") pod \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") "
Sep 08 15:16:46.955365 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.955325    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knggg\" (UniqueName: \"kubernetes.io/projected/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-kube-api-access-knggg\") pod \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") "
Sep 08 15:16:46.955365 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.955360    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-oauth-config\") pod \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") "
Sep 08 15:16:46.955721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.955386    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-oauth-serving-cert\") pod \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") "
Sep 08 15:16:46.955721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.955429    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-service-ca\") pod \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") "
Sep 08 15:16:46.955721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.955478    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-config\") pod \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") "
Sep 08 15:16:46.955721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.955532    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-serving-cert\") pod \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\" (UID: \"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4\") "
Sep 08 15:16:46.955928 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.955908    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" (UID: "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:16:46.955989 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.955933    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" (UID: "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:16:46.956042 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.956009    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-service-ca" (OuterVolumeSpecName: "service-ca") pod "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" (UID: "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:16:46.956042 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.956010    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-config" (OuterVolumeSpecName: "console-config") pod "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" (UID: "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:16:46.957836 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.957812    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" (UID: "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:16:46.958204 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.958185    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" (UID: "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:16:46.958204 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:46.958189    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-kube-api-access-knggg" (OuterVolumeSpecName: "kube-api-access-knggg") pod "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" (UID: "37c1c7ab-f57e-4d13-9c87-ec877efc1fa4"). InnerVolumeSpecName "kube-api-access-knggg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:16:47.056456 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.056422    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knggg\" (UniqueName: \"kubernetes.io/projected/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-kube-api-access-knggg\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:16:47.056456 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.056450    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-oauth-config\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:16:47.056456 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.056460    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-oauth-serving-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:16:47.056713 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.056469    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:16:47.056713 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.056477    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-config\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:16:47.056713 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.056484    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-console-serving-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:16:47.056713 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.056495    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4-trusted-ca-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:16:47.637110 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.637069    2566 generic.go:356] "Generic (PLEG): container finished" podID="37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" containerID="6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85" exitCode=0
Sep 08 15:16:47.637110 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.637116    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86689cd86-2kz84"
Sep 08 15:16:47.637548 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.637158    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86689cd86-2kz84" event={"ID":"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4","Type":"ContainerDied","Data":"6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85"}
Sep 08 15:16:47.637548 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.637213    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86689cd86-2kz84" event={"ID":"37c1c7ab-f57e-4d13-9c87-ec877efc1fa4","Type":"ContainerDied","Data":"22e4a5b1f990be260bf981d3fe1bf9fe170a836342ea616d21de6c8dc4c3a08b"}
Sep 08 15:16:47.637548 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.637233    2566 scope.go:117] "RemoveContainer" containerID="6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85"
Sep 08 15:16:47.645672 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.645656    2566 scope.go:117] "RemoveContainer" containerID="6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85"
Sep 08 15:16:47.645958 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:16:47.645938    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85\": container with ID starting with 6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85 not found: ID does not exist" containerID="6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85"
Sep 08 15:16:47.646021 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.645967    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85"} err="failed to get container status \"6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85\": rpc error: code = NotFound desc = could not find container \"6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85\": container with ID starting with 6feacafce8a81dbe18a24c3cc5bf0edcafa59c4acba64958e690a127508d7a85 not found: ID does not exist"
Sep 08 15:16:47.657700 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.657671    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86689cd86-2kz84"]
Sep 08 15:16:47.661417 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.661395    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86689cd86-2kz84"]
Sep 08 15:16:47.913241 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:16:47.913166    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" path="/var/lib/kubelet/pods/37c1c7ab-f57e-4d13-9c87-ec877efc1fa4/volumes"
Sep 08 15:17:07.227517 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.227478    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"]
Sep 08 15:17:07.227991 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.227810    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" containerName="console"
Sep 08 15:17:07.227991 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.227821    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" containerName="console"
Sep 08 15:17:07.227991 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.227871    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="37c1c7ab-f57e-4d13-9c87-ec877efc1fa4" containerName="console"
Sep 08 15:17:07.231995 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.231979    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:07.235037 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.235017    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:17:07.235177 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.235143    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:17:07.236310 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.236293    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kx27n\""
Sep 08 15:17:07.239441 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.239416    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"]
Sep 08 15:17:07.301458 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.301424    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:07.301659 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.301466    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b445s\" (UniqueName: \"kubernetes.io/projected/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-kube-api-access-b445s\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:07.301659 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.301544    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:07.401997 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.401958    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:07.401997 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.402003    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:07.402231 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.402129    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b445s\" (UniqueName: \"kubernetes.io/projected/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-kube-api-access-b445s\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:07.402337 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.402321    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:07.402410 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.402389    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:07.413030 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.412991    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b445s\" (UniqueName: \"kubernetes.io/projected/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-kube-api-access-b445s\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:07.542034 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.541938    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:07.817759 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:07.817580    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"]
Sep 08 15:17:07.820383 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:17:07.820354    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d4c4d4_8a48_4c01_b009_7cee08b25aba.slice/crio-369a55c65579e03fb55e2566f46d724273b32ad532a631d739ced08751beb1bd WatchSource:0}: Error finding container 369a55c65579e03fb55e2566f46d724273b32ad532a631d739ced08751beb1bd: Status 404 returned error can't find the container with id 369a55c65579e03fb55e2566f46d724273b32ad532a631d739ced08751beb1bd
Sep 08 15:17:08.718476 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:08.718443    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc" event={"ID":"f7d4c4d4-8a48-4c01-b009-7cee08b25aba","Type":"ContainerStarted","Data":"369a55c65579e03fb55e2566f46d724273b32ad532a631d739ced08751beb1bd"}
Sep 08 15:17:15.750849 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:15.750745    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7d4c4d4-8a48-4c01-b009-7cee08b25aba" containerID="75391cb4b71a167b769426af9fb32f72222191acce9f8c2eab247c5649c59a2c" exitCode=0
Sep 08 15:17:15.750849 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:15.750776    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc" event={"ID":"f7d4c4d4-8a48-4c01-b009-7cee08b25aba","Type":"ContainerDied","Data":"75391cb4b71a167b769426af9fb32f72222191acce9f8c2eab247c5649c59a2c"}
Sep 08 15:17:33.823583 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:33.823538    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7d4c4d4-8a48-4c01-b009-7cee08b25aba" containerID="2f9ae0cb0d023afda6d0c58f46476d4105393a9f3bc949efe0ef3c0c1b2455c9" exitCode=0
Sep 08 15:17:33.824140 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:33.823600    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc" event={"ID":"f7d4c4d4-8a48-4c01-b009-7cee08b25aba","Type":"ContainerDied","Data":"2f9ae0cb0d023afda6d0c58f46476d4105393a9f3bc949efe0ef3c0c1b2455c9"}
Sep 08 15:17:41.863282 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:41.863247    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7d4c4d4-8a48-4c01-b009-7cee08b25aba" containerID="956811d66dc90ffa1f6dac7175f31a5ce9dc1c699c249a9dfcd74566a81a1370" exitCode=0
Sep 08 15:17:41.863690 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:41.863321    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc" event={"ID":"f7d4c4d4-8a48-4c01-b009-7cee08b25aba","Type":"ContainerDied","Data":"956811d66dc90ffa1f6dac7175f31a5ce9dc1c699c249a9dfcd74566a81a1370"}
Sep 08 15:17:42.997193 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:42.997168    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:43.113824 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.113785    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-bundle\") pod \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") "
Sep 08 15:17:43.113824 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.113828    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b445s\" (UniqueName: \"kubernetes.io/projected/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-kube-api-access-b445s\") pod \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") "
Sep 08 15:17:43.114079 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.113862    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-util\") pod \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\" (UID: \"f7d4c4d4-8a48-4c01-b009-7cee08b25aba\") "
Sep 08 15:17:43.114446 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.114422    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-bundle" (OuterVolumeSpecName: "bundle") pod "f7d4c4d4-8a48-4c01-b009-7cee08b25aba" (UID: "f7d4c4d4-8a48-4c01-b009-7cee08b25aba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:17:43.116192 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.116171    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-kube-api-access-b445s" (OuterVolumeSpecName: "kube-api-access-b445s") pod "f7d4c4d4-8a48-4c01-b009-7cee08b25aba" (UID: "f7d4c4d4-8a48-4c01-b009-7cee08b25aba"). InnerVolumeSpecName "kube-api-access-b445s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:17:43.121201 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.121143    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-util" (OuterVolumeSpecName: "util") pod "f7d4c4d4-8a48-4c01-b009-7cee08b25aba" (UID: "f7d4c4d4-8a48-4c01-b009-7cee08b25aba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:17:43.215337 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.215287    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-util\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:17:43.215337 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.215327    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:17:43.215337 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.215336    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b445s\" (UniqueName: \"kubernetes.io/projected/f7d4c4d4-8a48-4c01-b009-7cee08b25aba-kube-api-access-b445s\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:17:43.872743 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.872700    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc" event={"ID":"f7d4c4d4-8a48-4c01-b009-7cee08b25aba","Type":"ContainerDied","Data":"369a55c65579e03fb55e2566f46d724273b32ad532a631d739ced08751beb1bd"}
Sep 08 15:17:43.872743 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.872737    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlqvc"
Sep 08 15:17:43.872955 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:43.872758    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="369a55c65579e03fb55e2566f46d724273b32ad532a631d739ced08751beb1bd"
Sep 08 15:17:49.770534 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.770500    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j"]
Sep 08 15:17:49.770957 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.770820    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d4c4d4-8a48-4c01-b009-7cee08b25aba" containerName="util"
Sep 08 15:17:49.770957 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.770832    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d4c4d4-8a48-4c01-b009-7cee08b25aba" containerName="util"
Sep 08 15:17:49.770957 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.770845    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d4c4d4-8a48-4c01-b009-7cee08b25aba" containerName="pull"
Sep 08 15:17:49.770957 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.770850    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d4c4d4-8a48-4c01-b009-7cee08b25aba" containerName="pull"
Sep 08 15:17:49.770957 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.770857    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d4c4d4-8a48-4c01-b009-7cee08b25aba" containerName="extract"
Sep 08 15:17:49.770957 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.770864    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d4c4d4-8a48-4c01-b009-7cee08b25aba" containerName="extract"
Sep 08 15:17:49.770957 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.770945    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7d4c4d4-8a48-4c01-b009-7cee08b25aba" containerName="extract"
Sep 08 15:17:49.773370 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.773355    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j"
Sep 08 15:17:49.777992 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.777963    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:17:49.778145 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.778018    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 08 15:17:49.778145 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.778017    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j6n5h\""
Sep 08 15:17:49.793396 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.793365    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j"]
Sep 08 15:17:49.873211 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.873168    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8blzx\" (UniqueName: \"kubernetes.io/projected/37ae60b7-bfc6-4e70-8837-d5dc17f638e3-kube-api-access-8blzx\") pod \"cert-manager-operator-controller-manager-55c444bf86-59w7j\" (UID: \"37ae60b7-bfc6-4e70-8837-d5dc17f638e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j"
Sep 08 15:17:49.873211 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.873217    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37ae60b7-bfc6-4e70-8837-d5dc17f638e3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-59w7j\" (UID: \"37ae60b7-bfc6-4e70-8837-d5dc17f638e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j"
Sep 08 15:17:49.974502 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.974462    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8blzx\" (UniqueName: \"kubernetes.io/projected/37ae60b7-bfc6-4e70-8837-d5dc17f638e3-kube-api-access-8blzx\") pod \"cert-manager-operator-controller-manager-55c444bf86-59w7j\" (UID: \"37ae60b7-bfc6-4e70-8837-d5dc17f638e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j"
Sep 08 15:17:49.974502 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.974507    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37ae60b7-bfc6-4e70-8837-d5dc17f638e3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-59w7j\" (UID: \"37ae60b7-bfc6-4e70-8837-d5dc17f638e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j"
Sep 08 15:17:49.974943 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.974925    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37ae60b7-bfc6-4e70-8837-d5dc17f638e3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-59w7j\" (UID: \"37ae60b7-bfc6-4e70-8837-d5dc17f638e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j"
Sep 08 15:17:49.990877 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:49.990835    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8blzx\" (UniqueName: \"kubernetes.io/projected/37ae60b7-bfc6-4e70-8837-d5dc17f638e3-kube-api-access-8blzx\") pod \"cert-manager-operator-controller-manager-55c444bf86-59w7j\" (UID: \"37ae60b7-bfc6-4e70-8837-d5dc17f638e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j"
Sep 08 15:17:50.082742 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:50.082707    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j"
Sep 08 15:17:50.379612 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:50.379580    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j"]
Sep 08 15:17:50.380118 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:17:50.380091    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ae60b7_bfc6_4e70_8837_d5dc17f638e3.slice/crio-8299a84ce7b336d624eb49f7d29a73c37fdc7e55e388d4b87abd089d828df471 WatchSource:0}: Error finding container 8299a84ce7b336d624eb49f7d29a73c37fdc7e55e388d4b87abd089d828df471: Status 404 returned error can't find the container with id 8299a84ce7b336d624eb49f7d29a73c37fdc7e55e388d4b87abd089d828df471
Sep 08 15:17:50.903074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:50.903036    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j" event={"ID":"37ae60b7-bfc6-4e70-8837-d5dc17f638e3","Type":"ContainerStarted","Data":"8299a84ce7b336d624eb49f7d29a73c37fdc7e55e388d4b87abd089d828df471"}
Sep 08 15:17:52.914398 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:52.914367    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j" event={"ID":"37ae60b7-bfc6-4e70-8837-d5dc17f638e3","Type":"ContainerStarted","Data":"a091a3ddbf19cebe0bdcde1ff28085020d575387b6f72335c965d96feac750c5"}
Sep 08 15:17:52.962847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:52.962788    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-59w7j" podStartSLOduration=2.206546802 podStartE2EDuration="3.962772233s" totalImagesPullingTime="1.756225431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:17:52.960165441 +0000 UTC m=+533.531711483" watchObservedRunningTime="2026-09-08 15:17:52.962772233 +0000 UTC m=+533.534318274"
Sep 08 15:17:53.342524 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.342489    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lhgjs"]
Sep 08 15:17:53.345901 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.345884    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs"
Sep 08 15:17:53.353550 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.353528    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-45rcb\""
Sep 08 15:17:53.354737 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.354724    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 15:17:53.356716 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.356700    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 15:17:53.382443 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.382397    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lhgjs"]
Sep 08 15:17:53.505173 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.505137    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfkzk\" (UniqueName: \"kubernetes.io/projected/de89750a-14d0-426c-b263-bde7097eb623-kube-api-access-jfkzk\") pod \"cert-manager-webhook-6486ffd997-lhgjs\" (UID: \"de89750a-14d0-426c-b263-bde7097eb623\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs"
Sep 08 15:17:53.505368 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.505196    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de89750a-14d0-426c-b263-bde7097eb623-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lhgjs\" (UID: \"de89750a-14d0-426c-b263-bde7097eb623\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs"
Sep 08 15:17:53.606573 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.606456    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfkzk\" (UniqueName: \"kubernetes.io/projected/de89750a-14d0-426c-b263-bde7097eb623-kube-api-access-jfkzk\") pod \"cert-manager-webhook-6486ffd997-lhgjs\" (UID: \"de89750a-14d0-426c-b263-bde7097eb623\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs"
Sep 08 15:17:53.606573 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.606522    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de89750a-14d0-426c-b263-bde7097eb623-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lhgjs\" (UID: \"de89750a-14d0-426c-b263-bde7097eb623\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs"
Sep 08 15:17:53.620518 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.620480    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfkzk\" (UniqueName: \"kubernetes.io/projected/de89750a-14d0-426c-b263-bde7097eb623-kube-api-access-jfkzk\") pod \"cert-manager-webhook-6486ffd997-lhgjs\" (UID: \"de89750a-14d0-426c-b263-bde7097eb623\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs"
Sep 08 15:17:53.621655 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.621635    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de89750a-14d0-426c-b263-bde7097eb623-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lhgjs\" (UID: \"de89750a-14d0-426c-b263-bde7097eb623\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs"
Sep 08 15:17:53.663654 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.663597    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs"
Sep 08 15:17:53.999484 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:53.999457    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lhgjs"]
Sep 08 15:17:54.001800 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:17:54.001772    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde89750a_14d0_426c_b263_bde7097eb623.slice/crio-041b1c6661b8811d78ba17866f5d1ed9097216f7b27287484260118a9e08e941 WatchSource:0}: Error finding container 041b1c6661b8811d78ba17866f5d1ed9097216f7b27287484260118a9e08e941: Status 404 returned error can't find the container with id 041b1c6661b8811d78ba17866f5d1ed9097216f7b27287484260118a9e08e941
Sep 08 15:17:54.311902 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.311817    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"]
Sep 08 15:17:54.316439 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.316415    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:17:54.335749 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.335714    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:17:54.336762 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.336742    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kx27n\""
Sep 08 15:17:54.336845 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.336741    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:17:54.346346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.346314    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"]
Sep 08 15:17:54.412782 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.412741    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6gjm\" (UniqueName: \"kubernetes.io/projected/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-kube-api-access-n6gjm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:17:54.412782 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.412780    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:17:54.413035 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.412901    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:17:54.513970 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.513929    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:17:54.514148 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.513981    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6gjm\" (UniqueName: \"kubernetes.io/projected/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-kube-api-access-n6gjm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:17:54.514148 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.514092    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:17:54.514399 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.514377    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:17:54.514436 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.514385    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:17:54.535848 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.535812    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6gjm\" (UniqueName: \"kubernetes.io/projected/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-kube-api-access-n6gjm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:17:54.625839 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.625805    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:17:54.925477 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.925385    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs" event={"ID":"de89750a-14d0-426c-b263-bde7097eb623","Type":"ContainerStarted","Data":"041b1c6661b8811d78ba17866f5d1ed9097216f7b27287484260118a9e08e941"}
Sep 08 15:17:54.934002 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:54.933919    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"]
Sep 08 15:17:54.936672 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:17:54.936642    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b96275_bdbd_4caf_8f43_cda3a6268c3c.slice/crio-f0f275d5ca7e14d2afd083abc216c851f7c92eed90520c715eb01b3753eedd31 WatchSource:0}: Error finding container f0f275d5ca7e14d2afd083abc216c851f7c92eed90520c715eb01b3753eedd31: Status 404 returned error can't find the container with id f0f275d5ca7e14d2afd083abc216c851f7c92eed90520c715eb01b3753eedd31
Sep 08 15:17:55.932967 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:55.932871    2566 generic.go:356] "Generic (PLEG): container finished" podID="b5b96275-bdbd-4caf-8f43-cda3a6268c3c" containerID="802fc1380c187f1b705d95fa895cebab5cc865f8303194387f81547fdbfb75e1" exitCode=0
Sep 08 15:17:55.932967 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:55.932910    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc" event={"ID":"b5b96275-bdbd-4caf-8f43-cda3a6268c3c","Type":"ContainerDied","Data":"802fc1380c187f1b705d95fa895cebab5cc865f8303194387f81547fdbfb75e1"}
Sep 08 15:17:55.932967 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:55.932964    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc" event={"ID":"b5b96275-bdbd-4caf-8f43-cda3a6268c3c","Type":"ContainerStarted","Data":"f0f275d5ca7e14d2afd083abc216c851f7c92eed90520c715eb01b3753eedd31"}
Sep 08 15:17:56.940967 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:56.940868    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs" event={"ID":"de89750a-14d0-426c-b263-bde7097eb623","Type":"ContainerStarted","Data":"0c1c78ac6b6e3d49b4c5a15edbd619779bcf2de53995f5e9808949ef0faf9b34"}
Sep 08 15:17:56.941370 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:56.940999    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs"
Sep 08 15:17:56.963303 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:56.963248    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs" podStartSLOduration=1.308129692 podStartE2EDuration="3.963228777s" totalImagesPullingTime="2.655099085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:17:56.961569502 +0000 UTC m=+537.533115545" watchObservedRunningTime="2026-09-08 15:17:56.963228777 +0000 UTC m=+537.534774818"
Sep 08 15:17:57.270980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:57.270907    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9np9v"]
Sep 08 15:17:57.275508 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:57.275484    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9np9v"
Sep 08 15:17:57.279149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:57.279121    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-v9zq2\""
Sep 08 15:17:57.287041 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:57.287006    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9np9v"]
Sep 08 15:17:57.337071 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:57.337037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9np9v\" (UID: \"3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9np9v"
Sep 08 15:17:57.337071 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:57.337080    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhtkk\" (UniqueName: \"kubernetes.io/projected/3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1-kube-api-access-fhtkk\") pod \"cert-manager-cainjector-559cdd8c87-9np9v\" (UID: \"3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9np9v"
Sep 08 15:17:57.438095 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:57.438059    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9np9v\" (UID: \"3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9np9v"
Sep 08 15:17:57.438281 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:57.438105    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhtkk\" (UniqueName: \"kubernetes.io/projected/3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1-kube-api-access-fhtkk\") pod \"cert-manager-cainjector-559cdd8c87-9np9v\" (UID: \"3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9np9v"
Sep 08 15:17:57.448571 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:57.448484    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9np9v\" (UID: \"3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9np9v"
Sep 08 15:17:57.448748 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:57.448583    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhtkk\" (UniqueName: \"kubernetes.io/projected/3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1-kube-api-access-fhtkk\") pod \"cert-manager-cainjector-559cdd8c87-9np9v\" (UID: \"3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9np9v"
Sep 08 15:17:57.585918 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:57.585889    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9np9v"
Sep 08 15:17:58.215037 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:58.214952    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9np9v"]
Sep 08 15:17:58.218334 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:17:58.218304    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3aa08f47_6d7f_4d2d_b635_1a8efa03b9c1.slice/crio-ea190a2c29b4c821aedab938b0ef480769029ac5a1a43112b920c416b894461e WatchSource:0}: Error finding container ea190a2c29b4c821aedab938b0ef480769029ac5a1a43112b920c416b894461e: Status 404 returned error can't find the container with id ea190a2c29b4c821aedab938b0ef480769029ac5a1a43112b920c416b894461e
Sep 08 15:17:58.952653 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:58.952602    2566 generic.go:356] "Generic (PLEG): container finished" podID="b5b96275-bdbd-4caf-8f43-cda3a6268c3c" containerID="4778cb358a404123f51edabd70060cd16d154ec003683f475205a38cc6282539" exitCode=0
Sep 08 15:17:58.953034 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:58.952695    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc" event={"ID":"b5b96275-bdbd-4caf-8f43-cda3a6268c3c","Type":"ContainerDied","Data":"4778cb358a404123f51edabd70060cd16d154ec003683f475205a38cc6282539"}
Sep 08 15:17:58.954286 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:58.954257    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9np9v" event={"ID":"3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1","Type":"ContainerStarted","Data":"ccdd8d1b2ca97672d9208cbf3eca72626d1589dce77c28788f1a7766a181d987"}
Sep 08 15:17:58.954362 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:58.954290    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9np9v" event={"ID":"3aa08f47-6d7f-4d2d-b635-1a8efa03b9c1","Type":"ContainerStarted","Data":"ea190a2c29b4c821aedab938b0ef480769029ac5a1a43112b920c416b894461e"}
Sep 08 15:17:59.014390 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:59.014216    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9np9v" podStartSLOduration=2.014197607 podStartE2EDuration="2.014197607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:17:59.013106818 +0000 UTC m=+539.584652860" watchObservedRunningTime="2026-09-08 15:17:59.014197607 +0000 UTC m=+539.585743648"
Sep 08 15:17:59.959997 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:59.959961    2566 generic.go:356] "Generic (PLEG): container finished" podID="b5b96275-bdbd-4caf-8f43-cda3a6268c3c" containerID="51d47c4d23d3acbd73b41016f7c47761fa9c74ffa00ef48d99279671dc73c0a2" exitCode=0
Sep 08 15:17:59.960457 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:17:59.960039    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc" event={"ID":"b5b96275-bdbd-4caf-8f43-cda3a6268c3c","Type":"ContainerDied","Data":"51d47c4d23d3acbd73b41016f7c47761fa9c74ffa00ef48d99279671dc73c0a2"}
Sep 08 15:18:01.104320 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.104296    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:18:01.182638 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.182581    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-util\") pod \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") "
Sep 08 15:18:01.182920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.182899    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6gjm\" (UniqueName: \"kubernetes.io/projected/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-kube-api-access-n6gjm\") pod \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") "
Sep 08 15:18:01.183087 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.183074    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-bundle\") pod \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\" (UID: \"b5b96275-bdbd-4caf-8f43-cda3a6268c3c\") "
Sep 08 15:18:01.183448 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.183417    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-bundle" (OuterVolumeSpecName: "bundle") pod "b5b96275-bdbd-4caf-8f43-cda3a6268c3c" (UID: "b5b96275-bdbd-4caf-8f43-cda3a6268c3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:18:01.185142 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.185119    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-kube-api-access-n6gjm" (OuterVolumeSpecName: "kube-api-access-n6gjm") pod "b5b96275-bdbd-4caf-8f43-cda3a6268c3c" (UID: "b5b96275-bdbd-4caf-8f43-cda3a6268c3c"). InnerVolumeSpecName "kube-api-access-n6gjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:18:01.188243 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.188214    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-util" (OuterVolumeSpecName: "util") pod "b5b96275-bdbd-4caf-8f43-cda3a6268c3c" (UID: "b5b96275-bdbd-4caf-8f43-cda3a6268c3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:18:01.284257 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.284165    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-util\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:18:01.284257 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.284195    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6gjm\" (UniqueName: \"kubernetes.io/projected/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-kube-api-access-n6gjm\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:18:01.284257 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.284207    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5b96275-bdbd-4caf-8f43-cda3a6268c3c-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:18:01.973515 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.973481    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc" event={"ID":"b5b96275-bdbd-4caf-8f43-cda3a6268c3c","Type":"ContainerDied","Data":"f0f275d5ca7e14d2afd083abc216c851f7c92eed90520c715eb01b3753eedd31"}
Sep 08 15:18:01.973716 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.973528    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0f275d5ca7e14d2afd083abc216c851f7c92eed90520c715eb01b3753eedd31"
Sep 08 15:18:01.973716 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:01.973537    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgftc"
Sep 08 15:18:02.949250 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:02.949219    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lhgjs"
Sep 08 15:18:07.105567 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.105532    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v"]
Sep 08 15:18:07.106038 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.105850    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5b96275-bdbd-4caf-8f43-cda3a6268c3c" containerName="pull"
Sep 08 15:18:07.106038 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.105861    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b96275-bdbd-4caf-8f43-cda3a6268c3c" containerName="pull"
Sep 08 15:18:07.106038 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.105876    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5b96275-bdbd-4caf-8f43-cda3a6268c3c" containerName="util"
Sep 08 15:18:07.106038 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.105880    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b96275-bdbd-4caf-8f43-cda3a6268c3c" containerName="util"
Sep 08 15:18:07.106038 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.105887    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5b96275-bdbd-4caf-8f43-cda3a6268c3c" containerName="extract"
Sep 08 15:18:07.106038 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.105893    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b96275-bdbd-4caf-8f43-cda3a6268c3c" containerName="extract"
Sep 08 15:18:07.106038 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.105942    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5b96275-bdbd-4caf-8f43-cda3a6268c3c" containerName="extract"
Sep 08 15:18:07.110780 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.110763    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v"
Sep 08 15:18:07.114353 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.114332    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 15:18:07.115441 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.115423    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:18:07.115536 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.115443    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cgqgw\""
Sep 08 15:18:07.120846 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.120823    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v"]
Sep 08 15:18:07.230998 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.230954    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhjzz\" (UniqueName: \"kubernetes.io/projected/07119d1e-7cf9-4d11-b5ed-6e42d7a1e430-kube-api-access-nhjzz\") pod \"openshift-lws-operator-fd8ccff4c-kwm2v\" (UID: \"07119d1e-7cf9-4d11-b5ed-6e42d7a1e430\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v"
Sep 08 15:18:07.230998 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.231006    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07119d1e-7cf9-4d11-b5ed-6e42d7a1e430-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kwm2v\" (UID: \"07119d1e-7cf9-4d11-b5ed-6e42d7a1e430\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v"
Sep 08 15:18:07.331690 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.331651    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjzz\" (UniqueName: \"kubernetes.io/projected/07119d1e-7cf9-4d11-b5ed-6e42d7a1e430-kube-api-access-nhjzz\") pod \"openshift-lws-operator-fd8ccff4c-kwm2v\" (UID: \"07119d1e-7cf9-4d11-b5ed-6e42d7a1e430\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v"
Sep 08 15:18:07.331690 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.331698    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07119d1e-7cf9-4d11-b5ed-6e42d7a1e430-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kwm2v\" (UID: \"07119d1e-7cf9-4d11-b5ed-6e42d7a1e430\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v"
Sep 08 15:18:07.332010 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.331991    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07119d1e-7cf9-4d11-b5ed-6e42d7a1e430-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kwm2v\" (UID: \"07119d1e-7cf9-4d11-b5ed-6e42d7a1e430\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v"
Sep 08 15:18:07.342122 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.342092    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhjzz\" (UniqueName: \"kubernetes.io/projected/07119d1e-7cf9-4d11-b5ed-6e42d7a1e430-kube-api-access-nhjzz\") pod \"openshift-lws-operator-fd8ccff4c-kwm2v\" (UID: \"07119d1e-7cf9-4d11-b5ed-6e42d7a1e430\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v"
Sep 08 15:18:07.420390 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.420306    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v"
Sep 08 15:18:07.701298 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:07.701206    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v"]
Sep 08 15:18:07.703671 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:18:07.703642    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07119d1e_7cf9_4d11_b5ed_6e42d7a1e430.slice/crio-53fb2b673eb857e789b00f89362a49bbdf03430ae729451a5cb524ed35192f4c WatchSource:0}: Error finding container 53fb2b673eb857e789b00f89362a49bbdf03430ae729451a5cb524ed35192f4c: Status 404 returned error can't find the container with id 53fb2b673eb857e789b00f89362a49bbdf03430ae729451a5cb524ed35192f4c
Sep 08 15:18:08.000788 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:08.000712    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v" event={"ID":"07119d1e-7cf9-4d11-b5ed-6e42d7a1e430","Type":"ContainerStarted","Data":"53fb2b673eb857e789b00f89362a49bbdf03430ae729451a5cb524ed35192f4c"}
Sep 08 15:18:14.031985 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:14.031906    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v" event={"ID":"07119d1e-7cf9-4d11-b5ed-6e42d7a1e430","Type":"ContainerStarted","Data":"bd43c26191f29578688b31b5ab952e46e6eef106da5997e7e1e4ca66cbe5eb7b"}
Sep 08 15:18:14.055131 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:14.055077    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kwm2v" podStartSLOduration=1.169065889 podStartE2EDuration="7.055061167s" totalImagesPullingTime="5.885995278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:14.054138612 +0000 UTC m=+554.625684655" watchObservedRunningTime="2026-09-08 15:18:14.055061167 +0000 UTC m=+554.626607209"
Sep 08 15:18:16.263024 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.262984    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"]
Sep 08 15:18:16.265370 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.265354    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:16.268420 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.268392    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:18:16.268420 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.268415    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:18:16.268637 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.268392    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kx27n\""
Sep 08 15:18:16.277277 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.277252    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"]
Sep 08 15:18:16.316050 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.316020    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:16.316050 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.316068    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjp5v\" (UniqueName: \"kubernetes.io/projected/eaa0171a-273a-475f-b5fd-fa08b24c5421-kube-api-access-wjp5v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:16.316287 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.316101    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:16.417456 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.417417    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:16.417647 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.417469    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjp5v\" (UniqueName: \"kubernetes.io/projected/eaa0171a-273a-475f-b5fd-fa08b24c5421-kube-api-access-wjp5v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:16.417647 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.417507    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:16.417861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.417844    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:16.417920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.417904    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:16.428483 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.428457    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjp5v\" (UniqueName: \"kubernetes.io/projected/eaa0171a-273a-475f-b5fd-fa08b24c5421-kube-api-access-wjp5v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:16.575180 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.575095    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:16.852601 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:16.852568    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"]
Sep 08 15:18:16.857181 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:18:16.857149    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa0171a_273a_475f_b5fd_fa08b24c5421.slice/crio-bd6b38b5a9d5d58dae7278b6649babeb629cf6207720dad8f0eae9da2f3ef124 WatchSource:0}: Error finding container bd6b38b5a9d5d58dae7278b6649babeb629cf6207720dad8f0eae9da2f3ef124: Status 404 returned error can't find the container with id bd6b38b5a9d5d58dae7278b6649babeb629cf6207720dad8f0eae9da2f3ef124
Sep 08 15:18:17.047954 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:17.047921    2566 generic.go:356] "Generic (PLEG): container finished" podID="eaa0171a-273a-475f-b5fd-fa08b24c5421" containerID="8f55d12ebdbe025f87d3a46d39afa42e200a02f4419f5274168c4d6024ded5b5" exitCode=0
Sep 08 15:18:17.048141 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:17.047979    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj" event={"ID":"eaa0171a-273a-475f-b5fd-fa08b24c5421","Type":"ContainerDied","Data":"8f55d12ebdbe025f87d3a46d39afa42e200a02f4419f5274168c4d6024ded5b5"}
Sep 08 15:18:17.048141 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:17.048062    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj" event={"ID":"eaa0171a-273a-475f-b5fd-fa08b24c5421","Type":"ContainerStarted","Data":"bd6b38b5a9d5d58dae7278b6649babeb629cf6207720dad8f0eae9da2f3ef124"}
Sep 08 15:18:19.059982 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:19.059935    2566 generic.go:356] "Generic (PLEG): container finished" podID="eaa0171a-273a-475f-b5fd-fa08b24c5421" containerID="e7fe9f371c5b790d20d7ffe6412482b62a71978375af27aca273a2156153192f" exitCode=0
Sep 08 15:18:19.060463 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:19.060002    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj" event={"ID":"eaa0171a-273a-475f-b5fd-fa08b24c5421","Type":"ContainerDied","Data":"e7fe9f371c5b790d20d7ffe6412482b62a71978375af27aca273a2156153192f"}
Sep 08 15:18:20.066493 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:20.066458    2566 generic.go:356] "Generic (PLEG): container finished" podID="eaa0171a-273a-475f-b5fd-fa08b24c5421" containerID="7e368a546eb9494fb925cba16bedb2938d0806ff03234ef88d9e1aefcca435cc" exitCode=0
Sep 08 15:18:20.066914 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:20.066542    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj" event={"ID":"eaa0171a-273a-475f-b5fd-fa08b24c5421","Type":"ContainerDied","Data":"7e368a546eb9494fb925cba16bedb2938d0806ff03234ef88d9e1aefcca435cc"}
Sep 08 15:18:21.207066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:21.207040    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:21.363153 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:21.363118    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-bundle\") pod \"eaa0171a-273a-475f-b5fd-fa08b24c5421\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") "
Sep 08 15:18:21.363355 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:21.363178    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-util\") pod \"eaa0171a-273a-475f-b5fd-fa08b24c5421\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") "
Sep 08 15:18:21.363355 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:21.363230    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjp5v\" (UniqueName: \"kubernetes.io/projected/eaa0171a-273a-475f-b5fd-fa08b24c5421-kube-api-access-wjp5v\") pod \"eaa0171a-273a-475f-b5fd-fa08b24c5421\" (UID: \"eaa0171a-273a-475f-b5fd-fa08b24c5421\") "
Sep 08 15:18:21.363938 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:21.363912    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-bundle" (OuterVolumeSpecName: "bundle") pod "eaa0171a-273a-475f-b5fd-fa08b24c5421" (UID: "eaa0171a-273a-475f-b5fd-fa08b24c5421"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:18:21.365521 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:21.365497    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa0171a-273a-475f-b5fd-fa08b24c5421-kube-api-access-wjp5v" (OuterVolumeSpecName: "kube-api-access-wjp5v") pod "eaa0171a-273a-475f-b5fd-fa08b24c5421" (UID: "eaa0171a-273a-475f-b5fd-fa08b24c5421"). InnerVolumeSpecName "kube-api-access-wjp5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:18:21.368559 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:21.368517    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-util" (OuterVolumeSpecName: "util") pod "eaa0171a-273a-475f-b5fd-fa08b24c5421" (UID: "eaa0171a-273a-475f-b5fd-fa08b24c5421"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:18:21.464663 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:21.464595    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-util\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:18:21.464663 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:21.464658    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjp5v\" (UniqueName: \"kubernetes.io/projected/eaa0171a-273a-475f-b5fd-fa08b24c5421-kube-api-access-wjp5v\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:18:21.464663 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:21.464670    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaa0171a-273a-475f-b5fd-fa08b24c5421-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:18:22.079322 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:22.079285    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj" event={"ID":"eaa0171a-273a-475f-b5fd-fa08b24c5421","Type":"ContainerDied","Data":"bd6b38b5a9d5d58dae7278b6649babeb629cf6207720dad8f0eae9da2f3ef124"}
Sep 08 15:18:22.079489 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:22.079344    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd6b38b5a9d5d58dae7278b6649babeb629cf6207720dad8f0eae9da2f3ef124"
Sep 08 15:18:22.079489 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:22.079295    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhjnhj"
Sep 08 15:18:26.407153 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.407114    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"]
Sep 08 15:18:26.407658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.407434    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa0171a-273a-475f-b5fd-fa08b24c5421" containerName="extract"
Sep 08 15:18:26.407658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.407446    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa0171a-273a-475f-b5fd-fa08b24c5421" containerName="extract"
Sep 08 15:18:26.407658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.407464    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa0171a-273a-475f-b5fd-fa08b24c5421" containerName="util"
Sep 08 15:18:26.407658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.407470    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa0171a-273a-475f-b5fd-fa08b24c5421" containerName="util"
Sep 08 15:18:26.407658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.407482    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa0171a-273a-475f-b5fd-fa08b24c5421" containerName="pull"
Sep 08 15:18:26.407658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.407488    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa0171a-273a-475f-b5fd-fa08b24c5421" containerName="pull"
Sep 08 15:18:26.407658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.407544    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaa0171a-273a-475f-b5fd-fa08b24c5421" containerName="extract"
Sep 08 15:18:26.409809 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.409791    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:26.416905 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.416877    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:18:26.416905 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.416897    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:18:26.418097 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.418080    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kx27n\""
Sep 08 15:18:26.434995 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.434962    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"]
Sep 08 15:18:26.509998 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.509958    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:26.510184 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.510020    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jgwf\" (UniqueName: \"kubernetes.io/projected/a523696f-2cb0-4cf0-bd20-147402cd26df-kube-api-access-4jgwf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:26.510184 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.510054    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:26.610446 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.610408    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:26.610665 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.610474    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jgwf\" (UniqueName: \"kubernetes.io/projected/a523696f-2cb0-4cf0-bd20-147402cd26df-kube-api-access-4jgwf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:26.610665 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.610498    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:26.610846 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.610826    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:26.610888 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.610854    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:26.620230 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.620200    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jgwf\" (UniqueName: \"kubernetes.io/projected/a523696f-2cb0-4cf0-bd20-147402cd26df-kube-api-access-4jgwf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:26.719178 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.719094    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:26.991383 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:26.991299    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"]
Sep 08 15:18:26.995086 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:18:26.995059    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda523696f_2cb0_4cf0_bd20_147402cd26df.slice/crio-dc440b3935a9a31da559b92c404b79d7884bfbfb8ae046601793fe9057f38099 WatchSource:0}: Error finding container dc440b3935a9a31da559b92c404b79d7884bfbfb8ae046601793fe9057f38099: Status 404 returned error can't find the container with id dc440b3935a9a31da559b92c404b79d7884bfbfb8ae046601793fe9057f38099
Sep 08 15:18:27.105303 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:27.105272    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8" event={"ID":"a523696f-2cb0-4cf0-bd20-147402cd26df","Type":"ContainerStarted","Data":"1f4d31f5a2e45ced74ec9e5c756529f5651d3f4f7c0428624962693653fb9706"}
Sep 08 15:18:27.105439 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:27.105327    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8" event={"ID":"a523696f-2cb0-4cf0-bd20-147402cd26df","Type":"ContainerStarted","Data":"dc440b3935a9a31da559b92c404b79d7884bfbfb8ae046601793fe9057f38099"}
Sep 08 15:18:28.111395 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:28.111358    2566 generic.go:356] "Generic (PLEG): container finished" podID="a523696f-2cb0-4cf0-bd20-147402cd26df" containerID="1f4d31f5a2e45ced74ec9e5c756529f5651d3f4f7c0428624962693653fb9706" exitCode=0
Sep 08 15:18:28.111829 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:28.111444    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8" event={"ID":"a523696f-2cb0-4cf0-bd20-147402cd26df","Type":"ContainerDied","Data":"1f4d31f5a2e45ced74ec9e5c756529f5651d3f4f7c0428624962693653fb9706"}
Sep 08 15:18:28.990971 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:28.990940    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"]
Sep 08 15:18:28.993737 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:28.993711    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.006967 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.006945    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jgmwt\""
Sep 08 15:18:29.007864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.007841    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 15:18:29.007864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.007861    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 15:18:29.019750 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.019722    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 15:18:29.020220 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.020204    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 15:18:29.041485 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.041454    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"]
Sep 08 15:18:29.118393 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.118305    2566 generic.go:356] "Generic (PLEG): container finished" podID="a523696f-2cb0-4cf0-bd20-147402cd26df" containerID="b24fea2c0cf79885c709f47db7c084fcb37f396be9ecf69dbdd12424340f0667" exitCode=0
Sep 08 15:18:29.118898 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.118389    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8" event={"ID":"a523696f-2cb0-4cf0-bd20-147402cd26df","Type":"ContainerDied","Data":"b24fea2c0cf79885c709f47db7c084fcb37f396be9ecf69dbdd12424340f0667"}
Sep 08 15:18:29.131292 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.131267    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc99bdb1-db34-4ecf-a42d-917d47343fca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.131390 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.131323    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb5k7\" (UniqueName: \"kubernetes.io/projected/bc99bdb1-db34-4ecf-a42d-917d47343fca-kube-api-access-gb5k7\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.131452 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.131387    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc99bdb1-db34-4ecf-a42d-917d47343fca-manifests\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.131505 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.131484    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc99bdb1-db34-4ecf-a42d-917d47343fca-tmp\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.131562 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.131545    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc99bdb1-db34-4ecf-a42d-917d47343fca-webhook-cert\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.233011 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.232969    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc99bdb1-db34-4ecf-a42d-917d47343fca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.233202 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.233030    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb5k7\" (UniqueName: \"kubernetes.io/projected/bc99bdb1-db34-4ecf-a42d-917d47343fca-kube-api-access-gb5k7\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.233202 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.233065    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc99bdb1-db34-4ecf-a42d-917d47343fca-manifests\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.233202 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.233114    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc99bdb1-db34-4ecf-a42d-917d47343fca-tmp\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.233202 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.233161    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc99bdb1-db34-4ecf-a42d-917d47343fca-webhook-cert\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.233525 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.233493    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc99bdb1-db34-4ecf-a42d-917d47343fca-manifests\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.236144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.236114    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc99bdb1-db34-4ecf-a42d-917d47343fca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.236144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.236141    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc99bdb1-db34-4ecf-a42d-917d47343fca-webhook-cert\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.236272 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.236238    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc99bdb1-db34-4ecf-a42d-917d47343fca-tmp\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.243747 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.243722    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb5k7\" (UniqueName: \"kubernetes.io/projected/bc99bdb1-db34-4ecf-a42d-917d47343fca-kube-api-access-gb5k7\") pod \"opendatahub-operator-controller-manager-66db8bdb84-zhnrd\" (UID: \"bc99bdb1-db34-4ecf-a42d-917d47343fca\") " pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.312901 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.312867    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:29.593991 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:29.593965    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"]
Sep 08 15:18:29.596379 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:18:29.596340    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc99bdb1_db34_4ecf_a42d_917d47343fca.slice/crio-850e8033b123c73c53470fd2331d1397e174f8f014789c46c5b319a3f9600803 WatchSource:0}: Error finding container 850e8033b123c73c53470fd2331d1397e174f8f014789c46c5b319a3f9600803: Status 404 returned error can't find the container with id 850e8033b123c73c53470fd2331d1397e174f8f014789c46c5b319a3f9600803
Sep 08 15:18:30.135815 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:30.135722    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd" event={"ID":"bc99bdb1-db34-4ecf-a42d-917d47343fca","Type":"ContainerStarted","Data":"850e8033b123c73c53470fd2331d1397e174f8f014789c46c5b319a3f9600803"}
Sep 08 15:18:30.138583 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:30.138548    2566 generic.go:356] "Generic (PLEG): container finished" podID="a523696f-2cb0-4cf0-bd20-147402cd26df" containerID="ef564331600e63044de19b0352e95767561e56c664000349bb0ab65fdd0fe400" exitCode=0
Sep 08 15:18:30.138757 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:30.138635    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8" event={"ID":"a523696f-2cb0-4cf0-bd20-147402cd26df","Type":"ContainerDied","Data":"ef564331600e63044de19b0352e95767561e56c664000349bb0ab65fdd0fe400"}
Sep 08 15:18:32.527559 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:32.527530    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:32.664754 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:32.664712    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-bundle\") pod \"a523696f-2cb0-4cf0-bd20-147402cd26df\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") "
Sep 08 15:18:32.664937 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:32.664772    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jgwf\" (UniqueName: \"kubernetes.io/projected/a523696f-2cb0-4cf0-bd20-147402cd26df-kube-api-access-4jgwf\") pod \"a523696f-2cb0-4cf0-bd20-147402cd26df\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") "
Sep 08 15:18:32.664937 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:32.664816    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-util\") pod \"a523696f-2cb0-4cf0-bd20-147402cd26df\" (UID: \"a523696f-2cb0-4cf0-bd20-147402cd26df\") "
Sep 08 15:18:32.665528 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:32.665496    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-bundle" (OuterVolumeSpecName: "bundle") pod "a523696f-2cb0-4cf0-bd20-147402cd26df" (UID: "a523696f-2cb0-4cf0-bd20-147402cd26df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:18:32.667025 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:32.667004    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a523696f-2cb0-4cf0-bd20-147402cd26df-kube-api-access-4jgwf" (OuterVolumeSpecName: "kube-api-access-4jgwf") pod "a523696f-2cb0-4cf0-bd20-147402cd26df" (UID: "a523696f-2cb0-4cf0-bd20-147402cd26df"). InnerVolumeSpecName "kube-api-access-4jgwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:18:32.669111 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:32.669067    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-util" (OuterVolumeSpecName: "util") pod "a523696f-2cb0-4cf0-bd20-147402cd26df" (UID: "a523696f-2cb0-4cf0-bd20-147402cd26df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:18:32.766079 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:32.765979    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:18:32.766079 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:32.766019    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jgwf\" (UniqueName: \"kubernetes.io/projected/a523696f-2cb0-4cf0-bd20-147402cd26df-kube-api-access-4jgwf\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:18:32.766079 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:32.766033    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a523696f-2cb0-4cf0-bd20-147402cd26df-util\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:18:33.155647 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:33.155582    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd" event={"ID":"bc99bdb1-db34-4ecf-a42d-917d47343fca","Type":"ContainerStarted","Data":"aa1b2b2262984367f5675ec43d97811af79e36cf63bd8b02ff69c27641fc4618"}
Sep 08 15:18:33.157523 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:33.157499    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8" event={"ID":"a523696f-2cb0-4cf0-bd20-147402cd26df","Type":"ContainerDied","Data":"dc440b3935a9a31da559b92c404b79d7884bfbfb8ae046601793fe9057f38099"}
Sep 08 15:18:33.157523 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:33.157516    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b076lf8"
Sep 08 15:18:33.157523 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:33.157535    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc440b3935a9a31da559b92c404b79d7884bfbfb8ae046601793fe9057f38099"
Sep 08 15:18:34.163774 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:34.163743    2566 generic.go:356] "Generic (PLEG): container finished" podID="bc99bdb1-db34-4ecf-a42d-917d47343fca" containerID="aa1b2b2262984367f5675ec43d97811af79e36cf63bd8b02ff69c27641fc4618" exitCode=0
Sep 08 15:18:34.164165 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:34.163777    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd" event={"ID":"bc99bdb1-db34-4ecf-a42d-917d47343fca","Type":"ContainerDied","Data":"aa1b2b2262984367f5675ec43d97811af79e36cf63bd8b02ff69c27641fc4618"}
Sep 08 15:18:35.176456 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:35.176419    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd" event={"ID":"bc99bdb1-db34-4ecf-a42d-917d47343fca","Type":"ContainerStarted","Data":"12009aa1098942ca11b141d6afc23b0ef60d2a6ea94ce91c98f04b9a0e723ab7"}
Sep 08 15:18:35.176975 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:35.176528    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:35.201731 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:35.201675    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd" podStartSLOduration=2.723079017 podStartE2EDuration="7.201658282s" totalImagesPullingTime="3.427522209s" totalInitContainerRuntime="1.051057056s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:35.200452082 +0000 UTC m=+575.771998152" watchObservedRunningTime="2026-09-08 15:18:35.201658282 +0000 UTC m=+575.773204324"
Sep 08 15:18:46.184141 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:46.184102    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66db8bdb84-zhnrd"
Sep 08 15:18:51.530834 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.530797    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"]
Sep 08 15:18:51.531249 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.531127    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a523696f-2cb0-4cf0-bd20-147402cd26df" containerName="util"
Sep 08 15:18:51.531249 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.531138    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a523696f-2cb0-4cf0-bd20-147402cd26df" containerName="util"
Sep 08 15:18:51.531249 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.531158    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a523696f-2cb0-4cf0-bd20-147402cd26df" containerName="extract"
Sep 08 15:18:51.531249 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.531163    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a523696f-2cb0-4cf0-bd20-147402cd26df" containerName="extract"
Sep 08 15:18:51.531249 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.531173    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a523696f-2cb0-4cf0-bd20-147402cd26df" containerName="pull"
Sep 08 15:18:51.531249 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.531178    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a523696f-2cb0-4cf0-bd20-147402cd26df" containerName="pull"
Sep 08 15:18:51.531249 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.531237    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a523696f-2cb0-4cf0-bd20-147402cd26df" containerName="extract"
Sep 08 15:18:51.542357 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.542327    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"
Sep 08 15:18:51.544271 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.544243    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"]
Sep 08 15:18:51.546247 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.546221    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 15:18:51.546390 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.546220    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6mm2r\""
Sep 08 15:18:51.546390 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.546221    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 15:18:51.617669 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.617603    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c626\" (UniqueName: \"kubernetes.io/projected/03b5fb31-aec9-4e2b-b51d-3778645cd8b6-kube-api-access-8c626\") pod \"kube-auth-proxy-5674d6d4b5-7cl4j\" (UID: \"03b5fb31-aec9-4e2b-b51d-3778645cd8b6\") " pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"
Sep 08 15:18:51.617669 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.617667    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03b5fb31-aec9-4e2b-b51d-3778645cd8b6-tmp\") pod \"kube-auth-proxy-5674d6d4b5-7cl4j\" (UID: \"03b5fb31-aec9-4e2b-b51d-3778645cd8b6\") " pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"
Sep 08 15:18:51.617942 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.617802    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03b5fb31-aec9-4e2b-b51d-3778645cd8b6-tls-certs\") pod \"kube-auth-proxy-5674d6d4b5-7cl4j\" (UID: \"03b5fb31-aec9-4e2b-b51d-3778645cd8b6\") " pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"
Sep 08 15:18:51.719100 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.719066    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03b5fb31-aec9-4e2b-b51d-3778645cd8b6-tls-certs\") pod \"kube-auth-proxy-5674d6d4b5-7cl4j\" (UID: \"03b5fb31-aec9-4e2b-b51d-3778645cd8b6\") " pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"
Sep 08 15:18:51.719303 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.719129    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c626\" (UniqueName: \"kubernetes.io/projected/03b5fb31-aec9-4e2b-b51d-3778645cd8b6-kube-api-access-8c626\") pod \"kube-auth-proxy-5674d6d4b5-7cl4j\" (UID: \"03b5fb31-aec9-4e2b-b51d-3778645cd8b6\") " pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"
Sep 08 15:18:51.719303 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.719149    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03b5fb31-aec9-4e2b-b51d-3778645cd8b6-tmp\") pod \"kube-auth-proxy-5674d6d4b5-7cl4j\" (UID: \"03b5fb31-aec9-4e2b-b51d-3778645cd8b6\") " pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"
Sep 08 15:18:51.721631 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.721593    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03b5fb31-aec9-4e2b-b51d-3778645cd8b6-tmp\") pod \"kube-auth-proxy-5674d6d4b5-7cl4j\" (UID: \"03b5fb31-aec9-4e2b-b51d-3778645cd8b6\") " pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"
Sep 08 15:18:51.721843 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.721823    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03b5fb31-aec9-4e2b-b51d-3778645cd8b6-tls-certs\") pod \"kube-auth-proxy-5674d6d4b5-7cl4j\" (UID: \"03b5fb31-aec9-4e2b-b51d-3778645cd8b6\") " pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"
Sep 08 15:18:51.728769 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.728745    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c626\" (UniqueName: \"kubernetes.io/projected/03b5fb31-aec9-4e2b-b51d-3778645cd8b6-kube-api-access-8c626\") pod \"kube-auth-proxy-5674d6d4b5-7cl4j\" (UID: \"03b5fb31-aec9-4e2b-b51d-3778645cd8b6\") " pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"
Sep 08 15:18:51.853778 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:51.853739    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"
Sep 08 15:18:52.159091 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.159052    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j"]
Sep 08 15:18:52.159560 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:18:52.159537    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b5fb31_aec9_4e2b_b51d_3778645cd8b6.slice/crio-73d6d2d19f66096755916d82e5bc45eeb4edc95973b0dbe337fb019afaeb98b8 WatchSource:0}: Error finding container 73d6d2d19f66096755916d82e5bc45eeb4edc95973b0dbe337fb019afaeb98b8: Status 404 returned error can't find the container with id 73d6d2d19f66096755916d82e5bc45eeb4edc95973b0dbe337fb019afaeb98b8
Sep 08 15:18:52.264604 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.264569    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j" event={"ID":"03b5fb31-aec9-4e2b-b51d-3778645cd8b6","Type":"ContainerStarted","Data":"73d6d2d19f66096755916d82e5bc45eeb4edc95973b0dbe337fb019afaeb98b8"}
Sep 08 15:18:52.740600 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.739911    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"]
Sep 08 15:18:52.743536 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.743502    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.746728 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.746694    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 15:18:52.747450 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.747068    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lkgfh\""
Sep 08 15:18:52.747450 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.747271    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 15:18:52.747450 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.747276    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 15:18:52.747450 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.747399    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 15:18:52.760138 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.760106    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"]
Sep 08 15:18:52.828916 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.828879    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.829129 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.828928    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.829129 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.828960    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.829129 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.829026    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96v82\" (UniqueName: \"kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-kube-api-access-96v82\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.829129 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.829088    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b8c076c-444c-4cee-874f-b1f7902e5fb8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.829377 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.829139    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.829377 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.829202    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.930075 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.930032    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.930266 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.930099    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.930266 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.930148    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.930266 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.930174    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.930266 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.930211    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.930266 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.930258    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96v82\" (UniqueName: \"kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-kube-api-access-96v82\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.930534 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.930303    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b8c076c-444c-4cee-874f-b1f7902e5fb8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.931162 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.930937    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.933005 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.932974    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b8c076c-444c-4cee-874f-b1f7902e5fb8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.933005 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.932992    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.933215 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.933191    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.933413 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.933393    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.940605 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.940394    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:52.940969 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:52.940946    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96v82\" (UniqueName: \"kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-kube-api-access-96v82\") pod \"istiod-openshift-gateway-7b7995d5cd-65g9p\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:53.057345 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:53.057247    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:53.362802 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:53.362764    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"]
Sep 08 15:18:54.278210 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:54.278167    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p" event={"ID":"6b8c076c-444c-4cee-874f-b1f7902e5fb8","Type":"ContainerStarted","Data":"6a31e210302e94321988421942edb5afc4a2ff95334f08410a9feafcd1239938"}
Sep 08 15:18:55.290963 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:55.290876    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j" event={"ID":"03b5fb31-aec9-4e2b-b51d-3778645cd8b6","Type":"ContainerStarted","Data":"c31ae52fd46dff0a89dc59563a9ff29ce97c24d96aca076b0bc6c88d82e422e5"}
Sep 08 15:18:56.561530 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:56.561495    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 15:18:56.561777 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:56.561572    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 15:18:57.304065 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:57.304024    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p" event={"ID":"6b8c076c-444c-4cee-874f-b1f7902e5fb8","Type":"ContainerStarted","Data":"f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0"}
Sep 08 15:18:57.304254 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:57.304181    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:18:57.306100 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:57.306069    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-65g9p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:18:57.306209 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:57.306119    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p" podUID="6b8c076c-444c-4cee-874f-b1f7902e5fb8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:18:57.329542 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:57.329483    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p" podStartSLOduration=2.138081662 podStartE2EDuration="5.329466888s" totalImagesPullingTime="3.191385226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:57.327794118 +0000 UTC m=+597.899340172" watchObservedRunningTime="2026-09-08 15:18:57.329466888 +0000 UTC m=+597.901012930"
Sep 08 15:18:57.329815 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:57.329785    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5674d6d4b5-7cl4j" podStartSLOduration=3.657425156 podStartE2EDuration="6.3297756s" totalImagesPullingTime="2.672350444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:55.328234215 +0000 UTC m=+595.899780258" watchObservedRunningTime="2026-09-08 15:18:57.3297756 +0000 UTC m=+597.901321676"
Sep 08 15:18:58.309509 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:58.309481    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-65g9p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:18:58.309889 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:18:58.309531    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p" podUID="6b8c076c-444c-4cee-874f-b1f7902e5fb8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:19:01.310728 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:01.310696    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:19:02.069644 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.069593    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-856b6897b7-fn6bl"]
Sep 08 15:19:02.072771 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.072754    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.088318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.088284    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-856b6897b7-fn6bl"]
Sep 08 15:19:02.123401 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.123369    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-service-ca\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.123401 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.123408    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-trusted-ca-bundle\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.123679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.123441    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-oauth-serving-cert\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.123679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.123496    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-console-config\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.123679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.123530    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13e6d01f-2b60-45c7-80f9-dd1923232dea-console-oauth-config\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.123679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.123552    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13e6d01f-2b60-45c7-80f9-dd1923232dea-console-serving-cert\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.123679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.123641    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5jzh\" (UniqueName: \"kubernetes.io/projected/13e6d01f-2b60-45c7-80f9-dd1923232dea-kube-api-access-g5jzh\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.224424 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.224383    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5jzh\" (UniqueName: \"kubernetes.io/projected/13e6d01f-2b60-45c7-80f9-dd1923232dea-kube-api-access-g5jzh\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.224649 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.224445    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-service-ca\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.224649 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.224591    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-trusted-ca-bundle\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.224778 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.224663    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-oauth-serving-cert\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.224778 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.224699    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-console-config\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.224778 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.224749    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13e6d01f-2b60-45c7-80f9-dd1923232dea-console-oauth-config\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.224924 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.224781    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13e6d01f-2b60-45c7-80f9-dd1923232dea-console-serving-cert\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.225300 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.225268    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-service-ca\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.225476 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.225454    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-console-config\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.225598 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.225573    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-trusted-ca-bundle\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.226057 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.226034    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13e6d01f-2b60-45c7-80f9-dd1923232dea-oauth-serving-cert\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.228127 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.228098    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13e6d01f-2b60-45c7-80f9-dd1923232dea-console-oauth-config\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.228267 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.228106    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13e6d01f-2b60-45c7-80f9-dd1923232dea-console-serving-cert\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.233646 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.233593    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5jzh\" (UniqueName: \"kubernetes.io/projected/13e6d01f-2b60-45c7-80f9-dd1923232dea-kube-api-access-g5jzh\") pod \"console-856b6897b7-fn6bl\" (UID: \"13e6d01f-2b60-45c7-80f9-dd1923232dea\") " pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.382812 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.382770    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:02.665791 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:02.665698    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-856b6897b7-fn6bl"]
Sep 08 15:19:02.668871 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:19:02.668843    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e6d01f_2b60_45c7_80f9_dd1923232dea.slice/crio-0c823d1e8bddb9bfae8e8bd9b32d38e0172ee651c56148fa86fbcecc0f20d153 WatchSource:0}: Error finding container 0c823d1e8bddb9bfae8e8bd9b32d38e0172ee651c56148fa86fbcecc0f20d153: Status 404 returned error can't find the container with id 0c823d1e8bddb9bfae8e8bd9b32d38e0172ee651c56148fa86fbcecc0f20d153
Sep 08 15:19:03.338592 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:03.338552    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856b6897b7-fn6bl" event={"ID":"13e6d01f-2b60-45c7-80f9-dd1923232dea","Type":"ContainerStarted","Data":"208e96b6c4cec7df1f939f45879cf182c6def4ac4b76bfa714e8d6f789c79fcb"}
Sep 08 15:19:03.338823 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:03.338642    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856b6897b7-fn6bl" event={"ID":"13e6d01f-2b60-45c7-80f9-dd1923232dea","Type":"ContainerStarted","Data":"0c823d1e8bddb9bfae8e8bd9b32d38e0172ee651c56148fa86fbcecc0f20d153"}
Sep 08 15:19:03.368438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:03.368378    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-856b6897b7-fn6bl" podStartSLOduration=1.368363265 podStartE2EDuration="1.368363265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:03.365278304 +0000 UTC m=+603.936824346" watchObservedRunningTime="2026-09-08 15:19:03.368363265 +0000 UTC m=+603.939909307"
Sep 08 15:19:10.979943 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:10.979905    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"]
Sep 08 15:19:10.983753 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:10.983728    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"
Sep 08 15:19:10.986272 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:10.986249    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 08 15:19:10.986778 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:10.986760    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mkdqc\""
Sep 08 15:19:11.005435 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.005400    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"]
Sep 08 15:19:11.007078 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.007058    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"]
Sep 08 15:19:11.010219 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.010201    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"
Sep 08 15:19:11.013483 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.013457    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wf8cz\""
Sep 08 15:19:11.013872 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.013854    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 15:19:11.029775 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.029742    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"]
Sep 08 15:19:11.109361 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.109324    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5967258-0d46-48e1-b8d3-6e24e145ccb6-cert\") pod \"kserve-controller-manager-d6f4b65b8-pz4mm\" (UID: \"e5967258-0d46-48e1-b8d3-6e24e145ccb6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"
Sep 08 15:19:11.109556 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.109397    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tv87\" (UniqueName: \"kubernetes.io/projected/e5967258-0d46-48e1-b8d3-6e24e145ccb6-kube-api-access-9tv87\") pod \"kserve-controller-manager-d6f4b65b8-pz4mm\" (UID: \"e5967258-0d46-48e1-b8d3-6e24e145ccb6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"
Sep 08 15:19:11.109556 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.109464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px9ng\" (UniqueName: \"kubernetes.io/projected/f29a6c8c-bcd9-4791-9629-95a151f1b466-kube-api-access-px9ng\") pod \"llmisvc-controller-manager-777c6bd7d5-6h7xx\" (UID: \"f29a6c8c-bcd9-4791-9629-95a151f1b466\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"
Sep 08 15:19:11.109556 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.109519    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f29a6c8c-bcd9-4791-9629-95a151f1b466-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6h7xx\" (UID: \"f29a6c8c-bcd9-4791-9629-95a151f1b466\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"
Sep 08 15:19:11.210023 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.209987    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tv87\" (UniqueName: \"kubernetes.io/projected/e5967258-0d46-48e1-b8d3-6e24e145ccb6-kube-api-access-9tv87\") pod \"kserve-controller-manager-d6f4b65b8-pz4mm\" (UID: \"e5967258-0d46-48e1-b8d3-6e24e145ccb6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"
Sep 08 15:19:11.210023 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.210038    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px9ng\" (UniqueName: \"kubernetes.io/projected/f29a6c8c-bcd9-4791-9629-95a151f1b466-kube-api-access-px9ng\") pod \"llmisvc-controller-manager-777c6bd7d5-6h7xx\" (UID: \"f29a6c8c-bcd9-4791-9629-95a151f1b466\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"
Sep 08 15:19:11.210301 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.210064    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f29a6c8c-bcd9-4791-9629-95a151f1b466-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6h7xx\" (UID: \"f29a6c8c-bcd9-4791-9629-95a151f1b466\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"
Sep 08 15:19:11.210301 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.210110    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5967258-0d46-48e1-b8d3-6e24e145ccb6-cert\") pod \"kserve-controller-manager-d6f4b65b8-pz4mm\" (UID: \"e5967258-0d46-48e1-b8d3-6e24e145ccb6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"
Sep 08 15:19:11.210301 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:19:11.210219    2566 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 08 15:19:11.210301 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:19:11.210301    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5967258-0d46-48e1-b8d3-6e24e145ccb6-cert podName:e5967258-0d46-48e1-b8d3-6e24e145ccb6 nodeName:}" failed. No retries permitted until 2026-09-08 15:19:11.710282337 +0000 UTC m=+612.281828357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e5967258-0d46-48e1-b8d3-6e24e145ccb6-cert") pod "kserve-controller-manager-d6f4b65b8-pz4mm" (UID: "e5967258-0d46-48e1-b8d3-6e24e145ccb6") : secret "kserve-webhook-server-cert" not found
Sep 08 15:19:11.212809 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.212773    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f29a6c8c-bcd9-4791-9629-95a151f1b466-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6h7xx\" (UID: \"f29a6c8c-bcd9-4791-9629-95a151f1b466\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"
Sep 08 15:19:11.227298 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.227269    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px9ng\" (UniqueName: \"kubernetes.io/projected/f29a6c8c-bcd9-4791-9629-95a151f1b466-kube-api-access-px9ng\") pod \"llmisvc-controller-manager-777c6bd7d5-6h7xx\" (UID: \"f29a6c8c-bcd9-4791-9629-95a151f1b466\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"
Sep 08 15:19:11.227519 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.227493    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tv87\" (UniqueName: \"kubernetes.io/projected/e5967258-0d46-48e1-b8d3-6e24e145ccb6-kube-api-access-9tv87\") pod \"kserve-controller-manager-d6f4b65b8-pz4mm\" (UID: \"e5967258-0d46-48e1-b8d3-6e24e145ccb6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"
Sep 08 15:19:11.321205 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.321104    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"
Sep 08 15:19:11.614158 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.614130    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"]
Sep 08 15:19:11.615401 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:19:11.615375    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf29a6c8c_bcd9_4791_9629_95a151f1b466.slice/crio-74b20f93ec326c2db97164adafc3a14f63b0421a686a6a7c94de1c4724f211e7 WatchSource:0}: Error finding container 74b20f93ec326c2db97164adafc3a14f63b0421a686a6a7c94de1c4724f211e7: Status 404 returned error can't find the container with id 74b20f93ec326c2db97164adafc3a14f63b0421a686a6a7c94de1c4724f211e7
Sep 08 15:19:11.616681 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.616664    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:19:11.713521 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.713479    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5967258-0d46-48e1-b8d3-6e24e145ccb6-cert\") pod \"kserve-controller-manager-d6f4b65b8-pz4mm\" (UID: \"e5967258-0d46-48e1-b8d3-6e24e145ccb6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"
Sep 08 15:19:11.716218 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.716193    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5967258-0d46-48e1-b8d3-6e24e145ccb6-cert\") pod \"kserve-controller-manager-d6f4b65b8-pz4mm\" (UID: \"e5967258-0d46-48e1-b8d3-6e24e145ccb6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"
Sep 08 15:19:11.894723 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:11.894594    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"
Sep 08 15:19:12.196278 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:12.196252    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"]
Sep 08 15:19:12.198388 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:19:12.198361    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5967258_0d46_48e1_b8d3_6e24e145ccb6.slice/crio-1cadfc931ea6a08e031c93dcbb4517ada3333fd93e164131b08ae26b7b8a18d5 WatchSource:0}: Error finding container 1cadfc931ea6a08e031c93dcbb4517ada3333fd93e164131b08ae26b7b8a18d5: Status 404 returned error can't find the container with id 1cadfc931ea6a08e031c93dcbb4517ada3333fd93e164131b08ae26b7b8a18d5
Sep 08 15:19:12.384000 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:12.383960    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:12.384193 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:12.384032    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:12.388815 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:12.388791    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:12.392111 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:12.392077    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm" event={"ID":"e5967258-0d46-48e1-b8d3-6e24e145ccb6","Type":"ContainerStarted","Data":"1cadfc931ea6a08e031c93dcbb4517ada3333fd93e164131b08ae26b7b8a18d5"}
Sep 08 15:19:12.393404 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:12.393377    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx" event={"ID":"f29a6c8c-bcd9-4791-9629-95a151f1b466","Type":"ContainerStarted","Data":"74b20f93ec326c2db97164adafc3a14f63b0421a686a6a7c94de1c4724f211e7"}
Sep 08 15:19:12.397093 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:12.397073    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-856b6897b7-fn6bl"
Sep 08 15:19:12.650525 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:12.650483    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759df99f5d-qkjs5"]
Sep 08 15:19:13.595863 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.595828    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"]
Sep 08 15:19:13.596323 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.596108    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p" podUID="6b8c076c-444c-4cee-874f-b1f7902e5fb8" containerName="discovery" containerID="cri-o://f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0" gracePeriod=30
Sep 08 15:19:13.873085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.872799    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:19:13.935636 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.935583    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-cacerts\") pod \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") "
Sep 08 15:19:13.935830 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.935650    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-kubeconfig\") pod \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") "
Sep 08 15:19:13.935830 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.935738    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-ca-configmap\") pod \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") "
Sep 08 15:19:13.935830 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.935759    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b8c076c-444c-4cee-874f-b1f7902e5fb8-local-certs\") pod \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") "
Sep 08 15:19:13.935830 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.935776    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-token\") pod \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") "
Sep 08 15:19:13.935830 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.935801    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96v82\" (UniqueName: \"kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-kube-api-access-96v82\") pod \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") "
Sep 08 15:19:13.936105 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.935840    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-dns-cert\") pod \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\" (UID: \"6b8c076c-444c-4cee-874f-b1f7902e5fb8\") "
Sep 08 15:19:13.936371 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.936341    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6b8c076c-444c-4cee-874f-b1f7902e5fb8" (UID: "6b8c076c-444c-4cee-874f-b1f7902e5fb8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:19:13.939379 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.939350    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b8c076c-444c-4cee-874f-b1f7902e5fb8-local-certs" (OuterVolumeSpecName: "local-certs") pod "6b8c076c-444c-4cee-874f-b1f7902e5fb8" (UID: "6b8c076c-444c-4cee-874f-b1f7902e5fb8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:19:13.939379 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.939366    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b8c076c-444c-4cee-874f-b1f7902e5fb8" (UID: "6b8c076c-444c-4cee-874f-b1f7902e5fb8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:19:13.939781 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.939739    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-cacerts" (OuterVolumeSpecName: "cacerts") pod "6b8c076c-444c-4cee-874f-b1f7902e5fb8" (UID: "6b8c076c-444c-4cee-874f-b1f7902e5fb8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:19:13.940025 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.939997    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6b8c076c-444c-4cee-874f-b1f7902e5fb8" (UID: "6b8c076c-444c-4cee-874f-b1f7902e5fb8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:19:13.941885 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.941845    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-kube-api-access-96v82" (OuterVolumeSpecName: "kube-api-access-96v82") pod "6b8c076c-444c-4cee-874f-b1f7902e5fb8" (UID: "6b8c076c-444c-4cee-874f-b1f7902e5fb8"). InnerVolumeSpecName "kube-api-access-96v82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:19:13.942174 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:13.942020    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6b8c076c-444c-4cee-874f-b1f7902e5fb8" (UID: "6b8c076c-444c-4cee-874f-b1f7902e5fb8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:19:14.037462 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.037421    2566 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-cacerts\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:14.037462 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.037463    2566 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-kubeconfig\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:14.037762 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.037481    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-ca-configmap\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:14.037762 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.037496    2566 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b8c076c-444c-4cee-874f-b1f7902e5fb8-local-certs\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:14.037762 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.037508    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-token\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:14.037762 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.037516    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96v82\" (UniqueName: \"kubernetes.io/projected/6b8c076c-444c-4cee-874f-b1f7902e5fb8-kube-api-access-96v82\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:14.037762 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.037524    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b8c076c-444c-4cee-874f-b1f7902e5fb8-istio-csr-dns-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:14.410375 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.410333    2566 generic.go:356] "Generic (PLEG): container finished" podID="6b8c076c-444c-4cee-874f-b1f7902e5fb8" containerID="f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0" exitCode=0
Sep 08 15:19:14.410577 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.410389    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"
Sep 08 15:19:14.410577 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.410384    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p" event={"ID":"6b8c076c-444c-4cee-874f-b1f7902e5fb8","Type":"ContainerDied","Data":"f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0"}
Sep 08 15:19:14.410577 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.410492    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p" event={"ID":"6b8c076c-444c-4cee-874f-b1f7902e5fb8","Type":"ContainerDied","Data":"6a31e210302e94321988421942edb5afc4a2ff95334f08410a9feafcd1239938"}
Sep 08 15:19:14.410577 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.410534    2566 scope.go:117] "RemoveContainer" containerID="f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0"
Sep 08 15:19:14.438527 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.438455    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"]
Sep 08 15:19:14.443078 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.443042    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-65g9p"]
Sep 08 15:19:14.580052 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.580031    2566 scope.go:117] "RemoveContainer" containerID="f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0"
Sep 08 15:19:14.580414 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:19:14.580393    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0\": container with ID starting with f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0 not found: ID does not exist" containerID="f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0"
Sep 08 15:19:14.580484 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:14.580429    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0"} err="failed to get container status \"f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0\": rpc error: code = NotFound desc = could not find container \"f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0\": container with ID starting with f59c51f46b5dd3228ef02451584a89228997c5857429f4d320c808c7807735b0 not found: ID does not exist"
Sep 08 15:19:15.915267 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:15.915227    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b8c076c-444c-4cee-874f-b1f7902e5fb8" path="/var/lib/kubelet/pods/6b8c076c-444c-4cee-874f-b1f7902e5fb8/volumes"
Sep 08 15:19:16.423891 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:16.423854    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm" event={"ID":"e5967258-0d46-48e1-b8d3-6e24e145ccb6","Type":"ContainerStarted","Data":"507795f1c80b2fe2ea04a138a48a9a1565ede246d9cea55489b81133bb9921d4"}
Sep 08 15:19:16.424078 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:16.424029    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"
Sep 08 15:19:16.425430 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:16.425407    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx" event={"ID":"f29a6c8c-bcd9-4791-9629-95a151f1b466","Type":"ContainerStarted","Data":"773463cff1e1d5b4a67ca943dd3fba2adec11cd376fcc43278693741d84607ae"}
Sep 08 15:19:16.425563 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:16.425457    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"
Sep 08 15:19:16.443943 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:16.443883    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm" podStartSLOduration=3.7922520730000002 podStartE2EDuration="6.443866269s" totalImagesPullingTime="2.651614196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:16.441719976 +0000 UTC m=+617.013266019" watchObservedRunningTime="2026-09-08 15:19:16.443866269 +0000 UTC m=+617.015412352"
Sep 08 15:19:16.462427 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:16.462366    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx" podStartSLOduration=2.603733251 podStartE2EDuration="6.462348242s" totalImagesPullingTime="3.858614991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:16.461577947 +0000 UTC m=+617.033123988" watchObservedRunningTime="2026-09-08 15:19:16.462348242 +0000 UTC m=+617.033894285"
Sep 08 15:19:37.670862 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.670754    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-759df99f5d-qkjs5" podUID="face309c-709a-4f77-9859-3499c55b2c57" containerName="console" containerID="cri-o://9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a" gracePeriod=15
Sep 08 15:19:37.924099 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.924032    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:19:37.954109 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.954080    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-trusted-ca-bundle\") pod \"face309c-709a-4f77-9859-3499c55b2c57\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") "
Sep 08 15:19:37.954276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.954128    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp4bn\" (UniqueName: \"kubernetes.io/projected/face309c-709a-4f77-9859-3499c55b2c57-kube-api-access-tp4bn\") pod \"face309c-709a-4f77-9859-3499c55b2c57\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") "
Sep 08 15:19:37.954276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.954157    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-serving-cert\") pod \"face309c-709a-4f77-9859-3499c55b2c57\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") "
Sep 08 15:19:37.954276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.954193    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-service-ca\") pod \"face309c-709a-4f77-9859-3499c55b2c57\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") "
Sep 08 15:19:37.954276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.954260    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-oauth-config\") pod \"face309c-709a-4f77-9859-3499c55b2c57\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") "
Sep 08 15:19:37.954436 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.954301    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-oauth-serving-cert\") pod \"face309c-709a-4f77-9859-3499c55b2c57\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") "
Sep 08 15:19:37.954436 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.954338    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-console-config\") pod \"face309c-709a-4f77-9859-3499c55b2c57\" (UID: \"face309c-709a-4f77-9859-3499c55b2c57\") "
Sep 08 15:19:37.954605 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.954487    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "face309c-709a-4f77-9859-3499c55b2c57" (UID: "face309c-709a-4f77-9859-3499c55b2c57"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:19:37.954864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.954840    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-service-ca" (OuterVolumeSpecName: "service-ca") pod "face309c-709a-4f77-9859-3499c55b2c57" (UID: "face309c-709a-4f77-9859-3499c55b2c57"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:19:37.954982 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.954912    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "face309c-709a-4f77-9859-3499c55b2c57" (UID: "face309c-709a-4f77-9859-3499c55b2c57"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:19:37.954982 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.954919    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-console-config" (OuterVolumeSpecName: "console-config") pod "face309c-709a-4f77-9859-3499c55b2c57" (UID: "face309c-709a-4f77-9859-3499c55b2c57"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:19:37.956593 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.956557    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "face309c-709a-4f77-9859-3499c55b2c57" (UID: "face309c-709a-4f77-9859-3499c55b2c57"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:19:37.956718 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.956693    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "face309c-709a-4f77-9859-3499c55b2c57" (UID: "face309c-709a-4f77-9859-3499c55b2c57"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:19:37.956937 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:37.956911    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/face309c-709a-4f77-9859-3499c55b2c57-kube-api-access-tp4bn" (OuterVolumeSpecName: "kube-api-access-tp4bn") pod "face309c-709a-4f77-9859-3499c55b2c57" (UID: "face309c-709a-4f77-9859-3499c55b2c57"). InnerVolumeSpecName "kube-api-access-tp4bn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:19:38.055972 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.055924    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-oauth-config\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:38.055972 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.055962    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-oauth-serving-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:38.055972 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.055973    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-console-config\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:38.055972 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.055982    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-trusted-ca-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:38.056233 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.055991    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp4bn\" (UniqueName: \"kubernetes.io/projected/face309c-709a-4f77-9859-3499c55b2c57-kube-api-access-tp4bn\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:38.056233 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.056000    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/face309c-709a-4f77-9859-3499c55b2c57-console-serving-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:38.056233 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.056008    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/face309c-709a-4f77-9859-3499c55b2c57-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:19:38.535074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.535037    2566 generic.go:356] "Generic (PLEG): container finished" podID="face309c-709a-4f77-9859-3499c55b2c57" containerID="9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a" exitCode=0
Sep 08 15:19:38.535255 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.535086    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759df99f5d-qkjs5"
Sep 08 15:19:38.535255 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.535124    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759df99f5d-qkjs5" event={"ID":"face309c-709a-4f77-9859-3499c55b2c57","Type":"ContainerDied","Data":"9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a"}
Sep 08 15:19:38.535255 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.535176    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759df99f5d-qkjs5" event={"ID":"face309c-709a-4f77-9859-3499c55b2c57","Type":"ContainerDied","Data":"676fe6187f38718c1d6c459a432a45cf209dfcbad7a1c54b8998da4b9d2e5f5e"}
Sep 08 15:19:38.535255 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.535197    2566 scope.go:117] "RemoveContainer" containerID="9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a"
Sep 08 15:19:38.544706 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.544684    2566 scope.go:117] "RemoveContainer" containerID="9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a"
Sep 08 15:19:38.545017 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:19:38.544996    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a\": container with ID starting with 9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a not found: ID does not exist" containerID="9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a"
Sep 08 15:19:38.545083 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.545030    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a"} err="failed to get container status \"9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a\": rpc error: code = NotFound desc = could not find container \"9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a\": container with ID starting with 9f3f98178e5c6182a3426143bce849d78a885fe4aba88f7cef65da293165b53a not found: ID does not exist"
Sep 08 15:19:38.557373 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.557337    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759df99f5d-qkjs5"]
Sep 08 15:19:38.563931 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:38.563900    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-759df99f5d-qkjs5"]
Sep 08 15:19:39.914323 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:39.914292    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="face309c-709a-4f77-9859-3499c55b2c57" path="/var/lib/kubelet/pods/face309c-709a-4f77-9859-3499c55b2c57/volumes"
Sep 08 15:19:47.432928 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:47.432894    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6h7xx"
Sep 08 15:19:47.436521 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:19:47.436501    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pz4mm"
Sep 08 15:20:04.740171 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.740135    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"]
Sep 08 15:20:04.740541 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.740483    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b8c076c-444c-4cee-874f-b1f7902e5fb8" containerName="discovery"
Sep 08 15:20:04.740541 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.740494    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b8c076c-444c-4cee-874f-b1f7902e5fb8" containerName="discovery"
Sep 08 15:20:04.740541 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.740519    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="face309c-709a-4f77-9859-3499c55b2c57" containerName="console"
Sep 08 15:20:04.740541 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.740525    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="face309c-709a-4f77-9859-3499c55b2c57" containerName="console"
Sep 08 15:20:04.740714 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.740603    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="face309c-709a-4f77-9859-3499c55b2c57" containerName="console"
Sep 08 15:20:04.740714 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.740611    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b8c076c-444c-4cee-874f-b1f7902e5fb8" containerName="discovery"
Sep 08 15:20:04.745019 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.744997    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:04.747720 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.747699    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kx27n\""
Sep 08 15:20:04.747845 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.747696    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:20:04.747845 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.747764    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:20:04.751638 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.751597    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"]
Sep 08 15:20:04.835435 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.835400    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"]
Sep 08 15:20:04.838923 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.838899    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:04.847300 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.847274    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"]
Sep 08 15:20:04.880573 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.880535    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:04.880814 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.880608    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:04.880814 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.880671    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxp9j\" (UniqueName: \"kubernetes.io/projected/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-kube-api-access-wxp9j\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:04.952366 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.952330    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"]
Sep 08 15:20:04.955760 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.955742    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:04.969832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.969805    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"]
Sep 08 15:20:04.981120 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.981086    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:04.981270 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.981126    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:04.981270 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.981210    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:04.981349 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.981267    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:04.981349 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.981294    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bh9v\" (UniqueName: \"kubernetes.io/projected/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-kube-api-access-7bh9v\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:04.981349 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.981336    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxp9j\" (UniqueName: \"kubernetes.io/projected/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-kube-api-access-wxp9j\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:04.981466 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.981451    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:04.981550 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.981534    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:04.995779 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:04.995709    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxp9j\" (UniqueName: \"kubernetes.io/projected/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-kube-api-access-wxp9j\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:05.043637 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.043596    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"]
Sep 08 15:20:05.047239 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.047220    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:05.056397 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.056373    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:05.056885 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.056864    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"]
Sep 08 15:20:05.082352 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.082323    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r6tp\" (UniqueName: \"kubernetes.io/projected/47627929-84fc-431c-852d-751ac8ea2c97-kube-api-access-8r6tp\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:05.082517 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.082369    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bh9v\" (UniqueName: \"kubernetes.io/projected/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-kube-api-access-7bh9v\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:05.082517 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.082441    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:05.082631 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.082518    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:05.082631 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.082549    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:05.082631 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.082575    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:05.082886 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.082867    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:05.082951 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.082898    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:05.090702 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.090669    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bh9v\" (UniqueName: \"kubernetes.io/projected/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-kube-api-access-7bh9v\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:05.148913 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.148879    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:05.183344 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.183293    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:05.183554 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.183353    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:05.183554 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.183395    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r6tp\" (UniqueName: \"kubernetes.io/projected/47627929-84fc-431c-852d-751ac8ea2c97-kube-api-access-8r6tp\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:05.183716 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.183595    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:05.183716 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.183647    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfl96\" (UniqueName: \"kubernetes.io/projected/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-kube-api-access-mfl96\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:05.183716 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.183706    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:05.183892 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.183863    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:05.183947 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.183892    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:05.193483 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.193447    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r6tp\" (UniqueName: \"kubernetes.io/projected/47627929-84fc-431c-852d-751ac8ea2c97-kube-api-access-8r6tp\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:05.265337 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.265243    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:05.284609 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.284580    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:05.284609 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.284632    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfl96\" (UniqueName: \"kubernetes.io/projected/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-kube-api-access-mfl96\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:05.284878 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.284672    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:05.284976 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.284957    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:05.285096 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.285071    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:05.294593 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.294559    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfl96\" (UniqueName: \"kubernetes.io/projected/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-kube-api-access-mfl96\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:05.336608 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.336577    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"]
Sep 08 15:20:05.338641 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:05.338601    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9ae65d_5862_4444_8bba_6e2a0a0e3452.slice/crio-0b1c02801e74bb9e7601ee14e48728440694926eea5acf848c80229ed3aee849 WatchSource:0}: Error finding container 0b1c02801e74bb9e7601ee14e48728440694926eea5acf848c80229ed3aee849: Status 404 returned error can't find the container with id 0b1c02801e74bb9e7601ee14e48728440694926eea5acf848c80229ed3aee849
Sep 08 15:20:05.359023 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.358997    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:05.426793 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.426758    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"]
Sep 08 15:20:05.430414 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:05.430380    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd161b094_2d0f_4d2a_8c16_07b40fea2bbb.slice/crio-026513df3bffb5527fd1c2d643b32db3aff3bff48fa8b8875233faad595122a3 WatchSource:0}: Error finding container 026513df3bffb5527fd1c2d643b32db3aff3bff48fa8b8875233faad595122a3: Status 404 returned error can't find the container with id 026513df3bffb5527fd1c2d643b32db3aff3bff48fa8b8875233faad595122a3
Sep 08 15:20:05.542542 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.542511    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"]
Sep 08 15:20:05.543576 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:05.543551    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47627929_84fc_431c_852d_751ac8ea2c97.slice/crio-65bf902d8b88b3330f09c20f4468c008ead739041cabafdb3997336976cc7912 WatchSource:0}: Error finding container 65bf902d8b88b3330f09c20f4468c008ead739041cabafdb3997336976cc7912: Status 404 returned error can't find the container with id 65bf902d8b88b3330f09c20f4468c008ead739041cabafdb3997336976cc7912
Sep 08 15:20:05.638783 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.638756    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"]
Sep 08 15:20:05.650549 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:05.650513    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc727a41f_ae3c_499c_a0e1_b5bdd5e7aedc.slice/crio-f5a4855b46259a8949a0f8cf4b67dd30c23e7a28b8e34d4260e5fcb26c9c7b87 WatchSource:0}: Error finding container f5a4855b46259a8949a0f8cf4b67dd30c23e7a28b8e34d4260e5fcb26c9c7b87: Status 404 returned error can't find the container with id f5a4855b46259a8949a0f8cf4b67dd30c23e7a28b8e34d4260e5fcb26c9c7b87
Sep 08 15:20:05.668062 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.668028    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq" event={"ID":"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc","Type":"ContainerStarted","Data":"f5a4855b46259a8949a0f8cf4b67dd30c23e7a28b8e34d4260e5fcb26c9c7b87"}
Sep 08 15:20:05.669555 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.669531    2566 generic.go:356] "Generic (PLEG): container finished" podID="47627929-84fc-431c-852d-751ac8ea2c97" containerID="40bfd6a0ed3a4752b405eb5827bb7dcada6422a750df2cf571ac9d4022f70fc1" exitCode=0
Sep 08 15:20:05.669691 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.669639    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk" event={"ID":"47627929-84fc-431c-852d-751ac8ea2c97","Type":"ContainerDied","Data":"40bfd6a0ed3a4752b405eb5827bb7dcada6422a750df2cf571ac9d4022f70fc1"}
Sep 08 15:20:05.669765 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.669694    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk" event={"ID":"47627929-84fc-431c-852d-751ac8ea2c97","Type":"ContainerStarted","Data":"65bf902d8b88b3330f09c20f4468c008ead739041cabafdb3997336976cc7912"}
Sep 08 15:20:05.671379 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.671357    2566 generic.go:356] "Generic (PLEG): container finished" podID="d161b094-2d0f-4d2a-8c16-07b40fea2bbb" containerID="778133a5710e59139cbbb199f4a05e7f2b105f295e6699f766e4d222c875cfa8" exitCode=0
Sep 08 15:20:05.671476 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.671437    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f" event={"ID":"d161b094-2d0f-4d2a-8c16-07b40fea2bbb","Type":"ContainerDied","Data":"778133a5710e59139cbbb199f4a05e7f2b105f295e6699f766e4d222c875cfa8"}
Sep 08 15:20:05.671540 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.671493    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f" event={"ID":"d161b094-2d0f-4d2a-8c16-07b40fea2bbb","Type":"ContainerStarted","Data":"026513df3bffb5527fd1c2d643b32db3aff3bff48fa8b8875233faad595122a3"}
Sep 08 15:20:05.673052 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.672986    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a9ae65d-5862-4444-8bba-6e2a0a0e3452" containerID="77630a6f809fced939ff1c685cd6cf6841087d8d44f7639bdac48816e29d4c80" exitCode=0
Sep 08 15:20:05.673157 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.673060    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck" event={"ID":"9a9ae65d-5862-4444-8bba-6e2a0a0e3452","Type":"ContainerDied","Data":"77630a6f809fced939ff1c685cd6cf6841087d8d44f7639bdac48816e29d4c80"}
Sep 08 15:20:05.673157 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:05.673094    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck" event={"ID":"9a9ae65d-5862-4444-8bba-6e2a0a0e3452","Type":"ContainerStarted","Data":"0b1c02801e74bb9e7601ee14e48728440694926eea5acf848c80229ed3aee849"}
Sep 08 15:20:06.681610 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:06.681516    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a9ae65d-5862-4444-8bba-6e2a0a0e3452" containerID="afc74a77bb7d3a3ed77baddbfb88a1f64e9055f303d21577a32c88947e9a20a2" exitCode=0
Sep 08 15:20:06.681610 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:06.681569    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck" event={"ID":"9a9ae65d-5862-4444-8bba-6e2a0a0e3452","Type":"ContainerDied","Data":"afc74a77bb7d3a3ed77baddbfb88a1f64e9055f303d21577a32c88947e9a20a2"}
Sep 08 15:20:06.683391 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:06.683370    2566 generic.go:356] "Generic (PLEG): container finished" podID="c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" containerID="0ffe18f6483df013e999fb1bbc6bce6b2e0627d3f1a459871408291582665996" exitCode=0
Sep 08 15:20:06.683485 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:06.683455    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq" event={"ID":"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc","Type":"ContainerDied","Data":"0ffe18f6483df013e999fb1bbc6bce6b2e0627d3f1a459871408291582665996"}
Sep 08 15:20:06.685598 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:06.685577    2566 generic.go:356] "Generic (PLEG): container finished" podID="47627929-84fc-431c-852d-751ac8ea2c97" containerID="754de6d9edebe7aec9a19b35b924c60f7648a1f6b46d74e7ade32a1605fec120" exitCode=0
Sep 08 15:20:06.685715 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:06.685635    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk" event={"ID":"47627929-84fc-431c-852d-751ac8ea2c97","Type":"ContainerDied","Data":"754de6d9edebe7aec9a19b35b924c60f7648a1f6b46d74e7ade32a1605fec120"}
Sep 08 15:20:07.692997 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:07.692955    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a9ae65d-5862-4444-8bba-6e2a0a0e3452" containerID="58177773ad6ada184367307fc7455e36db76ba08fcbeaef6fc8dcb6a63ae0f14" exitCode=0
Sep 08 15:20:07.693435 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:07.693017    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck" event={"ID":"9a9ae65d-5862-4444-8bba-6e2a0a0e3452","Type":"ContainerDied","Data":"58177773ad6ada184367307fc7455e36db76ba08fcbeaef6fc8dcb6a63ae0f14"}
Sep 08 15:20:07.694996 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:07.694973    2566 generic.go:356] "Generic (PLEG): container finished" podID="c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" containerID="b47802eb95cd892739d68918160bfc69db5bcd9af0dee7389e6bc064d69fdd07" exitCode=0
Sep 08 15:20:07.695127 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:07.695056    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq" event={"ID":"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc","Type":"ContainerDied","Data":"b47802eb95cd892739d68918160bfc69db5bcd9af0dee7389e6bc064d69fdd07"}
Sep 08 15:20:07.697411 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:07.697387    2566 generic.go:356] "Generic (PLEG): container finished" podID="47627929-84fc-431c-852d-751ac8ea2c97" containerID="21a2f661325edd6a985c616afbf55597edb9fe4e3653b2af3c9e8565bade537d" exitCode=0
Sep 08 15:20:07.697520 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:07.697468    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk" event={"ID":"47627929-84fc-431c-852d-751ac8ea2c97","Type":"ContainerDied","Data":"21a2f661325edd6a985c616afbf55597edb9fe4e3653b2af3c9e8565bade537d"}
Sep 08 15:20:08.705464 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:08.705432    2566 generic.go:356] "Generic (PLEG): container finished" podID="c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" containerID="b16e3ffcdca1cfd9bee3e4a8d94a5719fc22e3f6105753926fcbce2b15799026" exitCode=0
Sep 08 15:20:08.705887 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:08.705507    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq" event={"ID":"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc","Type":"ContainerDied","Data":"b16e3ffcdca1cfd9bee3e4a8d94a5719fc22e3f6105753926fcbce2b15799026"}
Sep 08 15:20:08.707350 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:08.707323    2566 generic.go:356] "Generic (PLEG): container finished" podID="d161b094-2d0f-4d2a-8c16-07b40fea2bbb" containerID="e0696ba9dd02aefe4b5a7bad77b846000f65e206d15a92a5cd1ed5fc53f10ae8" exitCode=0
Sep 08 15:20:08.707485 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:08.707410    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f" event={"ID":"d161b094-2d0f-4d2a-8c16-07b40fea2bbb","Type":"ContainerDied","Data":"e0696ba9dd02aefe4b5a7bad77b846000f65e206d15a92a5cd1ed5fc53f10ae8"}
Sep 08 15:20:08.857581 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:08.857548    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:08.869193 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:08.869164    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:09.016490 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.016384    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r6tp\" (UniqueName: \"kubernetes.io/projected/47627929-84fc-431c-852d-751ac8ea2c97-kube-api-access-8r6tp\") pod \"47627929-84fc-431c-852d-751ac8ea2c97\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") "
Sep 08 15:20:09.016490 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.016466    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxp9j\" (UniqueName: \"kubernetes.io/projected/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-kube-api-access-wxp9j\") pod \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") "
Sep 08 15:20:09.016490 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.016488    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-util\") pod \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") "
Sep 08 15:20:09.016826 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.016505    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-util\") pod \"47627929-84fc-431c-852d-751ac8ea2c97\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") "
Sep 08 15:20:09.016826 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.016592    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-bundle\") pod \"47627929-84fc-431c-852d-751ac8ea2c97\" (UID: \"47627929-84fc-431c-852d-751ac8ea2c97\") "
Sep 08 15:20:09.016826 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.016649    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-bundle\") pod \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\" (UID: \"9a9ae65d-5862-4444-8bba-6e2a0a0e3452\") "
Sep 08 15:20:09.017155 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.017128    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-bundle" (OuterVolumeSpecName: "bundle") pod "47627929-84fc-431c-852d-751ac8ea2c97" (UID: "47627929-84fc-431c-852d-751ac8ea2c97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:09.017371 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.017162    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-bundle" (OuterVolumeSpecName: "bundle") pod "9a9ae65d-5862-4444-8bba-6e2a0a0e3452" (UID: "9a9ae65d-5862-4444-8bba-6e2a0a0e3452"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:09.018872 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.018851    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-kube-api-access-wxp9j" (OuterVolumeSpecName: "kube-api-access-wxp9j") pod "9a9ae65d-5862-4444-8bba-6e2a0a0e3452" (UID: "9a9ae65d-5862-4444-8bba-6e2a0a0e3452"). InnerVolumeSpecName "kube-api-access-wxp9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:09.019102 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.019071    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47627929-84fc-431c-852d-751ac8ea2c97-kube-api-access-8r6tp" (OuterVolumeSpecName: "kube-api-access-8r6tp") pod "47627929-84fc-431c-852d-751ac8ea2c97" (UID: "47627929-84fc-431c-852d-751ac8ea2c97"). InnerVolumeSpecName "kube-api-access-8r6tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:09.022174 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.022147    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-util" (OuterVolumeSpecName: "util") pod "9a9ae65d-5862-4444-8bba-6e2a0a0e3452" (UID: "9a9ae65d-5862-4444-8bba-6e2a0a0e3452"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:09.023276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.023253    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-util" (OuterVolumeSpecName: "util") pod "47627929-84fc-431c-852d-751ac8ea2c97" (UID: "47627929-84fc-431c-852d-751ac8ea2c97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:09.117325 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.117276    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:09.117325 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.117323    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:09.117325 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.117335    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r6tp\" (UniqueName: \"kubernetes.io/projected/47627929-84fc-431c-852d-751ac8ea2c97-kube-api-access-8r6tp\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:09.117325 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.117351    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxp9j\" (UniqueName: \"kubernetes.io/projected/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-kube-api-access-wxp9j\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:09.117641 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.117364    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9ae65d-5862-4444-8bba-6e2a0a0e3452-util\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:09.117641 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.117374    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47627929-84fc-431c-852d-751ac8ea2c97-util\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:09.716518 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.716480    2566 generic.go:356] "Generic (PLEG): container finished" podID="d161b094-2d0f-4d2a-8c16-07b40fea2bbb" containerID="64ccf5e44c7c3629d4f26c9807a9156d4de97213b952a9ca22ce6ff180ba7a06" exitCode=0
Sep 08 15:20:09.716957 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.716572    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f" event={"ID":"d161b094-2d0f-4d2a-8c16-07b40fea2bbb","Type":"ContainerDied","Data":"64ccf5e44c7c3629d4f26c9807a9156d4de97213b952a9ca22ce6ff180ba7a06"}
Sep 08 15:20:09.718459 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.718441    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck"
Sep 08 15:20:09.718668 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.718473    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0z79ck" event={"ID":"9a9ae65d-5862-4444-8bba-6e2a0a0e3452","Type":"ContainerDied","Data":"0b1c02801e74bb9e7601ee14e48728440694926eea5acf848c80229ed3aee849"}
Sep 08 15:20:09.718668 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.718526    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b1c02801e74bb9e7601ee14e48728440694926eea5acf848c80229ed3aee849"
Sep 08 15:20:09.720596 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.720575    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk"
Sep 08 15:20:09.720720 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.720598    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb9bddk" event={"ID":"47627929-84fc-431c-852d-751ac8ea2c97","Type":"ContainerDied","Data":"65bf902d8b88b3330f09c20f4468c008ead739041cabafdb3997336976cc7912"}
Sep 08 15:20:09.720720 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.720657    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65bf902d8b88b3330f09c20f4468c008ead739041cabafdb3997336976cc7912"
Sep 08 15:20:09.866588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:09.866560    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:10.024018 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.023922    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-bundle\") pod \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") "
Sep 08 15:20:10.024161 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.024020    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfl96\" (UniqueName: \"kubernetes.io/projected/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-kube-api-access-mfl96\") pod \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") "
Sep 08 15:20:10.024161 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.024060    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-util\") pod \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\" (UID: \"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc\") "
Sep 08 15:20:10.024737 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.024704    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-bundle" (OuterVolumeSpecName: "bundle") pod "c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" (UID: "c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:10.026420 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.026382    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-kube-api-access-mfl96" (OuterVolumeSpecName: "kube-api-access-mfl96") pod "c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" (UID: "c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc"). InnerVolumeSpecName "kube-api-access-mfl96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:10.029560 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.029532    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-util" (OuterVolumeSpecName: "util") pod "c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" (UID: "c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:10.125469 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.125432    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-util\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:10.125469 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.125462    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:10.125469 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.125471    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfl96\" (UniqueName: \"kubernetes.io/projected/c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc-kube-api-access-mfl96\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:10.729166 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.729132    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq"
Sep 08 15:20:10.729536 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.729159    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lbcwq" event={"ID":"c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc","Type":"ContainerDied","Data":"f5a4855b46259a8949a0f8cf4b67dd30c23e7a28b8e34d4260e5fcb26c9c7b87"}
Sep 08 15:20:10.729536 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.729215    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5a4855b46259a8949a0f8cf4b67dd30c23e7a28b8e34d4260e5fcb26c9c7b87"
Sep 08 15:20:10.859027 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.858998    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:10.931741 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.931698    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-util\") pod \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") "
Sep 08 15:20:10.931894 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.931761    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bh9v\" (UniqueName: \"kubernetes.io/projected/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-kube-api-access-7bh9v\") pod \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") "
Sep 08 15:20:10.931894 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.931794    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-bundle\") pod \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\" (UID: \"d161b094-2d0f-4d2a-8c16-07b40fea2bbb\") "
Sep 08 15:20:10.932318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.932293    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-bundle" (OuterVolumeSpecName: "bundle") pod "d161b094-2d0f-4d2a-8c16-07b40fea2bbb" (UID: "d161b094-2d0f-4d2a-8c16-07b40fea2bbb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:10.934188 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.934161    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-kube-api-access-7bh9v" (OuterVolumeSpecName: "kube-api-access-7bh9v") pod "d161b094-2d0f-4d2a-8c16-07b40fea2bbb" (UID: "d161b094-2d0f-4d2a-8c16-07b40fea2bbb"). InnerVolumeSpecName "kube-api-access-7bh9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:10.937321 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:10.937292    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-util" (OuterVolumeSpecName: "util") pod "d161b094-2d0f-4d2a-8c16-07b40fea2bbb" (UID: "d161b094-2d0f-4d2a-8c16-07b40fea2bbb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:11.033330 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:11.033239    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-util\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:11.033330 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:11.033270    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bh9v\" (UniqueName: \"kubernetes.io/projected/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-kube-api-access-7bh9v\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:11.033330 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:11.033281    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d161b094-2d0f-4d2a-8c16-07b40fea2bbb-bundle\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:11.737169 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:11.737140    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f"
Sep 08 15:20:11.737169 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:11.737154    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183csxx9f" event={"ID":"d161b094-2d0f-4d2a-8c16-07b40fea2bbb","Type":"ContainerDied","Data":"026513df3bffb5527fd1c2d643b32db3aff3bff48fa8b8875233faad595122a3"}
Sep 08 15:20:11.737713 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:11.737195    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="026513df3bffb5527fd1c2d643b32db3aff3bff48fa8b8875233faad595122a3"
Sep 08 15:20:18.020712 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.020669    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds"]
Sep 08 15:20:18.021204 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021174    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9ae65d-5862-4444-8bba-6e2a0a0e3452" containerName="pull"
Sep 08 15:20:18.021204 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021194    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9ae65d-5862-4444-8bba-6e2a0a0e3452" containerName="pull"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021205    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47627929-84fc-431c-852d-751ac8ea2c97" containerName="pull"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021214    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="47627929-84fc-431c-852d-751ac8ea2c97" containerName="pull"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021223    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" containerName="pull"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021231    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" containerName="pull"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021243    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" containerName="util"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021250    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" containerName="util"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021269    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47627929-84fc-431c-852d-751ac8ea2c97" containerName="util"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021277    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="47627929-84fc-431c-852d-751ac8ea2c97" containerName="util"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021289    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9ae65d-5862-4444-8bba-6e2a0a0e3452" containerName="util"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021298    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9ae65d-5862-4444-8bba-6e2a0a0e3452" containerName="util"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021308    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d161b094-2d0f-4d2a-8c16-07b40fea2bbb" containerName="pull"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021316    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d161b094-2d0f-4d2a-8c16-07b40fea2bbb" containerName="pull"
Sep 08 15:20:18.021326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021331    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47627929-84fc-431c-852d-751ac8ea2c97" containerName="extract"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021339    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="47627929-84fc-431c-852d-751ac8ea2c97" containerName="extract"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021350    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" containerName="extract"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021358    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" containerName="extract"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021368    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d161b094-2d0f-4d2a-8c16-07b40fea2bbb" containerName="extract"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021377    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d161b094-2d0f-4d2a-8c16-07b40fea2bbb" containerName="extract"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021385    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d161b094-2d0f-4d2a-8c16-07b40fea2bbb" containerName="util"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021392    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d161b094-2d0f-4d2a-8c16-07b40fea2bbb" containerName="util"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021400    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9ae65d-5862-4444-8bba-6e2a0a0e3452" containerName="extract"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021408    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9ae65d-5862-4444-8bba-6e2a0a0e3452" containerName="extract"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021498    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="47627929-84fc-431c-852d-751ac8ea2c97" containerName="extract"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021512    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9ae65d-5862-4444-8bba-6e2a0a0e3452" containerName="extract"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021521    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d161b094-2d0f-4d2a-8c16-07b40fea2bbb" containerName="extract"
Sep 08 15:20:18.021980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.021530    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c727a41f-ae3c-499c-a0e1-b5bdd5e7aedc" containerName="extract"
Sep 08 15:20:18.026042 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.026019    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds"
Sep 08 15:20:18.029139 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.029115    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9swjr\""
Sep 08 15:20:18.029139 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.029144    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 08 15:20:18.030184 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.030161    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 15:20:18.030308 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.030164    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 15:20:18.037283 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.037257    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds"]
Sep 08 15:20:18.199548 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.199506    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpw2f\" (UniqueName: \"kubernetes.io/projected/475e98a1-3ac3-4d42-b27f-fde2eba59d0a-kube-api-access-rpw2f\") pod \"dns-operator-controller-manager-5985564776-xn5ds\" (UID: \"475e98a1-3ac3-4d42-b27f-fde2eba59d0a\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds"
Sep 08 15:20:18.300103 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.299994    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpw2f\" (UniqueName: \"kubernetes.io/projected/475e98a1-3ac3-4d42-b27f-fde2eba59d0a-kube-api-access-rpw2f\") pod \"dns-operator-controller-manager-5985564776-xn5ds\" (UID: \"475e98a1-3ac3-4d42-b27f-fde2eba59d0a\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds"
Sep 08 15:20:18.313148 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.313114    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpw2f\" (UniqueName: \"kubernetes.io/projected/475e98a1-3ac3-4d42-b27f-fde2eba59d0a-kube-api-access-rpw2f\") pod \"dns-operator-controller-manager-5985564776-xn5ds\" (UID: \"475e98a1-3ac3-4d42-b27f-fde2eba59d0a\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds"
Sep 08 15:20:18.336915 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.336881    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds"
Sep 08 15:20:18.617291 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.617265    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds"]
Sep 08 15:20:18.619711 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:18.619556    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475e98a1_3ac3_4d42_b27f_fde2eba59d0a.slice/crio-75211cd318fae7eff81df9aac35fb718acc1f6abe1e6501044cb1e2507de155c WatchSource:0}: Error finding container 75211cd318fae7eff81df9aac35fb718acc1f6abe1e6501044cb1e2507de155c: Status 404 returned error can't find the container with id 75211cd318fae7eff81df9aac35fb718acc1f6abe1e6501044cb1e2507de155c
Sep 08 15:20:18.776641 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:18.776582    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds" event={"ID":"475e98a1-3ac3-4d42-b27f-fde2eba59d0a","Type":"ContainerStarted","Data":"75211cd318fae7eff81df9aac35fb718acc1f6abe1e6501044cb1e2507de155c"}
Sep 08 15:20:19.973229 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:19.973190    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"]
Sep 08 15:20:19.980601 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:19.980571    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:19.983500 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:19.983473    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sfskl\""
Sep 08 15:20:19.989608 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:19.989017    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"]
Sep 08 15:20:20.116866 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:20.116815    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6dqp\" (UniqueName: \"kubernetes.io/projected/eec2e405-30f0-4d6f-9650-43062b7d5022-kube-api-access-l6dqp\") pod \"limitador-operator-controller-manager-6c549b6d85-fzzwb\" (UID: \"eec2e405-30f0-4d6f-9650-43062b7d5022\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:20.218093 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:20.218055    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6dqp\" (UniqueName: \"kubernetes.io/projected/eec2e405-30f0-4d6f-9650-43062b7d5022-kube-api-access-l6dqp\") pod \"limitador-operator-controller-manager-6c549b6d85-fzzwb\" (UID: \"eec2e405-30f0-4d6f-9650-43062b7d5022\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:20.237686 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:20.237577    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6dqp\" (UniqueName: \"kubernetes.io/projected/eec2e405-30f0-4d6f-9650-43062b7d5022-kube-api-access-l6dqp\") pod \"limitador-operator-controller-manager-6c549b6d85-fzzwb\" (UID: \"eec2e405-30f0-4d6f-9650-43062b7d5022\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:20.296411 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:20.296370    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:21.167594 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:21.167568    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"]
Sep 08 15:20:21.169416 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:21.169388    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec2e405_30f0_4d6f_9650_43062b7d5022.slice/crio-65a391d68ce41449d4bd10c720104d1e781fe22c07a3ae12d2ccb4eb875b868a WatchSource:0}: Error finding container 65a391d68ce41449d4bd10c720104d1e781fe22c07a3ae12d2ccb4eb875b868a: Status 404 returned error can't find the container with id 65a391d68ce41449d4bd10c720104d1e781fe22c07a3ae12d2ccb4eb875b868a
Sep 08 15:20:21.800633 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:21.800580    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb" event={"ID":"eec2e405-30f0-4d6f-9650-43062b7d5022","Type":"ContainerStarted","Data":"65a391d68ce41449d4bd10c720104d1e781fe22c07a3ae12d2ccb4eb875b868a"}
Sep 08 15:20:21.802732 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:21.802693    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds" event={"ID":"475e98a1-3ac3-4d42-b27f-fde2eba59d0a","Type":"ContainerStarted","Data":"e1c024500babcfc85107f6d645849ba18bd2095364dd25e205460e2c9143cbbc"}
Sep 08 15:20:21.802894 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:21.802837    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds"
Sep 08 15:20:21.829060 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:21.828988    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds" podStartSLOduration=2.487782839 podStartE2EDuration="4.828965169s" totalImagesPullingTime="2.34118233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:21.827555411 +0000 UTC m=+682.399101455" watchObservedRunningTime="2026-09-08 15:20:21.828965169 +0000 UTC m=+682.400511212"
Sep 08 15:20:22.809749 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:22.809649    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb" event={"ID":"eec2e405-30f0-4d6f-9650-43062b7d5022","Type":"ContainerStarted","Data":"028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd"}
Sep 08 15:20:22.810127 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:22.809837    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:22.856470 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:22.856413    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb" podStartSLOduration=2.648601943 podStartE2EDuration="3.856387944s" totalImagesPullingTime="1.207786001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:22.853385431 +0000 UTC m=+683.424931472" watchObservedRunningTime="2026-09-08 15:20:22.856387944 +0000 UTC m=+683.427933985"
Sep 08 15:20:24.518127 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:24.518081    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"]
Sep 08 15:20:24.521420 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:24.521396    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:24.524155 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:24.524133    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4g7sh\""
Sep 08 15:20:24.534857 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:24.534827    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"]
Sep 08 15:20:24.559547 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:24.559508    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrdnc\" (UniqueName: \"kubernetes.io/projected/47453791-df11-4efe-9a15-8cd9d54d31f8-kube-api-access-mrdnc\") pod \"kuadrant-operator-controller-manager-58fc56757c-5x52g\" (UID: \"47453791-df11-4efe-9a15-8cd9d54d31f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:24.559793 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:24.559556    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47453791-df11-4efe-9a15-8cd9d54d31f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-5x52g\" (UID: \"47453791-df11-4efe-9a15-8cd9d54d31f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:24.661058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:24.661017    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrdnc\" (UniqueName: \"kubernetes.io/projected/47453791-df11-4efe-9a15-8cd9d54d31f8-kube-api-access-mrdnc\") pod \"kuadrant-operator-controller-manager-58fc56757c-5x52g\" (UID: \"47453791-df11-4efe-9a15-8cd9d54d31f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:24.661058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:24.661058    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47453791-df11-4efe-9a15-8cd9d54d31f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-5x52g\" (UID: \"47453791-df11-4efe-9a15-8cd9d54d31f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:24.661414 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:24.661398    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47453791-df11-4efe-9a15-8cd9d54d31f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-5x52g\" (UID: \"47453791-df11-4efe-9a15-8cd9d54d31f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:24.670498 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:24.670472    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrdnc\" (UniqueName: \"kubernetes.io/projected/47453791-df11-4efe-9a15-8cd9d54d31f8-kube-api-access-mrdnc\") pod \"kuadrant-operator-controller-manager-58fc56757c-5x52g\" (UID: \"47453791-df11-4efe-9a15-8cd9d54d31f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:24.832066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:24.832032    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:25.117754 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:25.117667    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"]
Sep 08 15:20:25.121883 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:25.121841    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47453791_df11_4efe_9a15_8cd9d54d31f8.slice/crio-18671ca9487d4973d2e01d7c2abf753f14eac99666559cbdcc2dade7bf7b3bcd WatchSource:0}: Error finding container 18671ca9487d4973d2e01d7c2abf753f14eac99666559cbdcc2dade7bf7b3bcd: Status 404 returned error can't find the container with id 18671ca9487d4973d2e01d7c2abf753f14eac99666559cbdcc2dade7bf7b3bcd
Sep 08 15:20:25.826903 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:25.826867    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g" event={"ID":"47453791-df11-4efe-9a15-8cd9d54d31f8","Type":"ContainerStarted","Data":"18671ca9487d4973d2e01d7c2abf753f14eac99666559cbdcc2dade7bf7b3bcd"}
Sep 08 15:20:27.020531 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:27.020498    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-l9sgm"]
Sep 08 15:20:27.024122 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:27.024097    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-l9sgm"
Sep 08 15:20:27.027490 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:27.027427    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dskkh\""
Sep 08 15:20:27.034415 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:27.034353    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-l9sgm"]
Sep 08 15:20:27.083123 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:27.083083    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjbdm\" (UniqueName: \"kubernetes.io/projected/e5a11ab6-c0a4-4b4b-9518-d4a18ef1a6e5-kube-api-access-mjbdm\") pod \"authorino-operator-68d88948d8-l9sgm\" (UID: \"e5a11ab6-c0a4-4b4b-9518-d4a18ef1a6e5\") " pod="kuadrant-system/authorino-operator-68d88948d8-l9sgm"
Sep 08 15:20:27.184092 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:27.184026    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjbdm\" (UniqueName: \"kubernetes.io/projected/e5a11ab6-c0a4-4b4b-9518-d4a18ef1a6e5-kube-api-access-mjbdm\") pod \"authorino-operator-68d88948d8-l9sgm\" (UID: \"e5a11ab6-c0a4-4b4b-9518-d4a18ef1a6e5\") " pod="kuadrant-system/authorino-operator-68d88948d8-l9sgm"
Sep 08 15:20:27.193536 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:27.193499    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjbdm\" (UniqueName: \"kubernetes.io/projected/e5a11ab6-c0a4-4b4b-9518-d4a18ef1a6e5-kube-api-access-mjbdm\") pod \"authorino-operator-68d88948d8-l9sgm\" (UID: \"e5a11ab6-c0a4-4b4b-9518-d4a18ef1a6e5\") " pod="kuadrant-system/authorino-operator-68d88948d8-l9sgm"
Sep 08 15:20:27.340417 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:27.340384    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-l9sgm"
Sep 08 15:20:27.631983 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:27.631957    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-l9sgm"]
Sep 08 15:20:27.634766 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:27.634729    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a11ab6_c0a4_4b4b_9518_d4a18ef1a6e5.slice/crio-534a0eb9819649524e70860449f67fd0f0fd59a093dff6df4ddcd7d50072cd12 WatchSource:0}: Error finding container 534a0eb9819649524e70860449f67fd0f0fd59a093dff6df4ddcd7d50072cd12: Status 404 returned error can't find the container with id 534a0eb9819649524e70860449f67fd0f0fd59a093dff6df4ddcd7d50072cd12
Sep 08 15:20:27.842004 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:27.841966    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-l9sgm" event={"ID":"e5a11ab6-c0a4-4b4b-9518-d4a18ef1a6e5","Type":"ContainerStarted","Data":"534a0eb9819649524e70860449f67fd0f0fd59a093dff6df4ddcd7d50072cd12"}
Sep 08 15:20:29.857102 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:29.857056    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g" event={"ID":"47453791-df11-4efe-9a15-8cd9d54d31f8","Type":"ContainerStarted","Data":"6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b"}
Sep 08 15:20:29.857516 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:29.857168    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:29.883332 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:29.883262    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g" podStartSLOduration=1.294501336 podStartE2EDuration="5.883241296s" totalImagesPullingTime="4.58873996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:29.879153259 +0000 UTC m=+690.450699303" watchObservedRunningTime="2026-09-08 15:20:29.883241296 +0000 UTC m=+690.454787340"
Sep 08 15:20:30.865024 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:30.864978    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-l9sgm" event={"ID":"e5a11ab6-c0a4-4b4b-9518-d4a18ef1a6e5","Type":"ContainerStarted","Data":"0526a3107881566cc31df2570b4a16c4244de55dce63f8f5b409ba99ba4baf97"}
Sep 08 15:20:30.865464 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:30.865268    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-l9sgm"
Sep 08 15:20:30.887985 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:30.887929    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-l9sgm" podStartSLOduration=2.160515518 podStartE2EDuration="4.88791204s" totalImagesPullingTime="2.727396522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:30.884708692 +0000 UTC m=+691.456254736" watchObservedRunningTime="2026-09-08 15:20:30.88791204 +0000 UTC m=+691.459458082"
Sep 08 15:20:32.489853 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.489811    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"]
Sep 08 15:20:32.493339 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.493318    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:32.496334 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.496304    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 08 15:20:32.496691 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.496673    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 08 15:20:32.496691 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.496681    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vjhlc\""
Sep 08 15:20:32.502894 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.502867    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"]
Sep 08 15:20:32.535124 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.535083    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dfc288d2-0faf-41df-be9a-2f935b7ebc06-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-z46t4\" (UID: \"dfc288d2-0faf-41df-be9a-2f935b7ebc06\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:32.535322 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.535151    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dfc288d2-0faf-41df-be9a-2f935b7ebc06-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-z46t4\" (UID: \"dfc288d2-0faf-41df-be9a-2f935b7ebc06\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:32.535322 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.535201    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h2f9\" (UniqueName: \"kubernetes.io/projected/dfc288d2-0faf-41df-be9a-2f935b7ebc06-kube-api-access-2h2f9\") pod \"kuadrant-console-plugin-598f86468b-z46t4\" (UID: \"dfc288d2-0faf-41df-be9a-2f935b7ebc06\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:32.636593 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.636556    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dfc288d2-0faf-41df-be9a-2f935b7ebc06-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-z46t4\" (UID: \"dfc288d2-0faf-41df-be9a-2f935b7ebc06\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:32.636810 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.636605    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dfc288d2-0faf-41df-be9a-2f935b7ebc06-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-z46t4\" (UID: \"dfc288d2-0faf-41df-be9a-2f935b7ebc06\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:32.636810 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.636676    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h2f9\" (UniqueName: \"kubernetes.io/projected/dfc288d2-0faf-41df-be9a-2f935b7ebc06-kube-api-access-2h2f9\") pod \"kuadrant-console-plugin-598f86468b-z46t4\" (UID: \"dfc288d2-0faf-41df-be9a-2f935b7ebc06\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:32.636889 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:32.636811    2566 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 08 15:20:32.636889 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:32.636883    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfc288d2-0faf-41df-be9a-2f935b7ebc06-plugin-serving-cert podName:dfc288d2-0faf-41df-be9a-2f935b7ebc06 nodeName:}" failed. No retries permitted until 2026-09-08 15:20:33.136864136 +0000 UTC m=+693.708410156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/dfc288d2-0faf-41df-be9a-2f935b7ebc06-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-z46t4" (UID: "dfc288d2-0faf-41df-be9a-2f935b7ebc06") : secret "plugin-serving-cert" not found
Sep 08 15:20:32.637304 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.637273    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dfc288d2-0faf-41df-be9a-2f935b7ebc06-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-z46t4\" (UID: \"dfc288d2-0faf-41df-be9a-2f935b7ebc06\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:32.652067 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.652035    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h2f9\" (UniqueName: \"kubernetes.io/projected/dfc288d2-0faf-41df-be9a-2f935b7ebc06-kube-api-access-2h2f9\") pod \"kuadrant-console-plugin-598f86468b-z46t4\" (UID: \"dfc288d2-0faf-41df-be9a-2f935b7ebc06\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:32.812744 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:32.812662    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xn5ds"
Sep 08 15:20:33.141250 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:33.141197    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dfc288d2-0faf-41df-be9a-2f935b7ebc06-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-z46t4\" (UID: \"dfc288d2-0faf-41df-be9a-2f935b7ebc06\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:33.143912 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:33.143890    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dfc288d2-0faf-41df-be9a-2f935b7ebc06-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-z46t4\" (UID: \"dfc288d2-0faf-41df-be9a-2f935b7ebc06\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:33.404269 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:33.404174    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"
Sep 08 15:20:33.683417 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:33.683386    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4"]
Sep 08 15:20:33.685007 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:33.684976    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfc288d2_0faf_41df_be9a_2f935b7ebc06.slice/crio-fa934d1f39e8671545b2eb85cbdd0636391f8678a44c486b25c034eeda072ffa WatchSource:0}: Error finding container fa934d1f39e8671545b2eb85cbdd0636391f8678a44c486b25c034eeda072ffa: Status 404 returned error can't find the container with id fa934d1f39e8671545b2eb85cbdd0636391f8678a44c486b25c034eeda072ffa
Sep 08 15:20:33.817284 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:33.817251    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:33.884574 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:33.884543    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4" event={"ID":"dfc288d2-0faf-41df-be9a-2f935b7ebc06","Type":"ContainerStarted","Data":"fa934d1f39e8671545b2eb85cbdd0636391f8678a44c486b25c034eeda072ffa"}
Sep 08 15:20:38.917803 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:38.917766    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4" event={"ID":"dfc288d2-0faf-41df-be9a-2f935b7ebc06","Type":"ContainerStarted","Data":"56d0f08ca9a7aa1d55e0b0d3b6a84f80ebf5a00fc134e9e60f22851d02f3a2d1"}
Sep 08 15:20:38.934905 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:38.934853    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-z46t4" podStartSLOduration=2.469636008 podStartE2EDuration="6.934835615s" totalImagesPullingTime="4.465199607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:38.932747961 +0000 UTC m=+699.504294003" watchObservedRunningTime="2026-09-08 15:20:38.934835615 +0000 UTC m=+699.506381657"
Sep 08 15:20:40.867777 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:40.867744    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:41.873643 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:41.873593    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-l9sgm"
Sep 08 15:20:42.498578 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:42.498538    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"]
Sep 08 15:20:42.502314 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:42.502296    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:42.558482 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:42.558448    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"]
Sep 08 15:20:42.627389 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:42.627356    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njkd5\" (UniqueName: \"kubernetes.io/projected/dfe176f4-d7aa-46a8-8505-9562e405b21c-kube-api-access-njkd5\") pod \"kuadrant-operator-controller-manager-6bd956ccf-9chw5\" (UID: \"dfe176f4-d7aa-46a8-8505-9562e405b21c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:42.627590 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:42.627416    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfe176f4-d7aa-46a8-8505-9562e405b21c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-9chw5\" (UID: \"dfe176f4-d7aa-46a8-8505-9562e405b21c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:42.728501 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:42.728469    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njkd5\" (UniqueName: \"kubernetes.io/projected/dfe176f4-d7aa-46a8-8505-9562e405b21c-kube-api-access-njkd5\") pod \"kuadrant-operator-controller-manager-6bd956ccf-9chw5\" (UID: \"dfe176f4-d7aa-46a8-8505-9562e405b21c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:42.728714 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:42.728528    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfe176f4-d7aa-46a8-8505-9562e405b21c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-9chw5\" (UID: \"dfe176f4-d7aa-46a8-8505-9562e405b21c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:42.728906 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:42.728889    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfe176f4-d7aa-46a8-8505-9562e405b21c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-9chw5\" (UID: \"dfe176f4-d7aa-46a8-8505-9562e405b21c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:42.744371 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:42.744337    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njkd5\" (UniqueName: \"kubernetes.io/projected/dfe176f4-d7aa-46a8-8505-9562e405b21c-kube-api-access-njkd5\") pod \"kuadrant-operator-controller-manager-6bd956ccf-9chw5\" (UID: \"dfe176f4-d7aa-46a8-8505-9562e405b21c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:42.811923 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:42.811839    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:43.092936 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.092900    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"]
Sep 08 15:20:43.096450 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:43.096424    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe176f4_d7aa_46a8_8505_9562e405b21c.slice/crio-3360ef6f4ae73b1d9b05b56d337720800dec52a4c6bc66c71c661baf9faa7ef6 WatchSource:0}: Error finding container 3360ef6f4ae73b1d9b05b56d337720800dec52a4c6bc66c71c661baf9faa7ef6: Status 404 returned error can't find the container with id 3360ef6f4ae73b1d9b05b56d337720800dec52a4c6bc66c71c661baf9faa7ef6
Sep 08 15:20:43.247994 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.247956    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"]
Sep 08 15:20:43.248190 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.248129    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g" podUID="47453791-df11-4efe-9a15-8cd9d54d31f8" containerName="manager" containerID="cri-o://6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b" gracePeriod=2
Sep 08 15:20:43.254199 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.254131    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"]
Sep 08 15:20:43.266816 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.266780    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"]
Sep 08 15:20:43.281581 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.281545    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"]
Sep 08 15:20:43.282241 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.282214    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47453791-df11-4efe-9a15-8cd9d54d31f8" containerName="manager"
Sep 08 15:20:43.282241 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.282243    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="47453791-df11-4efe-9a15-8cd9d54d31f8" containerName="manager"
Sep 08 15:20:43.282406 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.282341    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="47453791-df11-4efe-9a15-8cd9d54d31f8" containerName="manager"
Sep 08 15:20:43.286532 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.286331    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:43.286940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.286917    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"]
Sep 08 15:20:43.290762 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.290518    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-5x52g\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="47453791-df11-4efe-9a15-8cd9d54d31f8" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:43.293832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.293803    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"]
Sep 08 15:20:43.294190 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.294175    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe176f4-d7aa-46a8-8505-9562e405b21c" containerName="manager"
Sep 08 15:20:43.294190 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.294189    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe176f4-d7aa-46a8-8505-9562e405b21c" containerName="manager"
Sep 08 15:20:43.294324 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.294251    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe176f4-d7aa-46a8-8505-9562e405b21c" containerName="manager"
Sep 08 15:20:43.298434 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.298410    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:20:43.299659 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.299635    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"]
Sep 08 15:20:43.304360 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.304332    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"]
Sep 08 15:20:43.304603 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.304580    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb" podUID="eec2e405-30f0-4d6f-9650-43062b7d5022" containerName="manager" containerID="cri-o://028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd" gracePeriod=2
Sep 08 15:20:43.322742 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.322705    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"]
Sep 08 15:20:43.330083 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.330012    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-fzzwb\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="eec2e405-30f0-4d6f-9650-43062b7d5022" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:43.331850 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.331758    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"]
Sep 08 15:20:43.332151 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.332121    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-5x52g\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="47453791-df11-4efe-9a15-8cd9d54d31f8" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:43.332295 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.332162    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f58e5ea6-37cb-4242-8057-0bd0c1be236c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-x9dhk\" (UID: \"f58e5ea6-37cb-4242-8057-0bd0c1be236c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:43.332295 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.332216    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jkvl\" (UniqueName: \"kubernetes.io/projected/f58e5ea6-37cb-4242-8057-0bd0c1be236c-kube-api-access-8jkvl\") pod \"kuadrant-operator-controller-manager-58fc56757c-x9dhk\" (UID: \"f58e5ea6-37cb-4242-8057-0bd0c1be236c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:43.337531 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.337500    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv"]
Sep 08 15:20:43.337930 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.337911    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec2e405-30f0-4d6f-9650-43062b7d5022" containerName="manager"
Sep 08 15:20:43.337930 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.337931    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec2e405-30f0-4d6f-9650-43062b7d5022" containerName="manager"
Sep 08 15:20:43.338065 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.338018    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec2e405-30f0-4d6f-9650-43062b7d5022" containerName="manager"
Sep 08 15:20:43.341185 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.341166    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv"
Sep 08 15:20:43.346164 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.346082    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv"]
Sep 08 15:20:43.366789 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.366747    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-fzzwb\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="eec2e405-30f0-4d6f-9650-43062b7d5022" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:43.370250 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.370218    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-5x52g\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="47453791-df11-4efe-9a15-8cd9d54d31f8" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:43.432896 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.432857    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-4s4fj\" (UID: \"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:20:43.432896 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.432900    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrv6n\" (UniqueName: \"kubernetes.io/projected/5fb78bc4-ff01-4644-91bf-8b66b91f6c57-kube-api-access-qrv6n\") pod \"limitador-operator-controller-manager-6c549b6d85-dwkkv\" (UID: \"5fb78bc4-ff01-4644-91bf-8b66b91f6c57\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv"
Sep 08 15:20:43.433156 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.432918    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjp52\" (UniqueName: \"kubernetes.io/projected/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-kube-api-access-zjp52\") pod \"kuadrant-operator-controller-manager-6bd956ccf-4s4fj\" (UID: \"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:20:43.433156 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.433000    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f58e5ea6-37cb-4242-8057-0bd0c1be236c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-x9dhk\" (UID: \"f58e5ea6-37cb-4242-8057-0bd0c1be236c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:43.433156 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.433068    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jkvl\" (UniqueName: \"kubernetes.io/projected/f58e5ea6-37cb-4242-8057-0bd0c1be236c-kube-api-access-8jkvl\") pod \"kuadrant-operator-controller-manager-58fc56757c-x9dhk\" (UID: \"f58e5ea6-37cb-4242-8057-0bd0c1be236c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:43.433365 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.433343    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f58e5ea6-37cb-4242-8057-0bd0c1be236c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-x9dhk\" (UID: \"f58e5ea6-37cb-4242-8057-0bd0c1be236c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:43.443260 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.443217    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jkvl\" (UniqueName: \"kubernetes.io/projected/f58e5ea6-37cb-4242-8057-0bd0c1be236c-kube-api-access-8jkvl\") pod \"kuadrant-operator-controller-manager-58fc56757c-x9dhk\" (UID: \"f58e5ea6-37cb-4242-8057-0bd0c1be236c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:43.533970 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.533939    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-4s4fj\" (UID: \"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:20:43.533970 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.533973    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrv6n\" (UniqueName: \"kubernetes.io/projected/5fb78bc4-ff01-4644-91bf-8b66b91f6c57-kube-api-access-qrv6n\") pod \"limitador-operator-controller-manager-6c549b6d85-dwkkv\" (UID: \"5fb78bc4-ff01-4644-91bf-8b66b91f6c57\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv"
Sep 08 15:20:43.534193 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.533992    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjp52\" (UniqueName: \"kubernetes.io/projected/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-kube-api-access-zjp52\") pod \"kuadrant-operator-controller-manager-6bd956ccf-4s4fj\" (UID: \"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:20:43.534319 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.534298    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-4s4fj\" (UID: \"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:20:43.535144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.535123    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:43.537701 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.537673    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-fzzwb\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="eec2e405-30f0-4d6f-9650-43062b7d5022" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:43.539987 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.539952    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-5x52g\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="47453791-df11-4efe-9a15-8cd9d54d31f8" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:43.543112 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.543096    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:43.545509 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.545488    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-fzzwb\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="eec2e405-30f0-4d6f-9650-43062b7d5022" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:43.547727 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.547697    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-5x52g\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="47453791-df11-4efe-9a15-8cd9d54d31f8" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:43.549477 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.549457    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrv6n\" (UniqueName: \"kubernetes.io/projected/5fb78bc4-ff01-4644-91bf-8b66b91f6c57-kube-api-access-qrv6n\") pod \"limitador-operator-controller-manager-6c549b6d85-dwkkv\" (UID: \"5fb78bc4-ff01-4644-91bf-8b66b91f6c57\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv"
Sep 08 15:20:43.549809 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.549793    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjp52\" (UniqueName: \"kubernetes.io/projected/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-kube-api-access-zjp52\") pod \"kuadrant-operator-controller-manager-6bd956ccf-4s4fj\" (UID: \"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:20:43.634783 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.634692    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47453791-df11-4efe-9a15-8cd9d54d31f8-extensions-socket-volume\") pod \"47453791-df11-4efe-9a15-8cd9d54d31f8\" (UID: \"47453791-df11-4efe-9a15-8cd9d54d31f8\") "
Sep 08 15:20:43.634783 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.634746    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6dqp\" (UniqueName: \"kubernetes.io/projected/eec2e405-30f0-4d6f-9650-43062b7d5022-kube-api-access-l6dqp\") pod \"eec2e405-30f0-4d6f-9650-43062b7d5022\" (UID: \"eec2e405-30f0-4d6f-9650-43062b7d5022\") "
Sep 08 15:20:43.634978 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.634847    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrdnc\" (UniqueName: \"kubernetes.io/projected/47453791-df11-4efe-9a15-8cd9d54d31f8-kube-api-access-mrdnc\") pod \"47453791-df11-4efe-9a15-8cd9d54d31f8\" (UID: \"47453791-df11-4efe-9a15-8cd9d54d31f8\") "
Sep 08 15:20:43.635292 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.635260    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47453791-df11-4efe-9a15-8cd9d54d31f8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "47453791-df11-4efe-9a15-8cd9d54d31f8" (UID: "47453791-df11-4efe-9a15-8cd9d54d31f8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:43.637140 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.637115    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47453791-df11-4efe-9a15-8cd9d54d31f8-kube-api-access-mrdnc" (OuterVolumeSpecName: "kube-api-access-mrdnc") pod "47453791-df11-4efe-9a15-8cd9d54d31f8" (UID: "47453791-df11-4efe-9a15-8cd9d54d31f8"). InnerVolumeSpecName "kube-api-access-mrdnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:43.637234 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.637162    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec2e405-30f0-4d6f-9650-43062b7d5022-kube-api-access-l6dqp" (OuterVolumeSpecName: "kube-api-access-l6dqp") pod "eec2e405-30f0-4d6f-9650-43062b7d5022" (UID: "eec2e405-30f0-4d6f-9650-43062b7d5022"). InnerVolumeSpecName "kube-api-access-l6dqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:43.674058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.674025    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:43.682092 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.682062    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:20:43.688806 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.688770    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv"
Sep 08 15:20:43.736602 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.736461    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrdnc\" (UniqueName: \"kubernetes.io/projected/47453791-df11-4efe-9a15-8cd9d54d31f8-kube-api-access-mrdnc\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:43.736602 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.736498    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47453791-df11-4efe-9a15-8cd9d54d31f8-extensions-socket-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:43.736602 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.736517    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6dqp\" (UniqueName: \"kubernetes.io/projected/eec2e405-30f0-4d6f-9650-43062b7d5022-kube-api-access-l6dqp\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:43.914952 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.914870    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47453791-df11-4efe-9a15-8cd9d54d31f8" path="/var/lib/kubelet/pods/47453791-df11-4efe-9a15-8cd9d54d31f8/volumes"
Sep 08 15:20:43.915240 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.915226    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eec2e405-30f0-4d6f-9650-43062b7d5022" path="/var/lib/kubelet/pods/eec2e405-30f0-4d6f-9650-43062b7d5022/volumes"
Sep 08 15:20:43.948863 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.948835    2566 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5" container="manager"
Sep 08 15:20:43.950182 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.950154    2566 generic.go:356] "Generic (PLEG): container finished" podID="eec2e405-30f0-4d6f-9650-43062b7d5022" containerID="028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd" exitCode=0
Sep 08 15:20:43.950334 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.950197    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fzzwb"
Sep 08 15:20:43.950334 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.950222    2566 scope.go:117] "RemoveContainer" containerID="028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd"
Sep 08 15:20:43.952246 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.951963    2566 generic.go:356] "Generic (PLEG): container finished" podID="47453791-df11-4efe-9a15-8cd9d54d31f8" containerID="6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b" exitCode=0
Sep 08 15:20:43.952246 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.952003    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5x52g"
Sep 08 15:20:43.960441 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.960421    2566 scope.go:117] "RemoveContainer" containerID="028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd"
Sep 08 15:20:43.961012 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.960982    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd\": container with ID starting with 028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd not found: ID does not exist" containerID="028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd"
Sep 08 15:20:43.961127 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.961026    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd"} err="failed to get container status \"028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd\": rpc error: code = NotFound desc = could not find container \"028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd\": container with ID starting with 028807993e0c4003d876ed59c6c97ccab7990c136dabdec3a09dd4f26d7e8cdd not found: ID does not exist"
Sep 08 15:20:43.961127 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.961074    2566 scope.go:117] "RemoveContainer" containerID="6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b"
Sep 08 15:20:43.966351 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.966327    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"]
Sep 08 15:20:43.972905 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.972881    2566 scope.go:117] "RemoveContainer" containerID="6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b"
Sep 08 15:20:43.973295 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.973218    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"]
Sep 08 15:20:43.973361 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:43.973277    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b\": container with ID starting with 6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b not found: ID does not exist" containerID="6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b"
Sep 08 15:20:43.973361 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.973332    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b"} err="failed to get container status \"6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b\": rpc error: code = NotFound desc = could not find container \"6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b\": container with ID starting with 6055bd424d6640be842666688de6b752287382504875a65758fe019e02583d7b not found: ID does not exist"
Sep 08 15:20:43.976748 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:43.976719    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6eda3b_df5e_4f7f_a733_895bd88ac4ed.slice/crio-742454eca9c5ab1c435bd31639e2e45a132b30124dcb24bb2e6bd658bf07e4d0 WatchSource:0}: Error finding container 742454eca9c5ab1c435bd31639e2e45a132b30124dcb24bb2e6bd658bf07e4d0: Status 404 returned error can't find the container with id 742454eca9c5ab1c435bd31639e2e45a132b30124dcb24bb2e6bd658bf07e4d0
Sep 08 15:20:43.988030 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:43.988004    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv"]
Sep 08 15:20:43.990874 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:43.990843    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb78bc4_ff01_4644_91bf_8b66b91f6c57.slice/crio-0d3249338f3a67f29d378c7406d82b655132286ed59b7cff0ad2f32aee8acca6 WatchSource:0}: Error finding container 0d3249338f3a67f29d378c7406d82b655132286ed59b7cff0ad2f32aee8acca6: Status 404 returned error can't find the container with id 0d3249338f3a67f29d378c7406d82b655132286ed59b7cff0ad2f32aee8acca6
Sep 08 15:20:44.960865 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:44.960828    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv" event={"ID":"5fb78bc4-ff01-4644-91bf-8b66b91f6c57","Type":"ContainerStarted","Data":"830e9b91f0124f6d6f9bdf32f2b6682d32f5109bbba898e593c33172aeb2e8bb"}
Sep 08 15:20:44.961350 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:44.960886    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv" event={"ID":"5fb78bc4-ff01-4644-91bf-8b66b91f6c57","Type":"ContainerStarted","Data":"0d3249338f3a67f29d378c7406d82b655132286ed59b7cff0ad2f32aee8acca6"}
Sep 08 15:20:44.961350 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:44.960941    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv"
Sep 08 15:20:44.962811 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:44.962781    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj" event={"ID":"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed","Type":"ContainerStarted","Data":"207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb"}
Sep 08 15:20:44.962948 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:44.962834    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:20:44.962948 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:44.962856    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj" event={"ID":"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed","Type":"ContainerStarted","Data":"742454eca9c5ab1c435bd31639e2e45a132b30124dcb24bb2e6bd658bf07e4d0"}
Sep 08 15:20:44.965594 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:44.965564    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5" podUID="dfe176f4-d7aa-46a8-8505-9562e405b21c" containerName="manager" containerID="cri-o://a863b879bcbde26640966a9062edc76272056eaadab97796ef2e32901790e477" gracePeriod=2
Sep 08 15:20:44.967417 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:44.967383    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk" event={"ID":"f58e5ea6-37cb-4242-8057-0bd0c1be236c","Type":"ContainerStarted","Data":"52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7"}
Sep 08 15:20:44.967765 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:44.967443    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk" event={"ID":"f58e5ea6-37cb-4242-8057-0bd0c1be236c","Type":"ContainerStarted","Data":"7048bc6a32928adfca2c90d357bc3b96bf3e7af061b73dd9239a85408bf6610e"}
Sep 08 15:20:44.967765 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:44.967496    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:44.993512 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:44.993458    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv" podStartSLOduration=1.993442719 podStartE2EDuration="1.993442719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:44.991332567 +0000 UTC m=+705.562878610" watchObservedRunningTime="2026-09-08 15:20:44.993442719 +0000 UTC m=+705.564988760"
Sep 08 15:20:45.013149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.013094    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj" podStartSLOduration=2.01307673 podStartE2EDuration="2.01307673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:45.011427571 +0000 UTC m=+705.582973614" watchObservedRunningTime="2026-09-08 15:20:45.01307673 +0000 UTC m=+705.584622771"
Sep 08 15:20:45.014765 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:45.014740    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-9chw5\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="dfe176f4-d7aa-46a8-8505-9562e405b21c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:45.050341 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.050279    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk" podStartSLOduration=2.050260475 podStartE2EDuration="2.050260475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:45.048633083 +0000 UTC m=+705.620179116" watchObservedRunningTime="2026-09-08 15:20:45.050260475 +0000 UTC m=+705.621806518"
Sep 08 15:20:45.210235 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.210205    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:45.212947 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:45.212877    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-9chw5\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="dfe176f4-d7aa-46a8-8505-9562e405b21c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:45.351085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.351050    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njkd5\" (UniqueName: \"kubernetes.io/projected/dfe176f4-d7aa-46a8-8505-9562e405b21c-kube-api-access-njkd5\") pod \"dfe176f4-d7aa-46a8-8505-9562e405b21c\" (UID: \"dfe176f4-d7aa-46a8-8505-9562e405b21c\") "
Sep 08 15:20:45.351289 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.351119    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfe176f4-d7aa-46a8-8505-9562e405b21c-extensions-socket-volume\") pod \"dfe176f4-d7aa-46a8-8505-9562e405b21c\" (UID: \"dfe176f4-d7aa-46a8-8505-9562e405b21c\") "
Sep 08 15:20:45.351394 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.351362    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe176f4-d7aa-46a8-8505-9562e405b21c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dfe176f4-d7aa-46a8-8505-9562e405b21c" (UID: "dfe176f4-d7aa-46a8-8505-9562e405b21c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:45.353418 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.353386    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe176f4-d7aa-46a8-8505-9562e405b21c-kube-api-access-njkd5" (OuterVolumeSpecName: "kube-api-access-njkd5") pod "dfe176f4-d7aa-46a8-8505-9562e405b21c" (UID: "dfe176f4-d7aa-46a8-8505-9562e405b21c"). InnerVolumeSpecName "kube-api-access-njkd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:45.451911 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.451871    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njkd5\" (UniqueName: \"kubernetes.io/projected/dfe176f4-d7aa-46a8-8505-9562e405b21c-kube-api-access-njkd5\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:45.451911 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.451906    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfe176f4-d7aa-46a8-8505-9562e405b21c-extensions-socket-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:45.915336 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.915296    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe176f4-d7aa-46a8-8505-9562e405b21c" path="/var/lib/kubelet/pods/dfe176f4-d7aa-46a8-8505-9562e405b21c/volumes"
Sep 08 15:20:45.974732 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.974699    2566 generic.go:356] "Generic (PLEG): container finished" podID="dfe176f4-d7aa-46a8-8505-9562e405b21c" containerID="a863b879bcbde26640966a9062edc76272056eaadab97796ef2e32901790e477" exitCode=2
Sep 08 15:20:45.975198 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.974761    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:45.975198 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.974799    2566 scope.go:117] "RemoveContainer" containerID="a863b879bcbde26640966a9062edc76272056eaadab97796ef2e32901790e477"
Sep 08 15:20:45.983497 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:45.983447    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-9chw5\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="dfe176f4-d7aa-46a8-8505-9562e405b21c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-9chw5"
Sep 08 15:20:45.986837 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.986814    2566 scope.go:117] "RemoveContainer" containerID="a863b879bcbde26640966a9062edc76272056eaadab97796ef2e32901790e477"
Sep 08 15:20:45.987344 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:45.987320    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a863b879bcbde26640966a9062edc76272056eaadab97796ef2e32901790e477\": container with ID starting with a863b879bcbde26640966a9062edc76272056eaadab97796ef2e32901790e477 not found: ID does not exist" containerID="a863b879bcbde26640966a9062edc76272056eaadab97796ef2e32901790e477"
Sep 08 15:20:45.987399 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:45.987353    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a863b879bcbde26640966a9062edc76272056eaadab97796ef2e32901790e477"} err="failed to get container status \"a863b879bcbde26640966a9062edc76272056eaadab97796ef2e32901790e477\": rpc error: code = NotFound desc = could not find container \"a863b879bcbde26640966a9062edc76272056eaadab97796ef2e32901790e477\": container with ID starting with a863b879bcbde26640966a9062edc76272056eaadab97796ef2e32901790e477 not found: ID does not exist"
Sep 08 15:20:55.977196 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:55.977121    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:20:55.977670 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:55.977201    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:55.977670 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:55.977340    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dwkkv"
Sep 08 15:20:56.191703 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.191664    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"]
Sep 08 15:20:56.191911 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.191885    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk" podUID="f58e5ea6-37cb-4242-8057-0bd0c1be236c" containerName="manager" containerID="cri-o://52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7" gracePeriod=10
Sep 08 15:20:56.442923 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.442894    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:56.557451 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.557428    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jkvl\" (UniqueName: \"kubernetes.io/projected/f58e5ea6-37cb-4242-8057-0bd0c1be236c-kube-api-access-8jkvl\") pod \"f58e5ea6-37cb-4242-8057-0bd0c1be236c\" (UID: \"f58e5ea6-37cb-4242-8057-0bd0c1be236c\") "
Sep 08 15:20:56.557606 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.557521    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f58e5ea6-37cb-4242-8057-0bd0c1be236c-extensions-socket-volume\") pod \"f58e5ea6-37cb-4242-8057-0bd0c1be236c\" (UID: \"f58e5ea6-37cb-4242-8057-0bd0c1be236c\") "
Sep 08 15:20:56.557883 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.557858    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58e5ea6-37cb-4242-8057-0bd0c1be236c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f58e5ea6-37cb-4242-8057-0bd0c1be236c" (UID: "f58e5ea6-37cb-4242-8057-0bd0c1be236c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:56.559950 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.559887    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f58e5ea6-37cb-4242-8057-0bd0c1be236c-kube-api-access-8jkvl" (OuterVolumeSpecName: "kube-api-access-8jkvl") pod "f58e5ea6-37cb-4242-8057-0bd0c1be236c" (UID: "f58e5ea6-37cb-4242-8057-0bd0c1be236c"). InnerVolumeSpecName "kube-api-access-8jkvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:56.658151 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.658123    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jkvl\" (UniqueName: \"kubernetes.io/projected/f58e5ea6-37cb-4242-8057-0bd0c1be236c-kube-api-access-8jkvl\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:56.658151 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.658147    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f58e5ea6-37cb-4242-8057-0bd0c1be236c-extensions-socket-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:20:56.974509 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.974473    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"]
Sep 08 15:20:56.974891 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.974878    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58e5ea6-37cb-4242-8057-0bd0c1be236c" containerName="manager"
Sep 08 15:20:56.974941 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.974893    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58e5ea6-37cb-4242-8057-0bd0c1be236c" containerName="manager"
Sep 08 15:20:56.974976 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.974947    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58e5ea6-37cb-4242-8057-0bd0c1be236c" containerName="manager"
Sep 08 15:20:56.977019 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:56.977004    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:20:57.008301 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.008258    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"]
Sep 08 15:20:57.052982 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.052950    2566 generic.go:356] "Generic (PLEG): container finished" podID="f58e5ea6-37cb-4242-8057-0bd0c1be236c" containerID="52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7" exitCode=0
Sep 08 15:20:57.053143 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.053001    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"
Sep 08 15:20:57.053143 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.053047    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk" event={"ID":"f58e5ea6-37cb-4242-8057-0bd0c1be236c","Type":"ContainerDied","Data":"52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7"}
Sep 08 15:20:57.053143 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.053097    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk" event={"ID":"f58e5ea6-37cb-4242-8057-0bd0c1be236c","Type":"ContainerDied","Data":"7048bc6a32928adfca2c90d357bc3b96bf3e7af061b73dd9239a85408bf6610e"}
Sep 08 15:20:57.053143 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.053118    2566 scope.go:117] "RemoveContainer" containerID="52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7"
Sep 08 15:20:57.061566 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.061221    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfcfk\" (UniqueName: \"kubernetes.io/projected/dc7214ea-b338-4d53-b382-6ddddb48cc86-kube-api-access-nfcfk\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rrnvv\" (UID: \"dc7214ea-b338-4d53-b382-6ddddb48cc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:20:57.061566 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.061423    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc7214ea-b338-4d53-b382-6ddddb48cc86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rrnvv\" (UID: \"dc7214ea-b338-4d53-b382-6ddddb48cc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:20:57.063711 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.063694    2566 scope.go:117] "RemoveContainer" containerID="52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7"
Sep 08 15:20:57.064023 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:20:57.064005    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7\": container with ID starting with 52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7 not found: ID does not exist" containerID="52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7"
Sep 08 15:20:57.064088 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.064035    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7"} err="failed to get container status \"52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7\": rpc error: code = NotFound desc = could not find container \"52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7\": container with ID starting with 52e221bc4eaed2e443c6ea392508248ee74847eb6a414c7610b0eaa1a38119f7 not found: ID does not exist"
Sep 08 15:20:57.089302 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.089272    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"]
Sep 08 15:20:57.103238 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.103207    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-x9dhk"]
Sep 08 15:20:57.162209 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.162167    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc7214ea-b338-4d53-b382-6ddddb48cc86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rrnvv\" (UID: \"dc7214ea-b338-4d53-b382-6ddddb48cc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:20:57.162406 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.162244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfcfk\" (UniqueName: \"kubernetes.io/projected/dc7214ea-b338-4d53-b382-6ddddb48cc86-kube-api-access-nfcfk\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rrnvv\" (UID: \"dc7214ea-b338-4d53-b382-6ddddb48cc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:20:57.162724 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.162701    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc7214ea-b338-4d53-b382-6ddddb48cc86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rrnvv\" (UID: \"dc7214ea-b338-4d53-b382-6ddddb48cc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:20:57.189888 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.189842    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfcfk\" (UniqueName: \"kubernetes.io/projected/dc7214ea-b338-4d53-b382-6ddddb48cc86-kube-api-access-nfcfk\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rrnvv\" (UID: \"dc7214ea-b338-4d53-b382-6ddddb48cc86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:20:57.287263 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.287165    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:20:57.579852 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.579826    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"]
Sep 08 15:20:57.581231 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:20:57.581205    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7214ea_b338_4d53_b382_6ddddb48cc86.slice/crio-8c8e61e6e29556ce26945ca21905c4ae3d3a3b0eb82750eac35c6700bdec7cd5 WatchSource:0}: Error finding container 8c8e61e6e29556ce26945ca21905c4ae3d3a3b0eb82750eac35c6700bdec7cd5: Status 404 returned error can't find the container with id 8c8e61e6e29556ce26945ca21905c4ae3d3a3b0eb82750eac35c6700bdec7cd5
Sep 08 15:20:57.914917 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:57.914835    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f58e5ea6-37cb-4242-8057-0bd0c1be236c" path="/var/lib/kubelet/pods/f58e5ea6-37cb-4242-8057-0bd0c1be236c/volumes"
Sep 08 15:20:58.061353 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:58.061313    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv" event={"ID":"dc7214ea-b338-4d53-b382-6ddddb48cc86","Type":"ContainerStarted","Data":"2aa3e74f92f860b44975037f0e6016554cdd41639bb9c15e747beb0bd3e179c4"}
Sep 08 15:20:58.061761 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:58.061366    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv" event={"ID":"dc7214ea-b338-4d53-b382-6ddddb48cc86","Type":"ContainerStarted","Data":"8c8e61e6e29556ce26945ca21905c4ae3d3a3b0eb82750eac35c6700bdec7cd5"}
Sep 08 15:20:58.061761 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:58.061430    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:20:58.154673 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:20:58.154602    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv" podStartSLOduration=2.154585077 podStartE2EDuration="2.154585077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:58.154473535 +0000 UTC m=+718.726019579" watchObservedRunningTime="2026-09-08 15:20:58.154585077 +0000 UTC m=+718.726131119"
Sep 08 15:21:09.070741 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:09.070702    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:21:09.164464 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:09.164399    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"]
Sep 08 15:21:09.164774 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:09.164748    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj" podUID="9b6eda3b-df5e-4f7f-a733-895bd88ac4ed" containerName="manager" containerID="cri-o://207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb" gracePeriod=10
Sep 08 15:21:09.415684 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:09.415655    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:21:09.574612 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:09.574573    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-extensions-socket-volume\") pod \"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed\" (UID: \"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed\") "
Sep 08 15:21:09.574823 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:09.574717    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjp52\" (UniqueName: \"kubernetes.io/projected/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-kube-api-access-zjp52\") pod \"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed\" (UID: \"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed\") "
Sep 08 15:21:09.575040 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:09.575019    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b6eda3b-df5e-4f7f-a733-895bd88ac4ed" (UID: "9b6eda3b-df5e-4f7f-a733-895bd88ac4ed"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:21:09.576983 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:09.576962    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-kube-api-access-zjp52" (OuterVolumeSpecName: "kube-api-access-zjp52") pod "9b6eda3b-df5e-4f7f-a733-895bd88ac4ed" (UID: "9b6eda3b-df5e-4f7f-a733-895bd88ac4ed"). InnerVolumeSpecName "kube-api-access-zjp52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:21:09.676238 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:09.676131    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-extensions-socket-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:21:09.676238 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:09.676169    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjp52\" (UniqueName: \"kubernetes.io/projected/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed-kube-api-access-zjp52\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:21:10.139600 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:10.139567    2566 generic.go:356] "Generic (PLEG): container finished" podID="9b6eda3b-df5e-4f7f-a733-895bd88ac4ed" containerID="207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb" exitCode=0
Sep 08 15:21:10.140046 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:10.139613    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"
Sep 08 15:21:10.140046 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:10.139653    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj" event={"ID":"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed","Type":"ContainerDied","Data":"207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb"}
Sep 08 15:21:10.140046 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:10.139712    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj" event={"ID":"9b6eda3b-df5e-4f7f-a733-895bd88ac4ed","Type":"ContainerDied","Data":"742454eca9c5ab1c435bd31639e2e45a132b30124dcb24bb2e6bd658bf07e4d0"}
Sep 08 15:21:10.140046 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:10.139734    2566 scope.go:117] "RemoveContainer" containerID="207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb"
Sep 08 15:21:10.148993 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:10.148976    2566 scope.go:117] "RemoveContainer" containerID="207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb"
Sep 08 15:21:10.149277 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:21:10.149259    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb\": container with ID starting with 207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb not found: ID does not exist" containerID="207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb"
Sep 08 15:21:10.149332 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:10.149287    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb"} err="failed to get container status \"207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb\": rpc error: code = NotFound desc = could not find container \"207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb\": container with ID starting with 207c55a0d130178f50b9b3af224e66addd4ebe655eec50685c8b831de92befdb not found: ID does not exist"
Sep 08 15:21:10.174783 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:10.174734    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"]
Sep 08 15:21:10.176585 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:10.176555    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-4s4fj"]
Sep 08 15:21:11.914905 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:11.914872    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b6eda3b-df5e-4f7f-a733-895bd88ac4ed" path="/var/lib/kubelet/pods/9b6eda3b-df5e-4f7f-a733-895bd88ac4ed/volumes"
Sep 08 15:21:31.856200 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:31.856159    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"]
Sep 08 15:21:31.856697 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:31.856529    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b6eda3b-df5e-4f7f-a733-895bd88ac4ed" containerName="manager"
Sep 08 15:21:31.856697 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:31.856540    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b6eda3b-df5e-4f7f-a733-895bd88ac4ed" containerName="manager"
Sep 08 15:21:31.856697 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:31.856611    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b6eda3b-df5e-4f7f-a733-895bd88ac4ed" containerName="manager"
Sep 08 15:21:31.859861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:31.859843    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:31.862735 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:31.862713    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 15:21:31.877636 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:31.874500    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"]
Sep 08 15:21:31.945738 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:31.945699    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"]
Sep 08 15:21:31.972340 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:31.972305    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq4g4\" (UniqueName: \"kubernetes.io/projected/1addedf9-d8f2-4895-b814-42d25ee41b0c-kube-api-access-kq4g4\") pod \"limitador-limitador-859c4d96d6-5rg4h\" (UID: \"1addedf9-d8f2-4895-b814-42d25ee41b0c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:31.972531 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:31.972453    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1addedf9-d8f2-4895-b814-42d25ee41b0c-config-file\") pod \"limitador-limitador-859c4d96d6-5rg4h\" (UID: \"1addedf9-d8f2-4895-b814-42d25ee41b0c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:32.073847 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:32.073814    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1addedf9-d8f2-4895-b814-42d25ee41b0c-config-file\") pod \"limitador-limitador-859c4d96d6-5rg4h\" (UID: \"1addedf9-d8f2-4895-b814-42d25ee41b0c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:32.074030 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:32.073886    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq4g4\" (UniqueName: \"kubernetes.io/projected/1addedf9-d8f2-4895-b814-42d25ee41b0c-kube-api-access-kq4g4\") pod \"limitador-limitador-859c4d96d6-5rg4h\" (UID: \"1addedf9-d8f2-4895-b814-42d25ee41b0c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:32.074473 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:32.074453    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1addedf9-d8f2-4895-b814-42d25ee41b0c-config-file\") pod \"limitador-limitador-859c4d96d6-5rg4h\" (UID: \"1addedf9-d8f2-4895-b814-42d25ee41b0c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:32.083412 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:32.083384    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq4g4\" (UniqueName: \"kubernetes.io/projected/1addedf9-d8f2-4895-b814-42d25ee41b0c-kube-api-access-kq4g4\") pod \"limitador-limitador-859c4d96d6-5rg4h\" (UID: \"1addedf9-d8f2-4895-b814-42d25ee41b0c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:32.170089 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:32.169992    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:32.447856 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:32.447831    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"]
Sep 08 15:21:32.449653 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:21:32.449601    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1addedf9_d8f2_4895_b814_42d25ee41b0c.slice/crio-39f273a6f8cb36668c593b8ef51191ac3c66792d4998cda626fa7dd8c4fc38c4 WatchSource:0}: Error finding container 39f273a6f8cb36668c593b8ef51191ac3c66792d4998cda626fa7dd8c4fc38c4: Status 404 returned error can't find the container with id 39f273a6f8cb36668c593b8ef51191ac3c66792d4998cda626fa7dd8c4fc38c4
Sep 08 15:21:32.968651 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:32.968578    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-k4k55"]
Sep 08 15:21:32.973656 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:32.973600    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-k4k55"
Sep 08 15:21:32.976937 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:32.976910    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mtxln\""
Sep 08 15:21:32.985861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:32.985836    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-k4k55"]
Sep 08 15:21:33.080786 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:33.080755    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t49sz\" (UniqueName: \"kubernetes.io/projected/ced3ffdf-fae3-40d8-a42d-9c7e7ac79809-kube-api-access-t49sz\") pod \"authorino-c548b5d7d-k4k55\" (UID: \"ced3ffdf-fae3-40d8-a42d-9c7e7ac79809\") " pod="kuadrant-system/authorino-c548b5d7d-k4k55"
Sep 08 15:21:33.181711 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:33.181668    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t49sz\" (UniqueName: \"kubernetes.io/projected/ced3ffdf-fae3-40d8-a42d-9c7e7ac79809-kube-api-access-t49sz\") pod \"authorino-c548b5d7d-k4k55\" (UID: \"ced3ffdf-fae3-40d8-a42d-9c7e7ac79809\") " pod="kuadrant-system/authorino-c548b5d7d-k4k55"
Sep 08 15:21:33.190754 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:33.190720    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t49sz\" (UniqueName: \"kubernetes.io/projected/ced3ffdf-fae3-40d8-a42d-9c7e7ac79809-kube-api-access-t49sz\") pod \"authorino-c548b5d7d-k4k55\" (UID: \"ced3ffdf-fae3-40d8-a42d-9c7e7ac79809\") " pod="kuadrant-system/authorino-c548b5d7d-k4k55"
Sep 08 15:21:33.276730 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:33.276642    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h" event={"ID":"1addedf9-d8f2-4895-b814-42d25ee41b0c","Type":"ContainerStarted","Data":"39f273a6f8cb36668c593b8ef51191ac3c66792d4998cda626fa7dd8c4fc38c4"}
Sep 08 15:21:33.282857 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:33.282838    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-k4k55"
Sep 08 15:21:33.553559 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:33.553529    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-k4k55"]
Sep 08 15:21:33.555371 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:21:33.555348    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podced3ffdf_fae3_40d8_a42d_9c7e7ac79809.slice/crio-69dc181c86a6251a55067b13f0f7c0a9795ffe5adaa130b724263472181c2851 WatchSource:0}: Error finding container 69dc181c86a6251a55067b13f0f7c0a9795ffe5adaa130b724263472181c2851: Status 404 returned error can't find the container with id 69dc181c86a6251a55067b13f0f7c0a9795ffe5adaa130b724263472181c2851
Sep 08 15:21:34.287228 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:34.287187    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-k4k55" event={"ID":"ced3ffdf-fae3-40d8-a42d-9c7e7ac79809","Type":"ContainerStarted","Data":"69dc181c86a6251a55067b13f0f7c0a9795ffe5adaa130b724263472181c2851"}
Sep 08 15:21:36.301502 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:36.301468    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h" event={"ID":"1addedf9-d8f2-4895-b814-42d25ee41b0c","Type":"ContainerStarted","Data":"d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79"}
Sep 08 15:21:36.301981 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:36.301563    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:36.303341 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:36.303319    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-k4k55" event={"ID":"ced3ffdf-fae3-40d8-a42d-9c7e7ac79809","Type":"ContainerStarted","Data":"935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810"}
Sep 08 15:21:36.322733 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:36.322678    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h" podStartSLOduration=2.30367457 podStartE2EDuration="5.322661474s" totalImagesPullingTime="3.018986904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:21:36.320237857 +0000 UTC m=+756.891783900" watchObservedRunningTime="2026-09-08 15:21:36.322661474 +0000 UTC m=+756.894207516"
Sep 08 15:21:36.338081 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:36.338025    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-k4k55" podStartSLOduration=2.412315133 podStartE2EDuration="4.338008278s" totalImagesPullingTime="1.925693145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:21:36.33590648 +0000 UTC m=+756.907452512" watchObservedRunningTime="2026-09-08 15:21:36.338008278 +0000 UTC m=+756.909554319"
Sep 08 15:21:47.309946 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:47.309914    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:47.324221 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:47.324183    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"]
Sep 08 15:21:47.372672 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:47.372612    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h" podUID="1addedf9-d8f2-4895-b814-42d25ee41b0c" containerName="limitador" containerID="cri-o://d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79" gracePeriod=30
Sep 08 15:21:48.325804 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.325778    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:48.380071 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.380037    2566 generic.go:356] "Generic (PLEG): container finished" podID="1addedf9-d8f2-4895-b814-42d25ee41b0c" containerID="d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79" exitCode=0
Sep 08 15:21:48.380272 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.380080    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h" event={"ID":"1addedf9-d8f2-4895-b814-42d25ee41b0c","Type":"ContainerDied","Data":"d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79"}
Sep 08 15:21:48.380272 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.380089    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"
Sep 08 15:21:48.380272 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.380117    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-5rg4h" event={"ID":"1addedf9-d8f2-4895-b814-42d25ee41b0c","Type":"ContainerDied","Data":"39f273a6f8cb36668c593b8ef51191ac3c66792d4998cda626fa7dd8c4fc38c4"}
Sep 08 15:21:48.380272 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.380140    2566 scope.go:117] "RemoveContainer" containerID="d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79"
Sep 08 15:21:48.389152 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.389127    2566 scope.go:117] "RemoveContainer" containerID="d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79"
Sep 08 15:21:48.389450 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:21:48.389433    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79\": container with ID starting with d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79 not found: ID does not exist" containerID="d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79"
Sep 08 15:21:48.389490 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.389461    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79"} err="failed to get container status \"d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79\": rpc error: code = NotFound desc = could not find container \"d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79\": container with ID starting with d0589eeedb4b269dd68645a1a62de19b16109cd8b82c031d7c487be7d4387e79 not found: ID does not exist"
Sep 08 15:21:48.417838 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.417806    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1addedf9-d8f2-4895-b814-42d25ee41b0c-config-file\") pod \"1addedf9-d8f2-4895-b814-42d25ee41b0c\" (UID: \"1addedf9-d8f2-4895-b814-42d25ee41b0c\") "
Sep 08 15:21:48.417928 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.417908    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq4g4\" (UniqueName: \"kubernetes.io/projected/1addedf9-d8f2-4895-b814-42d25ee41b0c-kube-api-access-kq4g4\") pod \"1addedf9-d8f2-4895-b814-42d25ee41b0c\" (UID: \"1addedf9-d8f2-4895-b814-42d25ee41b0c\") "
Sep 08 15:21:48.418240 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.418213    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1addedf9-d8f2-4895-b814-42d25ee41b0c-config-file" (OuterVolumeSpecName: "config-file") pod "1addedf9-d8f2-4895-b814-42d25ee41b0c" (UID: "1addedf9-d8f2-4895-b814-42d25ee41b0c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:21:48.420259 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.420234    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1addedf9-d8f2-4895-b814-42d25ee41b0c-kube-api-access-kq4g4" (OuterVolumeSpecName: "kube-api-access-kq4g4") pod "1addedf9-d8f2-4895-b814-42d25ee41b0c" (UID: "1addedf9-d8f2-4895-b814-42d25ee41b0c"). InnerVolumeSpecName "kube-api-access-kq4g4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:21:48.519358 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.519266    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq4g4\" (UniqueName: \"kubernetes.io/projected/1addedf9-d8f2-4895-b814-42d25ee41b0c-kube-api-access-kq4g4\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:21:48.519358 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.519296    2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1addedf9-d8f2-4895-b814-42d25ee41b0c-config-file\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:21:48.708546 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.708507    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"]
Sep 08 15:21:48.721470 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:48.721436    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-5rg4h"]
Sep 08 15:21:49.914869 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:49.914832    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1addedf9-d8f2-4895-b814-42d25ee41b0c" path="/var/lib/kubelet/pods/1addedf9-d8f2-4895-b814-42d25ee41b0c/volumes"
Sep 08 15:21:50.338570 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.338533    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"]
Sep 08 15:21:50.339144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.339123    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1addedf9-d8f2-4895-b814-42d25ee41b0c" containerName="limitador"
Sep 08 15:21:50.339196 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.339151    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1addedf9-d8f2-4895-b814-42d25ee41b0c" containerName="limitador"
Sep 08 15:21:50.339272 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.339260    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1addedf9-d8f2-4895-b814-42d25ee41b0c" containerName="limitador"
Sep 08 15:21:50.343669 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.343650    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"
Sep 08 15:21:50.349042 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.349018    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:21:50.368504 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.368472    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-nlhqr\""
Sep 08 15:21:50.368715 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.368472    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 15:21:50.368715 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.368543    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 15:21:50.370380 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.370349    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"]
Sep 08 15:21:50.437116 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.437077    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7d7fa11e-8cd4-4202-b497-c1e4ebd75441-data\") pod \"postgres-69fb4594cf-gspnn\" (UID: \"7d7fa11e-8cd4-4202-b497-c1e4ebd75441\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"
Sep 08 15:21:50.437305 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.437128    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlt5g\" (UniqueName: \"kubernetes.io/projected/7d7fa11e-8cd4-4202-b497-c1e4ebd75441-kube-api-access-mlt5g\") pod \"postgres-69fb4594cf-gspnn\" (UID: \"7d7fa11e-8cd4-4202-b497-c1e4ebd75441\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"
Sep 08 15:21:50.538254 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.538212    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7d7fa11e-8cd4-4202-b497-c1e4ebd75441-data\") pod \"postgres-69fb4594cf-gspnn\" (UID: \"7d7fa11e-8cd4-4202-b497-c1e4ebd75441\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"
Sep 08 15:21:50.538448 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.538280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlt5g\" (UniqueName: \"kubernetes.io/projected/7d7fa11e-8cd4-4202-b497-c1e4ebd75441-kube-api-access-mlt5g\") pod \"postgres-69fb4594cf-gspnn\" (UID: \"7d7fa11e-8cd4-4202-b497-c1e4ebd75441\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"
Sep 08 15:21:50.538651 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.538590    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7d7fa11e-8cd4-4202-b497-c1e4ebd75441-data\") pod \"postgres-69fb4594cf-gspnn\" (UID: \"7d7fa11e-8cd4-4202-b497-c1e4ebd75441\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"
Sep 08 15:21:50.549864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.549836    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlt5g\" (UniqueName: \"kubernetes.io/projected/7d7fa11e-8cd4-4202-b497-c1e4ebd75441-kube-api-access-mlt5g\") pod \"postgres-69fb4594cf-gspnn\" (UID: \"7d7fa11e-8cd4-4202-b497-c1e4ebd75441\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"
Sep 08 15:21:50.653659 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.653535    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"
Sep 08 15:21:50.928363 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:50.928329    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"]
Sep 08 15:21:50.931305 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:21:50.931279    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7fa11e_8cd4_4202_b497_c1e4ebd75441.slice/crio-ef9cfd49fcb8d2f9bc3cd14eea78651a07cef485504551e00745e8155f409795 WatchSource:0}: Error finding container ef9cfd49fcb8d2f9bc3cd14eea78651a07cef485504551e00745e8155f409795: Status 404 returned error can't find the container with id ef9cfd49fcb8d2f9bc3cd14eea78651a07cef485504551e00745e8155f409795
Sep 08 15:21:51.399678 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:51.399640    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn" event={"ID":"7d7fa11e-8cd4-4202-b497-c1e4ebd75441","Type":"ContainerStarted","Data":"ef9cfd49fcb8d2f9bc3cd14eea78651a07cef485504551e00745e8155f409795"}
Sep 08 15:21:57.443281 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:57.443243    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn" event={"ID":"7d7fa11e-8cd4-4202-b497-c1e4ebd75441","Type":"ContainerStarted","Data":"d0d85e68d8cbadfccd6a96c83ff97797a37253de810cd2f6837249c1ef75ab3c"}
Sep 08 15:21:57.443735 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:57.443374    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"
Sep 08 15:21:57.464430 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:21:57.464376    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn" podStartSLOduration=1.5643752119999998 podStartE2EDuration="7.464354787s" totalImagesPullingTime="5.899979575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:21:57.462055712 +0000 UTC m=+778.033601809" watchObservedRunningTime="2026-09-08 15:21:57.464354787 +0000 UTC m=+778.035900831"
Sep 08 15:22:03.479452 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:03.479414    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gspnn"
Sep 08 15:22:06.450023 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:06.449984    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-k4k55"]
Sep 08 15:22:06.450453 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:06.450211    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-k4k55" podUID="ced3ffdf-fae3-40d8-a42d-9c7e7ac79809" containerName="authorino" containerID="cri-o://935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810" gracePeriod=30
Sep 08 15:22:07.253047 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.253018    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-k4k55"
Sep 08 15:22:07.393034 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.392948    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t49sz\" (UniqueName: \"kubernetes.io/projected/ced3ffdf-fae3-40d8-a42d-9c7e7ac79809-kube-api-access-t49sz\") pod \"ced3ffdf-fae3-40d8-a42d-9c7e7ac79809\" (UID: \"ced3ffdf-fae3-40d8-a42d-9c7e7ac79809\") "
Sep 08 15:22:07.395228 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.395202    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced3ffdf-fae3-40d8-a42d-9c7e7ac79809-kube-api-access-t49sz" (OuterVolumeSpecName: "kube-api-access-t49sz") pod "ced3ffdf-fae3-40d8-a42d-9c7e7ac79809" (UID: "ced3ffdf-fae3-40d8-a42d-9c7e7ac79809"). InnerVolumeSpecName "kube-api-access-t49sz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:22:07.494356 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.494317    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t49sz\" (UniqueName: \"kubernetes.io/projected/ced3ffdf-fae3-40d8-a42d-9c7e7ac79809-kube-api-access-t49sz\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:22:07.502454 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.502417    2566 generic.go:356] "Generic (PLEG): container finished" podID="ced3ffdf-fae3-40d8-a42d-9c7e7ac79809" containerID="935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810" exitCode=0
Sep 08 15:22:07.502606 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.502465    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-k4k55" event={"ID":"ced3ffdf-fae3-40d8-a42d-9c7e7ac79809","Type":"ContainerDied","Data":"935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810"}
Sep 08 15:22:07.502606 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.502514    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-k4k55" event={"ID":"ced3ffdf-fae3-40d8-a42d-9c7e7ac79809","Type":"ContainerDied","Data":"69dc181c86a6251a55067b13f0f7c0a9795ffe5adaa130b724263472181c2851"}
Sep 08 15:22:07.502606 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.502531    2566 scope.go:117] "RemoveContainer" containerID="935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810"
Sep 08 15:22:07.502606 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.502473    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-k4k55"
Sep 08 15:22:07.512069 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.512047    2566 scope.go:117] "RemoveContainer" containerID="935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810"
Sep 08 15:22:07.512389 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:22:07.512371    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810\": container with ID starting with 935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810 not found: ID does not exist" containerID="935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810"
Sep 08 15:22:07.512455 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.512398    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810"} err="failed to get container status \"935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810\": rpc error: code = NotFound desc = could not find container \"935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810\": container with ID starting with 935780176dcd8cc614129b6f58a7281f59f565aef1d85e75d4071e189a3a3810 not found: ID does not exist"
Sep 08 15:22:07.526656 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.526604    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-k4k55"]
Sep 08 15:22:07.530082 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.530059    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-k4k55"]
Sep 08 15:22:07.914570 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:07.914534    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ced3ffdf-fae3-40d8-a42d-9c7e7ac79809" path="/var/lib/kubelet/pods/ced3ffdf-fae3-40d8-a42d-9c7e7ac79809/volumes"
Sep 08 15:22:11.438253 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.438212    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-684877b5d5-p2lzt"]
Sep 08 15:22:11.438685 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.438591    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced3ffdf-fae3-40d8-a42d-9c7e7ac79809" containerName="authorino"
Sep 08 15:22:11.438685 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.438602    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced3ffdf-fae3-40d8-a42d-9c7e7ac79809" containerName="authorino"
Sep 08 15:22:11.438777 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.438690    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced3ffdf-fae3-40d8-a42d-9c7e7ac79809" containerName="authorino"
Sep 08 15:22:11.444514 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.444479    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:11.447581 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.447554    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 15:22:11.447581 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.447576    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:22:11.447799 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.447557    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 15:22:11.448044 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.448027    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6lwn5\""
Sep 08 15:22:11.457021 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.456992    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-684877b5d5-p2lzt"]
Sep 08 15:22:11.630454 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.630416    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5dzc\" (UniqueName: \"kubernetes.io/projected/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-kube-api-access-w5dzc\") pod \"maas-controller-684877b5d5-p2lzt\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") " pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:11.630759 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.630511    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-webhook-cert\") pod \"maas-controller-684877b5d5-p2lzt\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") " pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:11.630759 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.630586    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-metrics-certs\") pod \"maas-controller-684877b5d5-p2lzt\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") " pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:11.657637 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.657585    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7578c8977-bdmfs"]
Sep 08 15:22:11.660082 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.660050    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:11.675380 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.675350    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7578c8977-bdmfs"]
Sep 08 15:22:11.731130 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.731037    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-webhook-cert\") pod \"maas-controller-684877b5d5-p2lzt\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") " pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:11.731130 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.731098    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-metrics-certs\") pod \"maas-controller-684877b5d5-p2lzt\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") " pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:11.731340 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.731178    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dzc\" (UniqueName: \"kubernetes.io/projected/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-kube-api-access-w5dzc\") pod \"maas-controller-684877b5d5-p2lzt\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") " pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:11.733889 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.733861    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-metrics-certs\") pod \"maas-controller-684877b5d5-p2lzt\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") " pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:11.734013 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.733998    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-webhook-cert\") pod \"maas-controller-684877b5d5-p2lzt\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") " pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:11.743599 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.743561    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5dzc\" (UniqueName: \"kubernetes.io/projected/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-kube-api-access-w5dzc\") pod \"maas-controller-684877b5d5-p2lzt\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") " pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:11.757610 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.757576    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:11.832314 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.832277    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-metrics-certs\") pod \"maas-controller-7578c8977-bdmfs\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") " pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:11.832478 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.832398    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-webhook-cert\") pod \"maas-controller-7578c8977-bdmfs\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") " pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:11.832478 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.832437    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm8tw\" (UniqueName: \"kubernetes.io/projected/0dd42584-40c4-4477-8ef0-83a8cf80b570-kube-api-access-sm8tw\") pod \"maas-controller-7578c8977-bdmfs\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") " pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:11.933165 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.933122    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-metrics-certs\") pod \"maas-controller-7578c8977-bdmfs\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") " pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:11.933393 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.933212    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-webhook-cert\") pod \"maas-controller-7578c8977-bdmfs\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") " pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:11.933393 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.933248    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm8tw\" (UniqueName: \"kubernetes.io/projected/0dd42584-40c4-4477-8ef0-83a8cf80b570-kube-api-access-sm8tw\") pod \"maas-controller-7578c8977-bdmfs\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") " pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:11.936005 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.935980    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-metrics-certs\") pod \"maas-controller-7578c8977-bdmfs\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") " pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:11.936129 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.936010    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-webhook-cert\") pod \"maas-controller-7578c8977-bdmfs\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") " pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:11.943233 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.943201    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm8tw\" (UniqueName: \"kubernetes.io/projected/0dd42584-40c4-4477-8ef0-83a8cf80b570-kube-api-access-sm8tw\") pod \"maas-controller-7578c8977-bdmfs\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") " pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:11.970614 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:11.970574    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:12.040757 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:22:12.040730    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd7ed8b_4e81_4247_9286_a07f65c37bd4.slice/crio-668baba08a1b336eca6328b5c8beec5cec159a89839cc3f585bffa568b10649d WatchSource:0}: Error finding container 668baba08a1b336eca6328b5c8beec5cec159a89839cc3f585bffa568b10649d: Status 404 returned error can't find the container with id 668baba08a1b336eca6328b5c8beec5cec159a89839cc3f585bffa568b10649d
Sep 08 15:22:12.040864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:12.040826    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-684877b5d5-p2lzt"]
Sep 08 15:22:12.248651 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:12.248605    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7578c8977-bdmfs"]
Sep 08 15:22:12.250068 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:22:12.250043    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd42584_40c4_4477_8ef0_83a8cf80b570.slice/crio-06eb4d499de4deeb482e8657482dee13daf85f2fb60068b14d02854a9ad660e8 WatchSource:0}: Error finding container 06eb4d499de4deeb482e8657482dee13daf85f2fb60068b14d02854a9ad660e8: Status 404 returned error can't find the container with id 06eb4d499de4deeb482e8657482dee13daf85f2fb60068b14d02854a9ad660e8
Sep 08 15:22:12.541259 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:12.541157    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7578c8977-bdmfs" event={"ID":"0dd42584-40c4-4477-8ef0-83a8cf80b570","Type":"ContainerStarted","Data":"06eb4d499de4deeb482e8657482dee13daf85f2fb60068b14d02854a9ad660e8"}
Sep 08 15:22:12.542454 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:12.542425    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684877b5d5-p2lzt" event={"ID":"dfd7ed8b-4e81-4247-9286-a07f65c37bd4","Type":"ContainerStarted","Data":"668baba08a1b336eca6328b5c8beec5cec159a89839cc3f585bffa568b10649d"}
Sep 08 15:22:15.563119 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:15.563084    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7578c8977-bdmfs" event={"ID":"0dd42584-40c4-4477-8ef0-83a8cf80b570","Type":"ContainerStarted","Data":"a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05"}
Sep 08 15:22:15.563567 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:15.563172    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:15.564712 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:15.564689    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684877b5d5-p2lzt" event={"ID":"dfd7ed8b-4e81-4247-9286-a07f65c37bd4","Type":"ContainerStarted","Data":"1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868"}
Sep 08 15:22:15.564832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:15.564818    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:15.613928 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:15.613865    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7578c8977-bdmfs" podStartSLOduration=2.205004267 podStartE2EDuration="4.613844211s" totalImagesPullingTime="2.408839944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:15.591736741 +0000 UTC m=+796.163282782" watchObservedRunningTime="2026-09-08 15:22:15.613844211 +0000 UTC m=+796.185390253"
Sep 08 15:22:15.616152 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:15.616117    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-684877b5d5-p2lzt" podStartSLOduration=1.987220397 podStartE2EDuration="4.616103648s" totalImagesPullingTime="2.628883251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:15.612936093 +0000 UTC m=+796.184482158" watchObservedRunningTime="2026-09-08 15:22:15.616103648 +0000 UTC m=+796.187649712"
Sep 08 15:22:26.574076 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:26.573999    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:26.574076 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:26.574070    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:22:26.678357 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:26.678326    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-684877b5d5-p2lzt"]
Sep 08 15:22:26.678587 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:26.678561    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-684877b5d5-p2lzt" podUID="dfd7ed8b-4e81-4247-9286-a07f65c37bd4" containerName="manager" containerID="cri-o://1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868" gracePeriod=30
Sep 08 15:22:26.935091 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:26.935066    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:27.075187 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.075150    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-metrics-certs\") pod \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") "
Sep 08 15:22:27.075187 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.075193    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-webhook-cert\") pod \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") "
Sep 08 15:22:27.075399 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.075236    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5dzc\" (UniqueName: \"kubernetes.io/projected/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-kube-api-access-w5dzc\") pod \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\" (UID: \"dfd7ed8b-4e81-4247-9286-a07f65c37bd4\") "
Sep 08 15:22:27.077702 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.077662    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dfd7ed8b-4e81-4247-9286-a07f65c37bd4" (UID: "dfd7ed8b-4e81-4247-9286-a07f65c37bd4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:22:27.077840 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.077702    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-kube-api-access-w5dzc" (OuterVolumeSpecName: "kube-api-access-w5dzc") pod "dfd7ed8b-4e81-4247-9286-a07f65c37bd4" (UID: "dfd7ed8b-4e81-4247-9286-a07f65c37bd4"). InnerVolumeSpecName "kube-api-access-w5dzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:22:27.077840 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.077785    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dfd7ed8b-4e81-4247-9286-a07f65c37bd4" (UID: "dfd7ed8b-4e81-4247-9286-a07f65c37bd4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:22:27.176169 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.176082    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-metrics-certs\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:22:27.176169 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.176111    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-webhook-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:22:27.176169 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.176120    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5dzc\" (UniqueName: \"kubernetes.io/projected/dfd7ed8b-4e81-4247-9286-a07f65c37bd4-kube-api-access-w5dzc\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:22:27.635169 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.635127    2566 generic.go:356] "Generic (PLEG): container finished" podID="dfd7ed8b-4e81-4247-9286-a07f65c37bd4" containerID="1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868" exitCode=0
Sep 08 15:22:27.635169 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.635172    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684877b5d5-p2lzt"
Sep 08 15:22:27.635660 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.635209    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684877b5d5-p2lzt" event={"ID":"dfd7ed8b-4e81-4247-9286-a07f65c37bd4","Type":"ContainerDied","Data":"1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868"}
Sep 08 15:22:27.635660 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.635266    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684877b5d5-p2lzt" event={"ID":"dfd7ed8b-4e81-4247-9286-a07f65c37bd4","Type":"ContainerDied","Data":"668baba08a1b336eca6328b5c8beec5cec159a89839cc3f585bffa568b10649d"}
Sep 08 15:22:27.635660 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.635288    2566 scope.go:117] "RemoveContainer" containerID="1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868"
Sep 08 15:22:27.646135 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.646104    2566 scope.go:117] "RemoveContainer" containerID="1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868"
Sep 08 15:22:27.646498 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:22:27.646477    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868\": container with ID starting with 1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868 not found: ID does not exist" containerID="1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868"
Sep 08 15:22:27.646579 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.646509    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868"} err="failed to get container status \"1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868\": rpc error: code = NotFound desc = could not find container \"1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868\": container with ID starting with 1526bb566ac3901c4d2f54300bcabbe734452ca951213a834d2dbbfb6c29f868 not found: ID does not exist"
Sep 08 15:22:27.666502 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.666471    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-684877b5d5-p2lzt"]
Sep 08 15:22:27.670297 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.670273    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-684877b5d5-p2lzt"]
Sep 08 15:22:27.915376 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:27.915296    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfd7ed8b-4e81-4247-9286-a07f65c37bd4" path="/var/lib/kubelet/pods/dfd7ed8b-4e81-4247-9286-a07f65c37bd4/volumes"
Sep 08 15:22:49.222688 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.222653    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"]
Sep 08 15:22:49.223167 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.223065    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd7ed8b-4e81-4247-9286-a07f65c37bd4" containerName="manager"
Sep 08 15:22:49.223167 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.223077    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd7ed8b-4e81-4247-9286-a07f65c37bd4" containerName="manager"
Sep 08 15:22:49.223167 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.223157    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd7ed8b-4e81-4247-9286-a07f65c37bd4" containerName="manager"
Sep 08 15:22:49.228166 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.228143    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.243665 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.242678    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 15:22:49.243665 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.242841    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hrbm8\""
Sep 08 15:22:49.243665 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.243037    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 15:22:49.267973 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.267941    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"]
Sep 08 15:22:49.379106 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.379058    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-metrics-certs\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.379301 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.379144    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b64c86-a349-4414-a003-bb41f3c562da-openshift-service-ca\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.379301 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.379187    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.379398 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.379343    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6xs8\" (UniqueName: \"kubernetes.io/projected/43b64c86-a349-4414-a003-bb41f3c562da-kube-api-access-w6xs8\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.480691 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.480562    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6xs8\" (UniqueName: \"kubernetes.io/projected/43b64c86-a349-4414-a003-bb41f3c562da-kube-api-access-w6xs8\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.480878 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.480735    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-metrics-certs\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.480878 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.480769    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b64c86-a349-4414-a003-bb41f3c562da-openshift-service-ca\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.480878 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.480806    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.481039 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:22:49.480953    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 08 15:22:49.481039 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:22:49.481022    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls podName:43b64c86-a349-4414-a003-bb41f3c562da nodeName:}" failed. No retries permitted until 2026-09-08 15:22:49.98100037 +0000 UTC m=+830.552546396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls") pod "maas-api-b858864dd-ttlnz" (UID: "43b64c86-a349-4414-a003-bb41f3c562da") : secret "maas-api-serving-cert" not found
Sep 08 15:22:49.481468 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.481444    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b64c86-a349-4414-a003-bb41f3c562da-openshift-service-ca\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.483378 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.483357    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-metrics-certs\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.495591 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.495567    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6xs8\" (UniqueName: \"kubernetes.io/projected/43b64c86-a349-4414-a003-bb41f3c562da-kube-api-access-w6xs8\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.984695 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:49.984663    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:49.984892 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:22:49.984821    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 08 15:22:49.984892 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:22:49.984887    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls podName:43b64c86-a349-4414-a003-bb41f3c562da nodeName:}" failed. No retries permitted until 2026-09-08 15:22:50.984870549 +0000 UTC m=+831.556416573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls") pod "maas-api-b858864dd-ttlnz" (UID: "43b64c86-a349-4414-a003-bb41f3c562da") : secret "maas-api-serving-cert" not found
Sep 08 15:22:50.030416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.030378    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"]
Sep 08 15:22:50.033107 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.033090    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"
Sep 08 15:22:50.035970 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.035940    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ssj9q\""
Sep 08 15:22:50.036225 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.036210    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 15:22:50.049825 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.049793    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"]
Sep 08 15:22:50.139948 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.139909    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"]
Sep 08 15:22:50.142749 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.142724    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"
Sep 08 15:22:50.157153 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.157123    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"]
Sep 08 15:22:50.186056 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.186024    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh8bt\" (UniqueName: \"kubernetes.io/projected/5d4b81ea-762e-4271-98d0-741c8f0ed744-kube-api-access-lh8bt\") pod \"payload-pre-processing-59fbc47bf8-fpwbv\" (UID: \"5d4b81ea-762e-4271-98d0-741c8f0ed744\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"
Sep 08 15:22:50.186263 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.186071    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d4b81ea-762e-4271-98d0-741c8f0ed744-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-fpwbv\" (UID: \"5d4b81ea-762e-4271-98d0-741c8f0ed744\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"
Sep 08 15:22:50.287611 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.287505    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh8bt\" (UniqueName: \"kubernetes.io/projected/5d4b81ea-762e-4271-98d0-741c8f0ed744-kube-api-access-lh8bt\") pod \"payload-pre-processing-59fbc47bf8-fpwbv\" (UID: \"5d4b81ea-762e-4271-98d0-741c8f0ed744\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"
Sep 08 15:22:50.287611 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.287574    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d4b81ea-762e-4271-98d0-741c8f0ed744-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-fpwbv\" (UID: \"5d4b81ea-762e-4271-98d0-741c8f0ed744\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"
Sep 08 15:22:50.288105 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.287657    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rr5c\" (UniqueName: \"kubernetes.io/projected/65264b73-4245-42ac-bc84-84b9c2b0dcef-kube-api-access-7rr5c\") pod \"payload-processing-5b54b7fbb7-pn2lc\" (UID: \"65264b73-4245-42ac-bc84-84b9c2b0dcef\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"
Sep 08 15:22:50.288105 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.287685    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65264b73-4245-42ac-bc84-84b9c2b0dcef-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pn2lc\" (UID: \"65264b73-4245-42ac-bc84-84b9c2b0dcef\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"
Sep 08 15:22:50.288256 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.288236    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d4b81ea-762e-4271-98d0-741c8f0ed744-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-fpwbv\" (UID: \"5d4b81ea-762e-4271-98d0-741c8f0ed744\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"
Sep 08 15:22:50.297780 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.297752    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh8bt\" (UniqueName: \"kubernetes.io/projected/5d4b81ea-762e-4271-98d0-741c8f0ed744-kube-api-access-lh8bt\") pod \"payload-pre-processing-59fbc47bf8-fpwbv\" (UID: \"5d4b81ea-762e-4271-98d0-741c8f0ed744\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"
Sep 08 15:22:50.346971 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.346935    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"
Sep 08 15:22:50.388830 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.388794    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rr5c\" (UniqueName: \"kubernetes.io/projected/65264b73-4245-42ac-bc84-84b9c2b0dcef-kube-api-access-7rr5c\") pod \"payload-processing-5b54b7fbb7-pn2lc\" (UID: \"65264b73-4245-42ac-bc84-84b9c2b0dcef\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"
Sep 08 15:22:50.389000 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.388837    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65264b73-4245-42ac-bc84-84b9c2b0dcef-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pn2lc\" (UID: \"65264b73-4245-42ac-bc84-84b9c2b0dcef\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"
Sep 08 15:22:50.389523 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.389502    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65264b73-4245-42ac-bc84-84b9c2b0dcef-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pn2lc\" (UID: \"65264b73-4245-42ac-bc84-84b9c2b0dcef\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"
Sep 08 15:22:50.410218 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.410170    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rr5c\" (UniqueName: \"kubernetes.io/projected/65264b73-4245-42ac-bc84-84b9c2b0dcef-kube-api-access-7rr5c\") pod \"payload-processing-5b54b7fbb7-pn2lc\" (UID: \"65264b73-4245-42ac-bc84-84b9c2b0dcef\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"
Sep 08 15:22:50.453597 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.453558    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"
Sep 08 15:22:50.645431 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.645187    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"]
Sep 08 15:22:50.647501 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:22:50.647457    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4b81ea_762e_4271_98d0_741c8f0ed744.slice/crio-0c91adc015df6fa63ee38c9f1e371b1160efea90ec8caf81cfd26871559eeb73 WatchSource:0}: Error finding container 0c91adc015df6fa63ee38c9f1e371b1160efea90ec8caf81cfd26871559eeb73: Status 404 returned error can't find the container with id 0c91adc015df6fa63ee38c9f1e371b1160efea90ec8caf81cfd26871559eeb73
Sep 08 15:22:50.745867 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.745837    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"]
Sep 08 15:22:50.746676 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:22:50.746651    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65264b73_4245_42ac_bc84_84b9c2b0dcef.slice/crio-29306b05b0d73e24757c484f648b532f7b43914ad1a0b757e27d955eb52b8927 WatchSource:0}: Error finding container 29306b05b0d73e24757c484f648b532f7b43914ad1a0b757e27d955eb52b8927: Status 404 returned error can't find the container with id 29306b05b0d73e24757c484f648b532f7b43914ad1a0b757e27d955eb52b8927
Sep 08 15:22:50.781571 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.781539    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv" event={"ID":"5d4b81ea-762e-4271-98d0-741c8f0ed744","Type":"ContainerStarted","Data":"0c91adc015df6fa63ee38c9f1e371b1160efea90ec8caf81cfd26871559eeb73"}
Sep 08 15:22:50.782905 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.782885    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc" event={"ID":"65264b73-4245-42ac-bc84-84b9c2b0dcef","Type":"ContainerStarted","Data":"29306b05b0d73e24757c484f648b532f7b43914ad1a0b757e27d955eb52b8927"}
Sep 08 15:22:50.993978 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.993875    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:50.997057 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:50.997026    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls\") pod \"maas-api-b858864dd-ttlnz\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") " pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:51.046820 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:51.046784    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:51.336301 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:51.336256    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"]
Sep 08 15:22:51.339716 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:22:51.339683    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b64c86_a349_4414_a003_bb41f3c562da.slice/crio-23044067c5f709c2ec174335394ad594db0229a33ac59483632a78c1b0061289 WatchSource:0}: Error finding container 23044067c5f709c2ec174335394ad594db0229a33ac59483632a78c1b0061289: Status 404 returned error can't find the container with id 23044067c5f709c2ec174335394ad594db0229a33ac59483632a78c1b0061289
Sep 08 15:22:51.793587 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:51.793482    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz" event={"ID":"43b64c86-a349-4414-a003-bb41f3c562da","Type":"ContainerStarted","Data":"23044067c5f709c2ec174335394ad594db0229a33ac59483632a78c1b0061289"}
Sep 08 15:22:52.804917 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:52.804870    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv" event={"ID":"5d4b81ea-762e-4271-98d0-741c8f0ed744","Type":"ContainerStarted","Data":"889dd5fd514005812de680ee460d167b68af2acbf0e36f6c3efc05a9a819d956"}
Sep 08 15:22:52.805340 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:52.804987    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"
Sep 08 15:22:52.830812 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:52.829335    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv" podStartSLOduration=2.1565500220000002 podStartE2EDuration="3.829313359s" totalImagesPullingTime="1.672763337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:52.82616257 +0000 UTC m=+833.397708613" watchObservedRunningTime="2026-09-08 15:22:52.829313359 +0000 UTC m=+833.400859402"
Sep 08 15:22:53.815410 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:53.815237    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz" event={"ID":"43b64c86-a349-4414-a003-bb41f3c562da","Type":"ContainerStarted","Data":"d062fb3715041db2a727eb7b626cc5b2a8b9007a2c5df6b6f70c4dae998d15e4"}
Sep 08 15:22:53.815903 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:53.815461    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:22:53.817335 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:53.817304    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc" event={"ID":"65264b73-4245-42ac-bc84-84b9c2b0dcef","Type":"ContainerStarted","Data":"fdf8642de956fa333f08c2b70253c098f505929be45fc5d601d4f1d6cabae7e4"}
Sep 08 15:22:53.817522 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:53.817499    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"
Sep 08 15:22:53.849511 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:53.849454    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz" podStartSLOduration=2.677406637 podStartE2EDuration="4.849433948s" totalImagesPullingTime="2.172027311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:53.848385132 +0000 UTC m=+834.419931174" watchObservedRunningTime="2026-09-08 15:22:53.849433948 +0000 UTC m=+834.420979989"
Sep 08 15:22:53.877310 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:53.877234    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc" podStartSLOduration=1.111526991 podStartE2EDuration="3.877211374s" totalImagesPullingTime="2.765684383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:53.876091405 +0000 UTC m=+834.447637449" watchObservedRunningTime="2026-09-08 15:22:53.877211374 +0000 UTC m=+834.448757417"
Sep 08 15:22:59.833516 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:22:59.833482    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:23:03.820591 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:03.820562    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-fpwbv"
Sep 08 15:23:04.829820 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:04.829792    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pn2lc"
Sep 08 15:23:38.155181 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.155147    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"]
Sep 08 15:23:38.159588 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.159566    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.163827 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.163802    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 15:23:38.163958 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.163865    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p82cs\""
Sep 08 15:23:38.163958 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.163865    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 08 15:23:38.164117 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.164104    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 15:23:38.169969 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.169942    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"]
Sep 08 15:23:38.224279 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.224242    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dl2v\" (UniqueName: \"kubernetes.io/projected/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-kube-api-access-7dl2v\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.224461 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.224291    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.224461 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.224315    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.224461 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.224342    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.224461 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.224369    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.224461 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.224419    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.325208 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.325164    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.325208 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.325215    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.325446 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.325257    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.325446 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.325300    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dl2v\" (UniqueName: \"kubernetes.io/projected/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-kube-api-access-7dl2v\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.325446 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.325339    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.325651 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.325455    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.325651 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.325583    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.325768 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.325671    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.325768 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.325748    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.327800 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.327777    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.327992 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.327972    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.334504 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.334478    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dl2v\" (UniqueName: \"kubernetes.io/projected/2d5b1b36-30ed-4c26-b8d1-dc616be91d10-kube-api-access-7dl2v\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96\" (UID: \"2d5b1b36-30ed-4c26-b8d1-dc616be91d10\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.471582 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.471464    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:38.767814 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:38.767781    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"]
Sep 08 15:23:38.768688 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:23:38.768664    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5b1b36_30ed_4c26_b8d1_dc616be91d10.slice/crio-6b6c0c08a68bd5eb1b441d74b95ced263d5ed38573b61126c3713279d660f069 WatchSource:0}: Error finding container 6b6c0c08a68bd5eb1b441d74b95ced263d5ed38573b61126c3713279d660f069: Status 404 returned error can't find the container with id 6b6c0c08a68bd5eb1b441d74b95ced263d5ed38573b61126c3713279d660f069
Sep 08 15:23:39.094832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:39.094793    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96" event={"ID":"2d5b1b36-30ed-4c26-b8d1-dc616be91d10","Type":"ContainerStarted","Data":"6b6c0c08a68bd5eb1b441d74b95ced263d5ed38573b61126c3713279d660f069"}
Sep 08 15:23:40.102428 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:40.102380    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96" event={"ID":"2d5b1b36-30ed-4c26-b8d1-dc616be91d10","Type":"ContainerStarted","Data":"fc941198defa85d459e5a473422a23ffd8e142432da2ca51fa2e7c501858c11c"}
Sep 08 15:23:40.125039 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:40.124985    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96" podStartSLOduration=1.08698885 podStartE2EDuration="2.124968055s" totalImagesPullingTime="1.037979205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:23:40.12338784 +0000 UTC m=+880.694933880" watchObservedRunningTime="2026-09-08 15:23:40.124968055 +0000 UTC m=+880.696514094"
Sep 08 15:23:48.472427 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:48.472390    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:48.472835 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:48.472449    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:48.486009 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:48.485981    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:23:49.166393 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:23:49.166360    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96"
Sep 08 15:25:35.804351 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:35.804261    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cdf6bbbfd-rxv7k"]
Sep 08 15:25:35.807023 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:35.807002    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cdf6bbbfd-rxv7k"
Sep 08 15:25:35.811424 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:35.811391    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 08 15:25:35.811424 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:35.811394    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mtxln\""
Sep 08 15:25:35.827730 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:35.827696    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cdf6bbbfd-rxv7k"]
Sep 08 15:25:35.958989 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:35.958952    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7f9l\" (UniqueName: \"kubernetes.io/projected/fb7a9884-f97c-41e6-86bc-12bf8f08f2f3-kube-api-access-d7f9l\") pod \"authorino-5cdf6bbbfd-rxv7k\" (UID: \"fb7a9884-f97c-41e6-86bc-12bf8f08f2f3\") " pod="kuadrant-system/authorino-5cdf6bbbfd-rxv7k"
Sep 08 15:25:35.959178 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:35.959012    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb7a9884-f97c-41e6-86bc-12bf8f08f2f3-tls-cert\") pod \"authorino-5cdf6bbbfd-rxv7k\" (UID: \"fb7a9884-f97c-41e6-86bc-12bf8f08f2f3\") " pod="kuadrant-system/authorino-5cdf6bbbfd-rxv7k"
Sep 08 15:25:36.059693 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:36.059583    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb7a9884-f97c-41e6-86bc-12bf8f08f2f3-tls-cert\") pod \"authorino-5cdf6bbbfd-rxv7k\" (UID: \"fb7a9884-f97c-41e6-86bc-12bf8f08f2f3\") " pod="kuadrant-system/authorino-5cdf6bbbfd-rxv7k"
Sep 08 15:25:36.059873 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:36.059730    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7f9l\" (UniqueName: \"kubernetes.io/projected/fb7a9884-f97c-41e6-86bc-12bf8f08f2f3-kube-api-access-d7f9l\") pod \"authorino-5cdf6bbbfd-rxv7k\" (UID: \"fb7a9884-f97c-41e6-86bc-12bf8f08f2f3\") " pod="kuadrant-system/authorino-5cdf6bbbfd-rxv7k"
Sep 08 15:25:36.062125 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:36.062104    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb7a9884-f97c-41e6-86bc-12bf8f08f2f3-tls-cert\") pod \"authorino-5cdf6bbbfd-rxv7k\" (UID: \"fb7a9884-f97c-41e6-86bc-12bf8f08f2f3\") " pod="kuadrant-system/authorino-5cdf6bbbfd-rxv7k"
Sep 08 15:25:36.069601 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:36.069574    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7f9l\" (UniqueName: \"kubernetes.io/projected/fb7a9884-f97c-41e6-86bc-12bf8f08f2f3-kube-api-access-d7f9l\") pod \"authorino-5cdf6bbbfd-rxv7k\" (UID: \"fb7a9884-f97c-41e6-86bc-12bf8f08f2f3\") " pod="kuadrant-system/authorino-5cdf6bbbfd-rxv7k"
Sep 08 15:25:36.116189 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:36.116152    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cdf6bbbfd-rxv7k"
Sep 08 15:25:36.391000 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:36.390966    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cdf6bbbfd-rxv7k"]
Sep 08 15:25:36.392677 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:25:36.392650    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb7a9884_f97c_41e6_86bc_12bf8f08f2f3.slice/crio-4aec3fd5addeb5e310d5728ef7e1ced13313f13bfb0b4c8ef8da93a8ff96a769 WatchSource:0}: Error finding container 4aec3fd5addeb5e310d5728ef7e1ced13313f13bfb0b4c8ef8da93a8ff96a769: Status 404 returned error can't find the container with id 4aec3fd5addeb5e310d5728ef7e1ced13313f13bfb0b4c8ef8da93a8ff96a769
Sep 08 15:25:36.394201 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:36.394179    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:25:36.790352 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:36.790272    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cdf6bbbfd-rxv7k" event={"ID":"fb7a9884-f97c-41e6-86bc-12bf8f08f2f3","Type":"ContainerStarted","Data":"4aec3fd5addeb5e310d5728ef7e1ced13313f13bfb0b4c8ef8da93a8ff96a769"}
Sep 08 15:25:37.798441 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:37.798404    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cdf6bbbfd-rxv7k" event={"ID":"fb7a9884-f97c-41e6-86bc-12bf8f08f2f3","Type":"ContainerStarted","Data":"7f8a044c43599792b893b0b50d816ce819f8895b061835d47f8be874d5ffb21c"}
Sep 08 15:25:37.819112 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:25:37.819062    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cdf6bbbfd-rxv7k" podStartSLOduration=2.420113281 podStartE2EDuration="2.819043169s" totalImagesPullingTime="398.929888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:37.817229065 +0000 UTC m=+998.388775106" watchObservedRunningTime="2026-09-08 15:25:37.819043169 +0000 UTC m=+998.390589210"
Sep 08 15:26:00.448420 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.448384    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"]
Sep 08 15:26:00.453717 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.453696    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:00.456198 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.456177    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d8e721-serving-cert\""
Sep 08 15:26:00.463956 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.463932    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"]
Sep 08 15:26:00.560955 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.560915    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-maas-api-tls\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:00.561124 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.560972    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33112609-c0bb-4b70-b6a1-3183829bc070-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:00.561124 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.561089    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-metrics-certs\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:00.561200 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.561129    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc626\" (UniqueName: \"kubernetes.io/projected/33112609-c0bb-4b70-b6a1-3183829bc070-kube-api-access-nc626\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:00.661872 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.661835    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33112609-c0bb-4b70-b6a1-3183829bc070-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:00.662052 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.661903    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-metrics-certs\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:00.662052 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.661930    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc626\" (UniqueName: \"kubernetes.io/projected/33112609-c0bb-4b70-b6a1-3183829bc070-kube-api-access-nc626\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:00.662052 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.662001    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-maas-api-tls\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:00.662243 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:26:00.662114    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-serving-cert: secret "maas-api-e2e-inf-a-d8e721-serving-cert" not found
Sep 08 15:26:00.662243 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:26:00.662187    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-maas-api-tls podName:33112609-c0bb-4b70-b6a1-3183829bc070 nodeName:}" failed. No retries permitted until 2026-09-08 15:26:01.162165973 +0000 UTC m=+1021.733711996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-maas-api-tls") pod "maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb" (UID: "33112609-c0bb-4b70-b6a1-3183829bc070") : secret "maas-api-e2e-inf-a-d8e721-serving-cert" not found
Sep 08 15:26:00.662507 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.662489    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33112609-c0bb-4b70-b6a1-3183829bc070-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:00.664491 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.664470    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-metrics-certs\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:00.673087 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:00.673067    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc626\" (UniqueName: \"kubernetes.io/projected/33112609-c0bb-4b70-b6a1-3183829bc070-kube-api-access-nc626\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:01.098992 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.098960    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"]
Sep 08 15:26:01.102590 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.102570    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:26:01.105154 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.105132    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-d8e721\""
Sep 08 15:26:01.105390 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.105370    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-d8e721-dockercfg-kxrzd\""
Sep 08 15:26:01.111876 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.111854    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"]
Sep 08 15:26:01.167316 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.167270    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d\" (UID: \"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:26:01.167512 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.167393    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-maas-api-tls\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:01.167512 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.167431    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j87z\" (UniqueName: \"kubernetes.io/projected/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-kube-api-access-9j87z\") pod \"payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d\" (UID: \"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:26:01.170026 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.170004    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-maas-api-tls\") pod \"maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:01.268044 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.268012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d\" (UID: \"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:26:01.268261 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.268059    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j87z\" (UniqueName: \"kubernetes.io/projected/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-kube-api-access-9j87z\") pod \"payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d\" (UID: \"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:26:01.268873 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.268848    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d\" (UID: \"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:26:01.276659 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.276599    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j87z\" (UniqueName: \"kubernetes.io/projected/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-kube-api-access-9j87z\") pod \"payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d\" (UID: \"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:26:01.367436 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.367342    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:01.415523 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.415247    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:26:01.641056 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.641027    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"]
Sep 08 15:26:01.642457 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:26:01.642434    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33112609_c0bb_4b70_b6a1_3183829bc070.slice/crio-682aa2cfe51d7e8cba3e594d6946134729aadf1da72ec5c07c21714ccd29b0e0 WatchSource:0}: Error finding container 682aa2cfe51d7e8cba3e594d6946134729aadf1da72ec5c07c21714ccd29b0e0: Status 404 returned error can't find the container with id 682aa2cfe51d7e8cba3e594d6946134729aadf1da72ec5c07c21714ccd29b0e0
Sep 08 15:26:01.703210 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.703175    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"]
Sep 08 15:26:01.711302 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:26:01.711275    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19ebbaf_c2f7_4af5_ba8a_4eca80d91066.slice/crio-fdc5254676418cea6155e03178e1b803a4eeb957e3d7480128bd52a982a1fa52 WatchSource:0}: Error finding container fdc5254676418cea6155e03178e1b803a4eeb957e3d7480128bd52a982a1fa52: Status 404 returned error can't find the container with id fdc5254676418cea6155e03178e1b803a4eeb957e3d7480128bd52a982a1fa52
Sep 08 15:26:01.947963 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.947855    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d" event={"ID":"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066","Type":"ContainerStarted","Data":"826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512"}
Sep 08 15:26:01.947963 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.947941    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d" event={"ID":"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066","Type":"ContainerStarted","Data":"fdc5254676418cea6155e03178e1b803a4eeb957e3d7480128bd52a982a1fa52"}
Sep 08 15:26:01.948200 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.947992    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:26:01.949227 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.949205    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb" event={"ID":"33112609-c0bb-4b70-b6a1-3183829bc070","Type":"ContainerStarted","Data":"682aa2cfe51d7e8cba3e594d6946134729aadf1da72ec5c07c21714ccd29b0e0"}
Sep 08 15:26:01.968134 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:01.968087    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d" podStartSLOduration=0.968072365 podStartE2EDuration="968.072365ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:26:01.964759531 +0000 UTC m=+1022.536305571" watchObservedRunningTime="2026-09-08 15:26:01.968072365 +0000 UTC m=+1022.539618435"
Sep 08 15:26:02.965108 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:02.965072    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb" event={"ID":"33112609-c0bb-4b70-b6a1-3183829bc070","Type":"ContainerStarted","Data":"73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2"}
Sep 08 15:26:02.965572 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:02.965297    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:08.935404 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:08.935346    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb" podStartSLOduration=8.457242575 podStartE2EDuration="8.93532799s" totalImagesPullingTime="478.085415ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:26:02.998316039 +0000 UTC m=+1023.569862080" watchObservedRunningTime="2026-09-08 15:26:08.93532799 +0000 UTC m=+1029.506874031"
Sep 08 15:26:08.936467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:08.936448    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"]
Sep 08 15:26:08.941395 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:08.941376    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:08.944240 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:08.944221    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-062f32f0\""
Sep 08 15:26:08.944326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:08.944238    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-062f32f0-dockercfg-q9x6z\""
Sep 08 15:26:08.951663 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:08.951638    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"]
Sep 08 15:26:08.971961 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:08.971921    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"]
Sep 08 15:26:08.975974 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:08.975955    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:08.976978 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:08.976957    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:26:08.984670 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:08.984644    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"]
Sep 08 15:26:09.039751 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.039718    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztjs7\" (UniqueName: \"kubernetes.io/projected/a05e063b-0902-4d47-bd24-b6f10468fd6a-kube-api-access-ztjs7\") pod \"payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s\" (UID: \"a05e063b-0902-4d47-bd24-b6f10468fd6a\") " pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:09.039955 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.039753    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg79r\" (UniqueName: \"kubernetes.io/projected/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-kube-api-access-gg79r\") pod \"payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl\" (UID: \"9f8c5730-013b-4ab9-b6fa-e5965e6c6247\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:09.039955 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.039921    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl\" (UID: \"9f8c5730-013b-4ab9-b6fa-e5965e6c6247\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:09.040074 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.040047    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a05e063b-0902-4d47-bd24-b6f10468fd6a-plugins-config-volume\") pod \"payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s\" (UID: \"a05e063b-0902-4d47-bd24-b6f10468fd6a\") " pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:09.140907 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.140871    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztjs7\" (UniqueName: \"kubernetes.io/projected/a05e063b-0902-4d47-bd24-b6f10468fd6a-kube-api-access-ztjs7\") pod \"payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s\" (UID: \"a05e063b-0902-4d47-bd24-b6f10468fd6a\") " pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:09.140907 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.140909    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg79r\" (UniqueName: \"kubernetes.io/projected/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-kube-api-access-gg79r\") pod \"payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl\" (UID: \"9f8c5730-013b-4ab9-b6fa-e5965e6c6247\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:09.141118 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.140956    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl\" (UID: \"9f8c5730-013b-4ab9-b6fa-e5965e6c6247\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:09.141118 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.141004    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a05e063b-0902-4d47-bd24-b6f10468fd6a-plugins-config-volume\") pod \"payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s\" (UID: \"a05e063b-0902-4d47-bd24-b6f10468fd6a\") " pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:09.141704 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.141686    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a05e063b-0902-4d47-bd24-b6f10468fd6a-plugins-config-volume\") pod \"payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s\" (UID: \"a05e063b-0902-4d47-bd24-b6f10468fd6a\") " pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:09.141758 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.141693    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl\" (UID: \"9f8c5730-013b-4ab9-b6fa-e5965e6c6247\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:09.150561 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.150532    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg79r\" (UniqueName: \"kubernetes.io/projected/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-kube-api-access-gg79r\") pod \"payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl\" (UID: \"9f8c5730-013b-4ab9-b6fa-e5965e6c6247\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:09.150714 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.150570    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztjs7\" (UniqueName: \"kubernetes.io/projected/a05e063b-0902-4d47-bd24-b6f10468fd6a-kube-api-access-ztjs7\") pod \"payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s\" (UID: \"a05e063b-0902-4d47-bd24-b6f10468fd6a\") " pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:09.252937 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.252862    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:09.290355 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.290317    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:09.534132 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.534099    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"]
Sep 08 15:26:09.535091 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:26:09.535067    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05e063b_0902_4d47_bd24_b6f10468fd6a.slice/crio-da3de9d630eb322f46b37283be38e266cba9bf05e2e3e7c7b2168253992d937f WatchSource:0}: Error finding container da3de9d630eb322f46b37283be38e266cba9bf05e2e3e7c7b2168253992d937f: Status 404 returned error can't find the container with id da3de9d630eb322f46b37283be38e266cba9bf05e2e3e7c7b2168253992d937f
Sep 08 15:26:09.580005 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:09.579806    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"]
Sep 08 15:26:09.581884 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:26:09.581856    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8c5730_013b_4ab9_b6fa_e5965e6c6247.slice/crio-73fde7520ec41c2a8babc1a116ae2fbad286e1eca68e5616d6832bb8e141dd1d WatchSource:0}: Error finding container 73fde7520ec41c2a8babc1a116ae2fbad286e1eca68e5616d6832bb8e141dd1d: Status 404 returned error can't find the container with id 73fde7520ec41c2a8babc1a116ae2fbad286e1eca68e5616d6832bb8e141dd1d
Sep 08 15:26:10.009210 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.009176    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl" event={"ID":"9f8c5730-013b-4ab9-b6fa-e5965e6c6247","Type":"ContainerStarted","Data":"a0f40ed9740201109d2988dcbbfb416c22123112ff63ea82da3d12afbd329459"}
Sep 08 15:26:10.009721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.009232    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl" event={"ID":"9f8c5730-013b-4ab9-b6fa-e5965e6c6247","Type":"ContainerStarted","Data":"73fde7520ec41c2a8babc1a116ae2fbad286e1eca68e5616d6832bb8e141dd1d"}
Sep 08 15:26:10.009721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.009258    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:10.010980 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.010953    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s" event={"ID":"a05e063b-0902-4d47-bd24-b6f10468fd6a","Type":"ContainerStarted","Data":"44de22a56c27b0464c8cc25e6c59cadf4644fe13e2db83ee679802f620acfb77"}
Sep 08 15:26:10.011085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.010994    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s" event={"ID":"a05e063b-0902-4d47-bd24-b6f10468fd6a","Type":"ContainerStarted","Data":"da3de9d630eb322f46b37283be38e266cba9bf05e2e3e7c7b2168253992d937f"}
Sep 08 15:26:10.011085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.011013    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:10.028754 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.028702    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl" podStartSLOduration=2.028687159 podStartE2EDuration="2.028687159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:26:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:26:10.027139811 +0000 UTC m=+1030.598685856" watchObservedRunningTime="2026-09-08 15:26:10.028687159 +0000 UTC m=+1030.600233199"
Sep 08 15:26:10.046684 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.046637    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s" podStartSLOduration=2.046605864 podStartE2EDuration="2.046605864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:26:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:26:10.045376914 +0000 UTC m=+1030.616922955" watchObservedRunningTime="2026-09-08 15:26:10.046605864 +0000 UTC m=+1030.618151904"
Sep 08 15:26:10.604316 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.604275    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"]
Sep 08 15:26:10.609008 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.608985    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:26:10.612139 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.612115    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-3bc9dc\""
Sep 08 15:26:10.612241 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.612143    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-3bc9dc-dockercfg-hnbnz\""
Sep 08 15:26:10.617508 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.617484    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"]
Sep 08 15:26:10.656374 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.656297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj6tx\" (UniqueName: \"kubernetes.io/projected/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-kube-api-access-cj6tx\") pod \"payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n\" (UID: \"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc\") " pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:26:10.656583 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.656448    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-plugins-config-volume\") pod \"payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n\" (UID: \"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc\") " pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:26:10.756994 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.756959    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj6tx\" (UniqueName: \"kubernetes.io/projected/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-kube-api-access-cj6tx\") pod \"payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n\" (UID: \"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc\") " pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:26:10.757178 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.757033    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-plugins-config-volume\") pod \"payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n\" (UID: \"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc\") " pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:26:10.757810 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.757790    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-plugins-config-volume\") pod \"payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n\" (UID: \"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc\") " pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:26:10.765836 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.765817    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj6tx\" (UniqueName: \"kubernetes.io/projected/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-kube-api-access-cj6tx\") pod \"payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n\" (UID: \"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc\") " pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:26:10.923906 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:10.923811    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:26:11.199607 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:11.199580    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"]
Sep 08 15:26:11.201211 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:26:11.201184    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b5eab2_cb5d_45c1_8450_d9bcf32dd8fc.slice/crio-849b564f89c94c01717d42d339d9bd3131939ef63e82e875f569af32ccb33204 WatchSource:0}: Error finding container 849b564f89c94c01717d42d339d9bd3131939ef63e82e875f569af32ccb33204: Status 404 returned error can't find the container with id 849b564f89c94c01717d42d339d9bd3131939ef63e82e875f569af32ccb33204
Sep 08 15:26:12.029237 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:12.029202    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n" event={"ID":"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc","Type":"ContainerStarted","Data":"fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8"}
Sep 08 15:26:12.029415 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:12.029258    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n" event={"ID":"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc","Type":"ContainerStarted","Data":"849b564f89c94c01717d42d339d9bd3131939ef63e82e875f569af32ccb33204"}
Sep 08 15:26:12.029415 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:12.029283    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:26:12.056134 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:12.056065    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n" podStartSLOduration=2.05604303 podStartE2EDuration="2.05604303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:26:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:26:12.055203617 +0000 UTC m=+1032.626749657" watchObservedRunningTime="2026-09-08 15:26:12.05604303 +0000 UTC m=+1032.627589072"
Sep 08 15:26:12.967439 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:12.967408    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:26:21.023703 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:21.023667    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:21.024085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:21.023755    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:23.038687 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:23.038657    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:26:49.010024 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.009988    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"]
Sep 08 15:26:49.010687 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.010291    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s" podUID="a05e063b-0902-4d47-bd24-b6f10468fd6a" containerName="payload-processing" containerID="cri-o://44de22a56c27b0464c8cc25e6c59cadf4644fe13e2db83ee679802f620acfb77" gracePeriod=30
Sep 08 15:26:49.022113 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.022075    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"]
Sep 08 15:26:49.022553 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.022523    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl" podUID="9f8c5730-013b-4ab9-b6fa-e5965e6c6247" containerName="payload-pre-processing" containerID="cri-o://a0f40ed9740201109d2988dcbbfb416c22123112ff63ea82da3d12afbd329459" gracePeriod=30
Sep 08 15:26:49.263520 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.263427    2566 generic.go:356] "Generic (PLEG): container finished" podID="9f8c5730-013b-4ab9-b6fa-e5965e6c6247" containerID="a0f40ed9740201109d2988dcbbfb416c22123112ff63ea82da3d12afbd329459" exitCode=0
Sep 08 15:26:49.263520 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.263499    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl" event={"ID":"9f8c5730-013b-4ab9-b6fa-e5965e6c6247","Type":"ContainerDied","Data":"a0f40ed9740201109d2988dcbbfb416c22123112ff63ea82da3d12afbd329459"}
Sep 08 15:26:49.265343 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.265319    2566 generic.go:356] "Generic (PLEG): container finished" podID="a05e063b-0902-4d47-bd24-b6f10468fd6a" containerID="44de22a56c27b0464c8cc25e6c59cadf4644fe13e2db83ee679802f620acfb77" exitCode=0
Sep 08 15:26:49.265449 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.265398    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s" event={"ID":"a05e063b-0902-4d47-bd24-b6f10468fd6a","Type":"ContainerDied","Data":"44de22a56c27b0464c8cc25e6c59cadf4644fe13e2db83ee679802f620acfb77"}
Sep 08 15:26:49.328459 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.328431    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:49.330566 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.330531    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:49.409372 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.409345    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztjs7\" (UniqueName: \"kubernetes.io/projected/a05e063b-0902-4d47-bd24-b6f10468fd6a-kube-api-access-ztjs7\") pod \"a05e063b-0902-4d47-bd24-b6f10468fd6a\" (UID: \"a05e063b-0902-4d47-bd24-b6f10468fd6a\") "
Sep 08 15:26:49.409372 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.409375    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a05e063b-0902-4d47-bd24-b6f10468fd6a-plugins-config-volume\") pod \"a05e063b-0902-4d47-bd24-b6f10468fd6a\" (UID: \"a05e063b-0902-4d47-bd24-b6f10468fd6a\") "
Sep 08 15:26:49.409613 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.409434    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-plugins-config-volume\") pod \"9f8c5730-013b-4ab9-b6fa-e5965e6c6247\" (UID: \"9f8c5730-013b-4ab9-b6fa-e5965e6c6247\") "
Sep 08 15:26:49.409613 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.409461    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg79r\" (UniqueName: \"kubernetes.io/projected/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-kube-api-access-gg79r\") pod \"9f8c5730-013b-4ab9-b6fa-e5965e6c6247\" (UID: \"9f8c5730-013b-4ab9-b6fa-e5965e6c6247\") "
Sep 08 15:26:49.409891 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.409861    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f8c5730-013b-4ab9-b6fa-e5965e6c6247" (UID: "9f8c5730-013b-4ab9-b6fa-e5965e6c6247"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:26:49.409994 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.409887    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a05e063b-0902-4d47-bd24-b6f10468fd6a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a05e063b-0902-4d47-bd24-b6f10468fd6a" (UID: "a05e063b-0902-4d47-bd24-b6f10468fd6a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:26:49.411791 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.411767    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a05e063b-0902-4d47-bd24-b6f10468fd6a-kube-api-access-ztjs7" (OuterVolumeSpecName: "kube-api-access-ztjs7") pod "a05e063b-0902-4d47-bd24-b6f10468fd6a" (UID: "a05e063b-0902-4d47-bd24-b6f10468fd6a"). InnerVolumeSpecName "kube-api-access-ztjs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:26:49.412315 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.412290    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-kube-api-access-gg79r" (OuterVolumeSpecName: "kube-api-access-gg79r") pod "9f8c5730-013b-4ab9-b6fa-e5965e6c6247" (UID: "9f8c5730-013b-4ab9-b6fa-e5965e6c6247"). InnerVolumeSpecName "kube-api-access-gg79r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:26:49.510188 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.510153    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztjs7\" (UniqueName: \"kubernetes.io/projected/a05e063b-0902-4d47-bd24-b6f10468fd6a-kube-api-access-ztjs7\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:26:49.510188 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.510183    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a05e063b-0902-4d47-bd24-b6f10468fd6a-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:26:49.510188 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.510193    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:26:49.510431 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:49.510204    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg79r\" (UniqueName: \"kubernetes.io/projected/9f8c5730-013b-4ab9-b6fa-e5965e6c6247-kube-api-access-gg79r\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:26:50.272877 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:50.272785    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl" event={"ID":"9f8c5730-013b-4ab9-b6fa-e5965e6c6247","Type":"ContainerDied","Data":"73fde7520ec41c2a8babc1a116ae2fbad286e1eca68e5616d6832bb8e141dd1d"}
Sep 08 15:26:50.272877 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:50.272803    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"
Sep 08 15:26:50.272877 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:50.272853    2566 scope.go:117] "RemoveContainer" containerID="a0f40ed9740201109d2988dcbbfb416c22123112ff63ea82da3d12afbd329459"
Sep 08 15:26:50.274331 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:50.274309    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"
Sep 08 15:26:50.274413 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:50.274306    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s" event={"ID":"a05e063b-0902-4d47-bd24-b6f10468fd6a","Type":"ContainerDied","Data":"da3de9d630eb322f46b37283be38e266cba9bf05e2e3e7c7b2168253992d937f"}
Sep 08 15:26:50.283172 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:50.283143    2566 scope.go:117] "RemoveContainer" containerID="44de22a56c27b0464c8cc25e6c59cadf4644fe13e2db83ee679802f620acfb77"
Sep 08 15:26:50.299985 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:50.299960    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"]
Sep 08 15:26:50.310589 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:50.310562    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-062f32f0-85ddd54f7c-wf55s"]
Sep 08 15:26:50.329673 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:50.329640    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"]
Sep 08 15:26:50.338309 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:50.338275    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-062f32f0-58b8bf6b98-2dqkl"]
Sep 08 15:26:51.914855 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:51.914783    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f8c5730-013b-4ab9-b6fa-e5965e6c6247" path="/var/lib/kubelet/pods/9f8c5730-013b-4ab9-b6fa-e5965e6c6247/volumes"
Sep 08 15:26:51.915238 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:51.915143    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a05e063b-0902-4d47-bd24-b6f10468fd6a" path="/var/lib/kubelet/pods/a05e063b-0902-4d47-bd24-b6f10468fd6a/volumes"
Sep 08 15:26:54.195678 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.195638    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"]
Sep 08 15:26:54.196107 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.196094    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a05e063b-0902-4d47-bd24-b6f10468fd6a" containerName="payload-processing"
Sep 08 15:26:54.196149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.196110    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a05e063b-0902-4d47-bd24-b6f10468fd6a" containerName="payload-processing"
Sep 08 15:26:54.196149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.196140    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8c5730-013b-4ab9-b6fa-e5965e6c6247" containerName="payload-pre-processing"
Sep 08 15:26:54.196149 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.196146    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8c5730-013b-4ab9-b6fa-e5965e6c6247" containerName="payload-pre-processing"
Sep 08 15:26:54.196244 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.196212    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a05e063b-0902-4d47-bd24-b6f10468fd6a" containerName="payload-processing"
Sep 08 15:26:54.196244 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.196223    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8c5730-013b-4ab9-b6fa-e5965e6c6247" containerName="payload-pre-processing"
Sep 08 15:26:54.200764 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.200747    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:26:54.203694 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.203670    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d1aa3ad8-dockercfg-5xx27\""
Sep 08 15:26:54.203800 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.203699    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d1aa3ad8\""
Sep 08 15:26:54.211679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.211653    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"]
Sep 08 15:26:54.245405 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.245372    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k85t\" (UniqueName: \"kubernetes.io/projected/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-kube-api-access-4k85t\") pod \"payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th\" (UID: \"2e5b52f2-228d-4027-9dcb-db8bd080dd8c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:26:54.245405 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.245415    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th\" (UID: \"2e5b52f2-228d-4027-9dcb-db8bd080dd8c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:26:54.346684 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.346645    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k85t\" (UniqueName: \"kubernetes.io/projected/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-kube-api-access-4k85t\") pod \"payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th\" (UID: \"2e5b52f2-228d-4027-9dcb-db8bd080dd8c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:26:54.346891 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.346707    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th\" (UID: \"2e5b52f2-228d-4027-9dcb-db8bd080dd8c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:26:54.347528 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.347509    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th\" (UID: \"2e5b52f2-228d-4027-9dcb-db8bd080dd8c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:26:54.362489 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.362461    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k85t\" (UniqueName: \"kubernetes.io/projected/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-kube-api-access-4k85t\") pod \"payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th\" (UID: \"2e5b52f2-228d-4027-9dcb-db8bd080dd8c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:26:54.513281 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.513203    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:26:54.790240 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:54.790209    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"]
Sep 08 15:26:54.792064 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:26:54.792036    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5b52f2_228d_4027_9dcb_db8bd080dd8c.slice/crio-4e6932d5d5fb562763ed73f4a1a05c124f9c38e9998ea5f1bfc82cf9c692be40 WatchSource:0}: Error finding container 4e6932d5d5fb562763ed73f4a1a05c124f9c38e9998ea5f1bfc82cf9c692be40: Status 404 returned error can't find the container with id 4e6932d5d5fb562763ed73f4a1a05c124f9c38e9998ea5f1bfc82cf9c692be40
Sep 08 15:26:55.313508 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:55.313471    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th" event={"ID":"2e5b52f2-228d-4027-9dcb-db8bd080dd8c","Type":"ContainerStarted","Data":"379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c"}
Sep 08 15:26:55.313973 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:55.313601    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:26:55.313973 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:55.313663    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th" event={"ID":"2e5b52f2-228d-4027-9dcb-db8bd080dd8c","Type":"ContainerStarted","Data":"4e6932d5d5fb562763ed73f4a1a05c124f9c38e9998ea5f1bfc82cf9c692be40"}
Sep 08 15:26:55.333417 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:26:55.333366    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th" podStartSLOduration=1.333349242 podStartE2EDuration="1.333349242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:26:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:26:55.331870624 +0000 UTC m=+1075.903416664" watchObservedRunningTime="2026-09-08 15:26:55.333349242 +0000 UTC m=+1075.904895283"
Sep 08 15:27:06.322393 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:06.322362    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:27:35.475440 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:35.475403    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"]
Sep 08 15:27:35.476063 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:35.475686    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th" podUID="2e5b52f2-228d-4027-9dcb-db8bd080dd8c" containerName="payload-pre-processing" containerID="cri-o://379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c" gracePeriod=30
Sep 08 15:27:35.753194 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:35.753165    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:27:35.850402 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:35.850374    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k85t\" (UniqueName: \"kubernetes.io/projected/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-kube-api-access-4k85t\") pod \"2e5b52f2-228d-4027-9dcb-db8bd080dd8c\" (UID: \"2e5b52f2-228d-4027-9dcb-db8bd080dd8c\") "
Sep 08 15:27:35.850578 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:35.850475    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-plugins-config-volume\") pod \"2e5b52f2-228d-4027-9dcb-db8bd080dd8c\" (UID: \"2e5b52f2-228d-4027-9dcb-db8bd080dd8c\") "
Sep 08 15:27:35.850880 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:35.850853    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e5b52f2-228d-4027-9dcb-db8bd080dd8c" (UID: "2e5b52f2-228d-4027-9dcb-db8bd080dd8c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:27:35.852598 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:35.852567    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-kube-api-access-4k85t" (OuterVolumeSpecName: "kube-api-access-4k85t") pod "2e5b52f2-228d-4027-9dcb-db8bd080dd8c" (UID: "2e5b52f2-228d-4027-9dcb-db8bd080dd8c"). InnerVolumeSpecName "kube-api-access-4k85t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:35.952120 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:35.952049    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:27:35.952120 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:35.952083    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k85t\" (UniqueName: \"kubernetes.io/projected/2e5b52f2-228d-4027-9dcb-db8bd080dd8c-kube-api-access-4k85t\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:27:36.573518 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:36.573482    2566 generic.go:356] "Generic (PLEG): container finished" podID="2e5b52f2-228d-4027-9dcb-db8bd080dd8c" containerID="379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c" exitCode=0
Sep 08 15:27:36.574110 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:36.573547    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"
Sep 08 15:27:36.574296 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:36.573544    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th" event={"ID":"2e5b52f2-228d-4027-9dcb-db8bd080dd8c","Type":"ContainerDied","Data":"379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c"}
Sep 08 15:27:36.574296 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:36.574285    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th" event={"ID":"2e5b52f2-228d-4027-9dcb-db8bd080dd8c","Type":"ContainerDied","Data":"4e6932d5d5fb562763ed73f4a1a05c124f9c38e9998ea5f1bfc82cf9c692be40"}
Sep 08 15:27:36.574426 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:36.574336    2566 scope.go:117] "RemoveContainer" containerID="379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c"
Sep 08 15:27:36.591897 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:36.591870    2566 scope.go:117] "RemoveContainer" containerID="379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c"
Sep 08 15:27:36.592817 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:27:36.592762    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c\": container with ID starting with 379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c not found: ID does not exist" containerID="379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c"
Sep 08 15:27:36.593003 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:36.592979    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c"} err="failed to get container status \"379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c\": rpc error: code = NotFound desc = could not find container \"379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c\": container with ID starting with 379c6dc68094caa1530a7eb917f76d2bf191eb36d4478d9ab403e3fdc714200c not found: ID does not exist"
Sep 08 15:27:36.607631 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:36.607578    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"]
Sep 08 15:27:36.616969 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:36.616938    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1aa3ad8-76f6ff67b6-sb9th"]
Sep 08 15:27:37.916126 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:37.916089    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e5b52f2-228d-4027-9dcb-db8bd080dd8c" path="/var/lib/kubelet/pods/2e5b52f2-228d-4027-9dcb-db8bd080dd8c/volumes"
Sep 08 15:27:40.868174 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.868140    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"]
Sep 08 15:27:40.868589 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.868576    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5b52f2-228d-4027-9dcb-db8bd080dd8c" containerName="payload-pre-processing"
Sep 08 15:27:40.868670 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.868591    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5b52f2-228d-4027-9dcb-db8bd080dd8c" containerName="payload-pre-processing"
Sep 08 15:27:40.868721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.868676    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e5b52f2-228d-4027-9dcb-db8bd080dd8c" containerName="payload-pre-processing"
Sep 08 15:27:40.873228 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.873211    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:27:40.876227 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.876205    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9e22317f\""
Sep 08 15:27:40.876362 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.876246    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9e22317f-dockercfg-55trl\""
Sep 08 15:27:40.882602 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.882574    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"]
Sep 08 15:27:40.889926 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.889899    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"]
Sep 08 15:27:40.894348 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.894323    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:27:40.900651 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.899978    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12a9927f-999d-4082-893d-06f53f11dc7f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f\" (UID: \"12a9927f-999d-4082-893d-06f53f11dc7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:27:40.900651 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.900027    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcb2d\" (UniqueName: \"kubernetes.io/projected/12a9927f-999d-4082-893d-06f53f11dc7f-kube-api-access-pcb2d\") pod \"payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f\" (UID: \"12a9927f-999d-4082-893d-06f53f11dc7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:27:40.904293 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:40.904265    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"]
Sep 08 15:27:41.001438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.001406    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75ce4fd5-8a04-441c-863d-318a238c1446-plugins-config-volume\") pod \"payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh\" (UID: \"75ce4fd5-8a04-441c-863d-318a238c1446\") " pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:27:41.001663 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.001483    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12a9927f-999d-4082-893d-06f53f11dc7f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f\" (UID: \"12a9927f-999d-4082-893d-06f53f11dc7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:27:41.001663 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.001515    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcb2d\" (UniqueName: \"kubernetes.io/projected/12a9927f-999d-4082-893d-06f53f11dc7f-kube-api-access-pcb2d\") pod \"payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f\" (UID: \"12a9927f-999d-4082-893d-06f53f11dc7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:27:41.001663 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.001569    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgzqg\" (UniqueName: \"kubernetes.io/projected/75ce4fd5-8a04-441c-863d-318a238c1446-kube-api-access-tgzqg\") pod \"payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh\" (UID: \"75ce4fd5-8a04-441c-863d-318a238c1446\") " pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:27:41.002404 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.002381    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12a9927f-999d-4082-893d-06f53f11dc7f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f\" (UID: \"12a9927f-999d-4082-893d-06f53f11dc7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:27:41.010375 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.010346    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcb2d\" (UniqueName: \"kubernetes.io/projected/12a9927f-999d-4082-893d-06f53f11dc7f-kube-api-access-pcb2d\") pod \"payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f\" (UID: \"12a9927f-999d-4082-893d-06f53f11dc7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:27:41.102044 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.102011    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75ce4fd5-8a04-441c-863d-318a238c1446-plugins-config-volume\") pod \"payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh\" (UID: \"75ce4fd5-8a04-441c-863d-318a238c1446\") " pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:27:41.102231 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.102088    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgzqg\" (UniqueName: \"kubernetes.io/projected/75ce4fd5-8a04-441c-863d-318a238c1446-kube-api-access-tgzqg\") pod \"payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh\" (UID: \"75ce4fd5-8a04-441c-863d-318a238c1446\") " pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:27:41.102745 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.102725    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75ce4fd5-8a04-441c-863d-318a238c1446-plugins-config-volume\") pod \"payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh\" (UID: \"75ce4fd5-8a04-441c-863d-318a238c1446\") " pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:27:41.114396 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.114369    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgzqg\" (UniqueName: \"kubernetes.io/projected/75ce4fd5-8a04-441c-863d-318a238c1446-kube-api-access-tgzqg\") pod \"payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh\" (UID: \"75ce4fd5-8a04-441c-863d-318a238c1446\") " pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:27:41.189144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.189054    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:27:41.207798 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.207768    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:27:41.468140 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.468100    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"]
Sep 08 15:27:41.469331 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:27:41.469308    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a9927f_999d_4082_893d_06f53f11dc7f.slice/crio-5085f23179ac9ccb0fe805af77414163e1d7452e832837a09036d489e45319ac WatchSource:0}: Error finding container 5085f23179ac9ccb0fe805af77414163e1d7452e832837a09036d489e45319ac: Status 404 returned error can't find the container with id 5085f23179ac9ccb0fe805af77414163e1d7452e832837a09036d489e45319ac
Sep 08 15:27:41.501890 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.501867    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"]
Sep 08 15:27:41.503845 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:27:41.503820    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ce4fd5_8a04_441c_863d_318a238c1446.slice/crio-1847cb49f8db1f8b8c2aaec1cac5c922f96f805579c0440c0020235227081e33 WatchSource:0}: Error finding container 1847cb49f8db1f8b8c2aaec1cac5c922f96f805579c0440c0020235227081e33: Status 404 returned error can't find the container with id 1847cb49f8db1f8b8c2aaec1cac5c922f96f805579c0440c0020235227081e33
Sep 08 15:27:41.611160 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.611049    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f" event={"ID":"12a9927f-999d-4082-893d-06f53f11dc7f","Type":"ContainerStarted","Data":"7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913"}
Sep 08 15:27:41.611160 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.611124    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f" event={"ID":"12a9927f-999d-4082-893d-06f53f11dc7f","Type":"ContainerStarted","Data":"5085f23179ac9ccb0fe805af77414163e1d7452e832837a09036d489e45319ac"}
Sep 08 15:27:41.611439 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.611311    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:27:41.612940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.612910    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh" event={"ID":"75ce4fd5-8a04-441c-863d-318a238c1446","Type":"ContainerStarted","Data":"089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19"}
Sep 08 15:27:41.613036 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.612990    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:27:41.613036 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.613012    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh" event={"ID":"75ce4fd5-8a04-441c-863d-318a238c1446","Type":"ContainerStarted","Data":"1847cb49f8db1f8b8c2aaec1cac5c922f96f805579c0440c0020235227081e33"}
Sep 08 15:27:41.627438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.627375    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f" podStartSLOduration=1.627359767 podStartE2EDuration="1.627359767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:27:41.626031279 +0000 UTC m=+1122.197577326" watchObservedRunningTime="2026-09-08 15:27:41.627359767 +0000 UTC m=+1122.198905811"
Sep 08 15:27:41.644146 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:41.644085    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh" podStartSLOduration=1.644070989 podStartE2EDuration="1.644070989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:27:41.64202982 +0000 UTC m=+1122.213575855" watchObservedRunningTime="2026-09-08 15:27:41.644070989 +0000 UTC m=+1122.215617030"
Sep 08 15:27:42.098768 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.098730    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"]
Sep 08 15:27:42.100512 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.099533    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n" podUID="38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc" containerName="payload-processing" containerID="cri-o://fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8" gracePeriod=30
Sep 08 15:27:42.369891 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.369865    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:27:42.415713 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.415680    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj6tx\" (UniqueName: \"kubernetes.io/projected/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-kube-api-access-cj6tx\") pod \"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc\" (UID: \"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc\") "
Sep 08 15:27:42.415895 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.415741    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-plugins-config-volume\") pod \"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc\" (UID: \"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc\") "
Sep 08 15:27:42.416285 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.416262    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc" (UID: "38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:27:42.417993 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.417958    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-kube-api-access-cj6tx" (OuterVolumeSpecName: "kube-api-access-cj6tx") pod "38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc" (UID: "38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc"). InnerVolumeSpecName "kube-api-access-cj6tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:42.516596 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.516564    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj6tx\" (UniqueName: \"kubernetes.io/projected/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-kube-api-access-cj6tx\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:27:42.516596 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.516596    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:27:42.621518 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.621424    2566 generic.go:356] "Generic (PLEG): container finished" podID="38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc" containerID="fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8" exitCode=0
Sep 08 15:27:42.621518 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.621470    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"
Sep 08 15:27:42.621787 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.621508    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n" event={"ID":"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc","Type":"ContainerDied","Data":"fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8"}
Sep 08 15:27:42.621787 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.621574    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n" event={"ID":"38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc","Type":"ContainerDied","Data":"849b564f89c94c01717d42d339d9bd3131939ef63e82e875f569af32ccb33204"}
Sep 08 15:27:42.621787 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.621603    2566 scope.go:117] "RemoveContainer" containerID="fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8"
Sep 08 15:27:42.637171 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.637146    2566 scope.go:117] "RemoveContainer" containerID="fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8"
Sep 08 15:27:42.637561 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:27:42.637536    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8\": container with ID starting with fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8 not found: ID does not exist" containerID="fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8"
Sep 08 15:27:42.637681 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.637567    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8"} err="failed to get container status \"fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8\": rpc error: code = NotFound desc = could not find container \"fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8\": container with ID starting with fb20314ca3d9dcd6a1fdd7262d1918a45a049f56727ecda941fc8bc293a78bd8 not found: ID does not exist"
Sep 08 15:27:42.648795 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.648770    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"]
Sep 08 15:27:42.652708 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:42.652687    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3bc9dc-64c78587d9-6tz5n"]
Sep 08 15:27:43.915257 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:43.915225    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc" path="/var/lib/kubelet/pods/38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc/volumes"
Sep 08 15:27:52.624012 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:52.623982    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:27:52.624404 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:52.624391    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:27:59.933426 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:59.933390    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"]
Sep 08 15:27:59.934032 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:59.934013    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc" containerName="payload-processing"
Sep 08 15:27:59.934032 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:59.934034    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc" containerName="payload-processing"
Sep 08 15:27:59.934219 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:59.934128    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b5eab2-cb5d-45c1-8450-d9bcf32dd8fc" containerName="payload-processing"
Sep 08 15:27:59.937410 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:59.937390    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:27:59.940000 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:59.939979    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-6de9d1-dockercfg-nplz5\""
Sep 08 15:27:59.940459 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:59.940439    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-6de9d1\""
Sep 08 15:27:59.948113 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:27:59.948086    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"]
Sep 08 15:28:00.099270 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.099223    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q78x\" (UniqueName: \"kubernetes.io/projected/44734f29-34b1-45b4-9978-df98c28e4cfa-kube-api-access-2q78x\") pod \"payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk\" (UID: \"44734f29-34b1-45b4-9978-df98c28e4cfa\") " pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:28:00.099465 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.099278    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44734f29-34b1-45b4-9978-df98c28e4cfa-plugins-config-volume\") pod \"payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk\" (UID: \"44734f29-34b1-45b4-9978-df98c28e4cfa\") " pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:28:00.200313 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.200209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q78x\" (UniqueName: \"kubernetes.io/projected/44734f29-34b1-45b4-9978-df98c28e4cfa-kube-api-access-2q78x\") pod \"payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk\" (UID: \"44734f29-34b1-45b4-9978-df98c28e4cfa\") " pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:28:00.200313 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.200250    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44734f29-34b1-45b4-9978-df98c28e4cfa-plugins-config-volume\") pod \"payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk\" (UID: \"44734f29-34b1-45b4-9978-df98c28e4cfa\") " pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:28:00.200909 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.200890    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44734f29-34b1-45b4-9978-df98c28e4cfa-plugins-config-volume\") pod \"payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk\" (UID: \"44734f29-34b1-45b4-9978-df98c28e4cfa\") " pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:28:00.210020 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.209977    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q78x\" (UniqueName: \"kubernetes.io/projected/44734f29-34b1-45b4-9978-df98c28e4cfa-kube-api-access-2q78x\") pod \"payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk\" (UID: \"44734f29-34b1-45b4-9978-df98c28e4cfa\") " pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:28:00.251790 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.251758    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:28:00.531888 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.531855    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"]
Sep 08 15:28:00.533052 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:28:00.533028    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44734f29_34b1_45b4_9978_df98c28e4cfa.slice/crio-5498ac9dbe88299333aa876162c396ea88db8c8d5c493512a1d976f287e04f96 WatchSource:0}: Error finding container 5498ac9dbe88299333aa876162c396ea88db8c8d5c493512a1d976f287e04f96: Status 404 returned error can't find the container with id 5498ac9dbe88299333aa876162c396ea88db8c8d5c493512a1d976f287e04f96
Sep 08 15:28:00.737577 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.737543    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk" event={"ID":"44734f29-34b1-45b4-9978-df98c28e4cfa","Type":"ContainerStarted","Data":"fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0"}
Sep 08 15:28:00.737766 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.737593    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk" event={"ID":"44734f29-34b1-45b4-9978-df98c28e4cfa","Type":"ContainerStarted","Data":"5498ac9dbe88299333aa876162c396ea88db8c8d5c493512a1d976f287e04f96"}
Sep 08 15:28:00.737766 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.737640    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:28:00.759778 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:00.759720    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk" podStartSLOduration=1.759700577 podStartE2EDuration="1.759700577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:28:00.754648179 +0000 UTC m=+1141.326194220" watchObservedRunningTime="2026-09-08 15:28:00.759700577 +0000 UTC m=+1141.331246617"
Sep 08 15:28:10.710841 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:10.710804    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"]
Sep 08 15:28:10.711456 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:10.711065    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh" podUID="75ce4fd5-8a04-441c-863d-318a238c1446" containerName="payload-processing" containerID="cri-o://089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19" gracePeriod=30
Sep 08 15:28:10.718904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:10.718527    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"]
Sep 08 15:28:10.718904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:10.718732    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f" podUID="12a9927f-999d-4082-893d-06f53f11dc7f" containerName="payload-pre-processing" containerID="cri-o://7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913" gracePeriod=30
Sep 08 15:28:11.000104 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.000077    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:28:11.003097 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.003077    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:28:11.107075 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.107042    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgzqg\" (UniqueName: \"kubernetes.io/projected/75ce4fd5-8a04-441c-863d-318a238c1446-kube-api-access-tgzqg\") pod \"75ce4fd5-8a04-441c-863d-318a238c1446\" (UID: \"75ce4fd5-8a04-441c-863d-318a238c1446\") "
Sep 08 15:28:11.107075 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.107079    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcb2d\" (UniqueName: \"kubernetes.io/projected/12a9927f-999d-4082-893d-06f53f11dc7f-kube-api-access-pcb2d\") pod \"12a9927f-999d-4082-893d-06f53f11dc7f\" (UID: \"12a9927f-999d-4082-893d-06f53f11dc7f\") "
Sep 08 15:28:11.107289 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.107104    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75ce4fd5-8a04-441c-863d-318a238c1446-plugins-config-volume\") pod \"75ce4fd5-8a04-441c-863d-318a238c1446\" (UID: \"75ce4fd5-8a04-441c-863d-318a238c1446\") "
Sep 08 15:28:11.107289 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.107177    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12a9927f-999d-4082-893d-06f53f11dc7f-plugins-config-volume\") pod \"12a9927f-999d-4082-893d-06f53f11dc7f\" (UID: \"12a9927f-999d-4082-893d-06f53f11dc7f\") "
Sep 08 15:28:11.107536 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.107514    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75ce4fd5-8a04-441c-863d-318a238c1446-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75ce4fd5-8a04-441c-863d-318a238c1446" (UID: "75ce4fd5-8a04-441c-863d-318a238c1446"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:28:11.107608 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.107553    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12a9927f-999d-4082-893d-06f53f11dc7f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "12a9927f-999d-4082-893d-06f53f11dc7f" (UID: "12a9927f-999d-4082-893d-06f53f11dc7f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:28:11.109389 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.109366    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12a9927f-999d-4082-893d-06f53f11dc7f-kube-api-access-pcb2d" (OuterVolumeSpecName: "kube-api-access-pcb2d") pod "12a9927f-999d-4082-893d-06f53f11dc7f" (UID: "12a9927f-999d-4082-893d-06f53f11dc7f"). InnerVolumeSpecName "kube-api-access-pcb2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:28:11.109486 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.109395    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ce4fd5-8a04-441c-863d-318a238c1446-kube-api-access-tgzqg" (OuterVolumeSpecName: "kube-api-access-tgzqg") pod "75ce4fd5-8a04-441c-863d-318a238c1446" (UID: "75ce4fd5-8a04-441c-863d-318a238c1446"). InnerVolumeSpecName "kube-api-access-tgzqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:28:11.208166 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.208135    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75ce4fd5-8a04-441c-863d-318a238c1446-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:28:11.208166 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.208162    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12a9927f-999d-4082-893d-06f53f11dc7f-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:28:11.208166 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.208171    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgzqg\" (UniqueName: \"kubernetes.io/projected/75ce4fd5-8a04-441c-863d-318a238c1446-kube-api-access-tgzqg\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:28:11.208404 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.208178    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcb2d\" (UniqueName: \"kubernetes.io/projected/12a9927f-999d-4082-893d-06f53f11dc7f-kube-api-access-pcb2d\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:28:11.747083 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.747054    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:28:11.810255 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.810223    2566 generic.go:356] "Generic (PLEG): container finished" podID="75ce4fd5-8a04-441c-863d-318a238c1446" containerID="089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19" exitCode=0
Sep 08 15:28:11.810441 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.810268    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"
Sep 08 15:28:11.810441 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.810299    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh" event={"ID":"75ce4fd5-8a04-441c-863d-318a238c1446","Type":"ContainerDied","Data":"089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19"}
Sep 08 15:28:11.810441 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.810352    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh" event={"ID":"75ce4fd5-8a04-441c-863d-318a238c1446","Type":"ContainerDied","Data":"1847cb49f8db1f8b8c2aaec1cac5c922f96f805579c0440c0020235227081e33"}
Sep 08 15:28:11.810441 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.810377    2566 scope.go:117] "RemoveContainer" containerID="089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19"
Sep 08 15:28:11.812159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.812017    2566 generic.go:356] "Generic (PLEG): container finished" podID="12a9927f-999d-4082-893d-06f53f11dc7f" containerID="7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913" exitCode=0
Sep 08 15:28:11.812159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.812087    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f" event={"ID":"12a9927f-999d-4082-893d-06f53f11dc7f","Type":"ContainerDied","Data":"7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913"}
Sep 08 15:28:11.812159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.812095    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"
Sep 08 15:28:11.812159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.812128    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f" event={"ID":"12a9927f-999d-4082-893d-06f53f11dc7f","Type":"ContainerDied","Data":"5085f23179ac9ccb0fe805af77414163e1d7452e832837a09036d489e45319ac"}
Sep 08 15:28:11.824325 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.824302    2566 scope.go:117] "RemoveContainer" containerID="089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19"
Sep 08 15:28:11.824752 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:28:11.824729    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19\": container with ID starting with 089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19 not found: ID does not exist" containerID="089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19"
Sep 08 15:28:11.824843 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.824760    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19"} err="failed to get container status \"089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19\": rpc error: code = NotFound desc = could not find container \"089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19\": container with ID starting with 089ec3c3f14bf09bd2391e18549e4b1e03fb9cc07447b63e5edf2787637cba19 not found: ID does not exist"
Sep 08 15:28:11.824843 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.824783    2566 scope.go:117] "RemoveContainer" containerID="7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913"
Sep 08 15:28:11.835661 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.835641    2566 scope.go:117] "RemoveContainer" containerID="7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913"
Sep 08 15:28:11.836154 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:28:11.836128    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913\": container with ID starting with 7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913 not found: ID does not exist" containerID="7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913"
Sep 08 15:28:11.836242 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.836162    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913"} err="failed to get container status \"7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913\": rpc error: code = NotFound desc = could not find container \"7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913\": container with ID starting with 7a11ea18ac49a64d9c32f174967d28235e4c12592c8c94159a135fc6d1589913 not found: ID does not exist"
Sep 08 15:28:11.839156 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.839136    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"]
Sep 08 15:28:11.843026 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.842997    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9e22317f-578dff76d5-p9zlh"]
Sep 08 15:28:11.854563 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.854530    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"]
Sep 08 15:28:11.858031 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.858004    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9e22317f-6b84ddb878-4rd4f"]
Sep 08 15:28:11.915780 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.915741    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12a9927f-999d-4082-893d-06f53f11dc7f" path="/var/lib/kubelet/pods/12a9927f-999d-4082-893d-06f53f11dc7f/volumes"
Sep 08 15:28:11.916158 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:11.916140    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75ce4fd5-8a04-441c-863d-318a238c1446" path="/var/lib/kubelet/pods/75ce4fd5-8a04-441c-863d-318a238c1446/volumes"
Sep 08 15:28:17.686557 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.686516    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"]
Sep 08 15:28:17.686990 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.686976    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ce4fd5-8a04-441c-863d-318a238c1446" containerName="payload-processing"
Sep 08 15:28:17.687047 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.686991    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ce4fd5-8a04-441c-863d-318a238c1446" containerName="payload-processing"
Sep 08 15:28:17.687047 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.687014    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12a9927f-999d-4082-893d-06f53f11dc7f" containerName="payload-pre-processing"
Sep 08 15:28:17.687047 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.687020    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="12a9927f-999d-4082-893d-06f53f11dc7f" containerName="payload-pre-processing"
Sep 08 15:28:17.687141 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.687080    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ce4fd5-8a04-441c-863d-318a238c1446" containerName="payload-processing"
Sep 08 15:28:17.687141 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.687088    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="12a9927f-999d-4082-893d-06f53f11dc7f" containerName="payload-pre-processing"
Sep 08 15:28:17.691754 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.691737    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:17.695038 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.695019    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-152e35a7-dockercfg-94gz5\""
Sep 08 15:28:17.695314 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.695297    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-152e35a7\""
Sep 08 15:28:17.703153 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.703131    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"]
Sep 08 15:28:17.768220 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.768186    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-plugins-config-volume\") pod \"payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5\" (UID: \"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3\") " pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:17.768220 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.768226    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7xlp\" (UniqueName: \"kubernetes.io/projected/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-kube-api-access-z7xlp\") pod \"payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5\" (UID: \"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3\") " pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:17.869051 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.869012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-plugins-config-volume\") pod \"payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5\" (UID: \"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3\") " pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:17.869250 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.869058    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7xlp\" (UniqueName: \"kubernetes.io/projected/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-kube-api-access-z7xlp\") pod \"payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5\" (UID: \"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3\") " pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:17.869709 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.869691    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-plugins-config-volume\") pod \"payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5\" (UID: \"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3\") " pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:17.879096 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:17.879065    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7xlp\" (UniqueName: \"kubernetes.io/projected/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-kube-api-access-z7xlp\") pod \"payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5\" (UID: \"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3\") " pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:18.002233 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:18.002150    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:18.280257 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:18.279587    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"]
Sep 08 15:28:18.280257 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:28:18.279748    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d71173a_ecc1_40e5_bfdc_34fec5bfa9b3.slice/crio-a17c7918ec05d3bff0657f4fabc599eb0809745f02de28615a502b71b30c462b WatchSource:0}: Error finding container a17c7918ec05d3bff0657f4fabc599eb0809745f02de28615a502b71b30c462b: Status 404 returned error can't find the container with id a17c7918ec05d3bff0657f4fabc599eb0809745f02de28615a502b71b30c462b
Sep 08 15:28:18.875429 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:18.875382    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5" event={"ID":"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3","Type":"ContainerStarted","Data":"92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba"}
Sep 08 15:28:18.875859 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:18.875487    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:18.875859 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:18.875514    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5" event={"ID":"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3","Type":"ContainerStarted","Data":"a17c7918ec05d3bff0657f4fabc599eb0809745f02de28615a502b71b30c462b"}
Sep 08 15:28:18.896159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:18.896104    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5" podStartSLOduration=1.8960883750000002 podStartE2EDuration="1.896088375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:28:18.895123387 +0000 UTC m=+1159.466669430" watchObservedRunningTime="2026-09-08 15:28:18.896088375 +0000 UTC m=+1159.467634415"
Sep 08 15:28:29.884508 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:29.884426    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:47.686669 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:47.686603    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"]
Sep 08 15:28:47.687294 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:47.686943    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5" podUID="8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3" containerName="payload-processing" containerID="cri-o://92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba" gracePeriod=30
Sep 08 15:28:47.947715 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:47.947632    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:48.058729 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.058683    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7xlp\" (UniqueName: \"kubernetes.io/projected/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-kube-api-access-z7xlp\") pod \"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3\" (UID: \"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3\") "
Sep 08 15:28:48.058936 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.058792    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-plugins-config-volume\") pod \"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3\" (UID: \"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3\") "
Sep 08 15:28:48.059235 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.059199    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3" (UID: "8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:28:48.060289 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.060264    2566 generic.go:356] "Generic (PLEG): container finished" podID="8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3" containerID="92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba" exitCode=0
Sep 08 15:28:48.060382 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.060312    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"
Sep 08 15:28:48.060382 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.060349    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5" event={"ID":"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3","Type":"ContainerDied","Data":"92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba"}
Sep 08 15:28:48.060468 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.060408    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5" event={"ID":"8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3","Type":"ContainerDied","Data":"a17c7918ec05d3bff0657f4fabc599eb0809745f02de28615a502b71b30c462b"}
Sep 08 15:28:48.060468 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.060437    2566 scope.go:117] "RemoveContainer" containerID="92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba"
Sep 08 15:28:48.061248 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.061221    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-kube-api-access-z7xlp" (OuterVolumeSpecName: "kube-api-access-z7xlp") pod "8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3" (UID: "8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3"). InnerVolumeSpecName "kube-api-access-z7xlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:28:48.076965 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.076923    2566 scope.go:117] "RemoveContainer" containerID="92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba"
Sep 08 15:28:48.077674 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:28:48.077607    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba\": container with ID starting with 92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba not found: ID does not exist" containerID="92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba"
Sep 08 15:28:48.077771 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.077687    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba"} err="failed to get container status \"92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba\": rpc error: code = NotFound desc = could not find container \"92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba\": container with ID starting with 92a8d8c78c56a0c5b4c9ae96b54c3fbbdb029fd172d1b7b98be7b454307e9cba not found: ID does not exist"
Sep 08 15:28:48.160595 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.160550    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7xlp\" (UniqueName: \"kubernetes.io/projected/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-kube-api-access-z7xlp\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:28:48.160595 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.160590    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:28:48.386371 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.386336    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"]
Sep 08 15:28:48.388859 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:48.388838    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-152e35a7-6db4df7f8f-pv5g5"]
Sep 08 15:28:49.918505 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:28:49.918459    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3" path="/var/lib/kubelet/pods/8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3/volumes"
Sep 08 15:29:20.391067 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:20.391032    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"]
Sep 08 15:29:20.391730 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:20.391221    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk" podUID="44734f29-34b1-45b4-9978-df98c28e4cfa" containerName="payload-processing" containerID="cri-o://fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0" gracePeriod=30
Sep 08 15:29:20.651513 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:20.651423    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:29:20.766467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:20.766434    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q78x\" (UniqueName: \"kubernetes.io/projected/44734f29-34b1-45b4-9978-df98c28e4cfa-kube-api-access-2q78x\") pod \"44734f29-34b1-45b4-9978-df98c28e4cfa\" (UID: \"44734f29-34b1-45b4-9978-df98c28e4cfa\") "
Sep 08 15:29:20.766467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:20.766470    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44734f29-34b1-45b4-9978-df98c28e4cfa-plugins-config-volume\") pod \"44734f29-34b1-45b4-9978-df98c28e4cfa\" (UID: \"44734f29-34b1-45b4-9978-df98c28e4cfa\") "
Sep 08 15:29:20.766929 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:20.766900    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44734f29-34b1-45b4-9978-df98c28e4cfa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44734f29-34b1-45b4-9978-df98c28e4cfa" (UID: "44734f29-34b1-45b4-9978-df98c28e4cfa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:20.768853 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:20.768821    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44734f29-34b1-45b4-9978-df98c28e4cfa-kube-api-access-2q78x" (OuterVolumeSpecName: "kube-api-access-2q78x") pod "44734f29-34b1-45b4-9978-df98c28e4cfa" (UID: "44734f29-34b1-45b4-9978-df98c28e4cfa"). InnerVolumeSpecName "kube-api-access-2q78x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:20.867430 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:20.867394    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q78x\" (UniqueName: \"kubernetes.io/projected/44734f29-34b1-45b4-9978-df98c28e4cfa-kube-api-access-2q78x\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:29:20.867430 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:20.867427    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44734f29-34b1-45b4-9978-df98c28e4cfa-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:29:21.270301 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:21.270270    2566 generic.go:356] "Generic (PLEG): container finished" podID="44734f29-34b1-45b4-9978-df98c28e4cfa" containerID="fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0" exitCode=0
Sep 08 15:29:21.270477 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:21.270298    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk" event={"ID":"44734f29-34b1-45b4-9978-df98c28e4cfa","Type":"ContainerDied","Data":"fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0"}
Sep 08 15:29:21.270477 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:21.270339    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"
Sep 08 15:29:21.270477 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:21.270366    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk" event={"ID":"44734f29-34b1-45b4-9978-df98c28e4cfa","Type":"ContainerDied","Data":"5498ac9dbe88299333aa876162c396ea88db8c8d5c493512a1d976f287e04f96"}
Sep 08 15:29:21.270477 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:21.270380    2566 scope.go:117] "RemoveContainer" containerID="fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0"
Sep 08 15:29:21.281209 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:21.281184    2566 scope.go:117] "RemoveContainer" containerID="fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0"
Sep 08 15:29:21.281560 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:29:21.281543    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0\": container with ID starting with fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0 not found: ID does not exist" containerID="fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0"
Sep 08 15:29:21.281646 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:21.281571    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0"} err="failed to get container status \"fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0\": rpc error: code = NotFound desc = could not find container \"fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0\": container with ID starting with fa66069724a2dcd62331a5bd9cda84e63748fefb120c9a624449e582cc7229a0 not found: ID does not exist"
Sep 08 15:29:21.295505 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:21.295476    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"]
Sep 08 15:29:21.300681 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:21.300658    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-6de9d1-57dd654569-spvqk"]
Sep 08 15:29:21.916272 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:29:21.916240    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44734f29-34b1-45b4-9978-df98c28e4cfa" path="/var/lib/kubelet/pods/44734f29-34b1-45b4-9978-df98c28e4cfa/volumes"
Sep 08 15:30:17.888125 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:17.888080    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"]
Sep 08 15:30:17.888720 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:17.888288    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb" podUID="33112609-c0bb-4b70-b6a1-3183829bc070" containerName="maas-api" containerID="cri-o://73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2" gracePeriod=30
Sep 08 15:30:18.114787 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.114745    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"]
Sep 08 15:30:18.115036 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.115002    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d" podUID="c19ebbaf-c2f7-4af5-ba8a-4eca80d91066" containerName="payload-processing" containerID="cri-o://826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512" gracePeriod=30
Sep 08 15:30:18.242501 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.242474    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:30:18.370100 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.370072    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:30:18.396828 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.396733    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33112609-c0bb-4b70-b6a1-3183829bc070-openshift-service-ca\") pod \"33112609-c0bb-4b70-b6a1-3183829bc070\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") "
Sep 08 15:30:18.396828 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.396795    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-maas-api-tls\") pod \"33112609-c0bb-4b70-b6a1-3183829bc070\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") "
Sep 08 15:30:18.396828 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.396817    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-metrics-certs\") pod \"33112609-c0bb-4b70-b6a1-3183829bc070\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") "
Sep 08 15:30:18.397118 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.396922    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc626\" (UniqueName: \"kubernetes.io/projected/33112609-c0bb-4b70-b6a1-3183829bc070-kube-api-access-nc626\") pod \"33112609-c0bb-4b70-b6a1-3183829bc070\" (UID: \"33112609-c0bb-4b70-b6a1-3183829bc070\") "
Sep 08 15:30:18.397206 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.397172    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33112609-c0bb-4b70-b6a1-3183829bc070-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "33112609-c0bb-4b70-b6a1-3183829bc070" (UID: "33112609-c0bb-4b70-b6a1-3183829bc070"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:30:18.399275 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.399252    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "33112609-c0bb-4b70-b6a1-3183829bc070" (UID: "33112609-c0bb-4b70-b6a1-3183829bc070"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:30:18.399370 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.399307    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33112609-c0bb-4b70-b6a1-3183829bc070-kube-api-access-nc626" (OuterVolumeSpecName: "kube-api-access-nc626") pod "33112609-c0bb-4b70-b6a1-3183829bc070" (UID: "33112609-c0bb-4b70-b6a1-3183829bc070"). InnerVolumeSpecName "kube-api-access-nc626". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:30:18.400213 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.400191    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "33112609-c0bb-4b70-b6a1-3183829bc070" (UID: "33112609-c0bb-4b70-b6a1-3183829bc070"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:30:18.498431 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.498402    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-plugins-config-volume\") pod \"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066\" (UID: \"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066\") "
Sep 08 15:30:18.498431 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.498439    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j87z\" (UniqueName: \"kubernetes.io/projected/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-kube-api-access-9j87z\") pod \"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066\" (UID: \"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066\") "
Sep 08 15:30:18.498739 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.498654    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc626\" (UniqueName: \"kubernetes.io/projected/33112609-c0bb-4b70-b6a1-3183829bc070-kube-api-access-nc626\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:30:18.498739 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.498671    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33112609-c0bb-4b70-b6a1-3183829bc070-openshift-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:30:18.498739 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.498700    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-maas-api-tls\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:30:18.498739 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.498714    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33112609-c0bb-4b70-b6a1-3183829bc070-metrics-certs\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:30:18.498869 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.498820    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c19ebbaf-c2f7-4af5-ba8a-4eca80d91066" (UID: "c19ebbaf-c2f7-4af5-ba8a-4eca80d91066"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:30:18.500710 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.500687    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-kube-api-access-9j87z" (OuterVolumeSpecName: "kube-api-access-9j87z") pod "c19ebbaf-c2f7-4af5-ba8a-4eca80d91066" (UID: "c19ebbaf-c2f7-4af5-ba8a-4eca80d91066"). InnerVolumeSpecName "kube-api-access-9j87z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:30:18.599780 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.599741    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:30:18.599780 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.599774    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j87z\" (UniqueName: \"kubernetes.io/projected/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066-kube-api-access-9j87z\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:30:18.638222 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.638189    2566 generic.go:356] "Generic (PLEG): container finished" podID="c19ebbaf-c2f7-4af5-ba8a-4eca80d91066" containerID="826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512" exitCode=0
Sep 08 15:30:18.638423 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.638234    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"
Sep 08 15:30:18.638423 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.638263    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d" event={"ID":"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066","Type":"ContainerDied","Data":"826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512"}
Sep 08 15:30:18.638423 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.638328    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d" event={"ID":"c19ebbaf-c2f7-4af5-ba8a-4eca80d91066","Type":"ContainerDied","Data":"fdc5254676418cea6155e03178e1b803a4eeb957e3d7480128bd52a982a1fa52"}
Sep 08 15:30:18.638423 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.638359    2566 scope.go:117] "RemoveContainer" containerID="826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512"
Sep 08 15:30:18.639988 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.639962    2566 generic.go:356] "Generic (PLEG): container finished" podID="33112609-c0bb-4b70-b6a1-3183829bc070" containerID="73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2" exitCode=0
Sep 08 15:30:18.640096 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.640059    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"
Sep 08 15:30:18.640231 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.640204    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb" event={"ID":"33112609-c0bb-4b70-b6a1-3183829bc070","Type":"ContainerDied","Data":"73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2"}
Sep 08 15:30:18.640282 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.640268    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb" event={"ID":"33112609-c0bb-4b70-b6a1-3183829bc070","Type":"ContainerDied","Data":"682aa2cfe51d7e8cba3e594d6946134729aadf1da72ec5c07c21714ccd29b0e0"}
Sep 08 15:30:18.650676 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.650415    2566 scope.go:117] "RemoveContainer" containerID="826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512"
Sep 08 15:30:18.651233 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:30:18.651206    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512\": container with ID starting with 826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512 not found: ID does not exist" containerID="826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512"
Sep 08 15:30:18.651315 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.651243    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512"} err="failed to get container status \"826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512\": rpc error: code = NotFound desc = could not find container \"826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512\": container with ID starting with 826c6b6c333b55bb442c74f589f4819274b9500d9a14829db436331fd84d0512 not found: ID does not exist"
Sep 08 15:30:18.651315 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.651258    2566 scope.go:117] "RemoveContainer" containerID="73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2"
Sep 08 15:30:18.660703 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.660681    2566 scope.go:117] "RemoveContainer" containerID="73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2"
Sep 08 15:30:18.661009 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:30:18.660989    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2\": container with ID starting with 73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2 not found: ID does not exist" containerID="73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2"
Sep 08 15:30:18.661084 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.661016    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2"} err="failed to get container status \"73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2\": rpc error: code = NotFound desc = could not find container \"73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2\": container with ID starting with 73942a8c59c31124db114ca74a1a8cea8cb5e2aa8aa7016e30b2115a53b73ce2 not found: ID does not exist"
Sep 08 15:30:18.680355 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.680320    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"]
Sep 08 15:30:18.685864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.685824    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8e721-68d769544c-4fv9d"]
Sep 08 15:30:18.737337 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.737303    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"]
Sep 08 15:30:18.746203 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:18.746175    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8e721-66566f59fc-8bjlb"]
Sep 08 15:30:19.915485 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:19.915420    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33112609-c0bb-4b70-b6a1-3183829bc070" path="/var/lib/kubelet/pods/33112609-c0bb-4b70-b6a1-3183829bc070/volumes"
Sep 08 15:30:19.915893 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:30:19.915821    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c19ebbaf-c2f7-4af5-ba8a-4eca80d91066" path="/var/lib/kubelet/pods/c19ebbaf-c2f7-4af5-ba8a-4eca80d91066/volumes"
Sep 08 15:31:01.723557 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.723521    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"]
Sep 08 15:31:01.724000 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.723954    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3" containerName="payload-processing"
Sep 08 15:31:01.724000 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.723966    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3" containerName="payload-processing"
Sep 08 15:31:01.724000 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.723986    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33112609-c0bb-4b70-b6a1-3183829bc070" containerName="maas-api"
Sep 08 15:31:01.724000 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.723992    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33112609-c0bb-4b70-b6a1-3183829bc070" containerName="maas-api"
Sep 08 15:31:01.724000 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.724000    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19ebbaf-c2f7-4af5-ba8a-4eca80d91066" containerName="payload-processing"
Sep 08 15:31:01.724159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.724005    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19ebbaf-c2f7-4af5-ba8a-4eca80d91066" containerName="payload-processing"
Sep 08 15:31:01.724159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.724013    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44734f29-34b1-45b4-9978-df98c28e4cfa" containerName="payload-processing"
Sep 08 15:31:01.724159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.724018    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="44734f29-34b1-45b4-9978-df98c28e4cfa" containerName="payload-processing"
Sep 08 15:31:01.724159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.724077    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="33112609-c0bb-4b70-b6a1-3183829bc070" containerName="maas-api"
Sep 08 15:31:01.724159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.724086    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d71173a-ecc1-40e5-bfdc-34fec5bfa9b3" containerName="payload-processing"
Sep 08 15:31:01.724159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.724100    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c19ebbaf-c2f7-4af5-ba8a-4eca80d91066" containerName="payload-processing"
Sep 08 15:31:01.724159 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.724108    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="44734f29-34b1-45b4-9978-df98c28e4cfa" containerName="payload-processing"
Sep 08 15:31:01.727319 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.727302    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:31:01.731041 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.731019    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-2e082e\""
Sep 08 15:31:01.778888 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.778853    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"]
Sep 08 15:31:01.811043 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.811005    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqgp4\" (UniqueName: \"kubernetes.io/projected/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-kube-api-access-kqgp4\") pod \"payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn\" (UID: \"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:31:01.811232 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.811144    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn\" (UID: \"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:31:01.912212 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.912179    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn\" (UID: \"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:31:01.912212 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.912219    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqgp4\" (UniqueName: \"kubernetes.io/projected/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-kube-api-access-kqgp4\") pod \"payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn\" (UID: \"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:31:01.913028 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.913006    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn\" (UID: \"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:31:01.944984 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:01.944949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqgp4\" (UniqueName: \"kubernetes.io/projected/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-kube-api-access-kqgp4\") pod \"payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn\" (UID: \"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:31:02.037805 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:02.037760    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:31:02.320207 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:02.320178    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"]
Sep 08 15:31:02.321779 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:31:02.321753    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8496b06_e2d3_44cc_b5a5_ef968a2d79a3.slice/crio-27e24077701a17a2cf02a2ecff85c329e979a0fff8e5a690326472e4733082ba WatchSource:0}: Error finding container 27e24077701a17a2cf02a2ecff85c329e979a0fff8e5a690326472e4733082ba: Status 404 returned error can't find the container with id 27e24077701a17a2cf02a2ecff85c329e979a0fff8e5a690326472e4733082ba
Sep 08 15:31:02.919688 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:02.919655    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn" event={"ID":"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3","Type":"ContainerStarted","Data":"8b421de474786afe5bb2da130d1aa41bc4f1433d405c60b76e8dc4fd47749b47"}
Sep 08 15:31:02.920122 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:02.919711    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn" event={"ID":"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3","Type":"ContainerStarted","Data":"27e24077701a17a2cf02a2ecff85c329e979a0fff8e5a690326472e4733082ba"}
Sep 08 15:31:02.920122 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:02.919833    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:31:13.930089 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:13.930060    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:31:13.954180 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:13.954123    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn" podStartSLOduration=12.954107423 podStartE2EDuration="12.954107423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:31:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:31:02.960487169 +0000 UTC m=+1323.532033213" watchObservedRunningTime="2026-09-08 15:31:13.954107423 +0000 UTC m=+1334.525653463"
Sep 08 15:31:30.494342 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.494256    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"]
Sep 08 15:31:30.497879 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.497861    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:31:30.501428 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.501406    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-bc9cdf\""
Sep 08 15:31:30.501548 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.501457    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-bc9cdf-dockercfg-8x4pb\""
Sep 08 15:31:30.514433 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.514401    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"]
Sep 08 15:31:30.571366 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.571333    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"]
Sep 08 15:31:30.575032 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.575014    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:31:30.583743 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.583534    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77402ada-99f2-4fad-8365-d9014df18141-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px\" (UID: \"77402ada-99f2-4fad-8365-d9014df18141\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:31:30.583743 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.583582    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2n8n\" (UniqueName: \"kubernetes.io/projected/77402ada-99f2-4fad-8365-d9014df18141-kube-api-access-m2n8n\") pod \"payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px\" (UID: \"77402ada-99f2-4fad-8365-d9014df18141\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:31:30.590017 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.589987    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"]
Sep 08 15:31:30.684692 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.684652    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77402ada-99f2-4fad-8365-d9014df18141-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px\" (UID: \"77402ada-99f2-4fad-8365-d9014df18141\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:31:30.684879 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.684713    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2n8n\" (UniqueName: \"kubernetes.io/projected/77402ada-99f2-4fad-8365-d9014df18141-kube-api-access-m2n8n\") pod \"payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px\" (UID: \"77402ada-99f2-4fad-8365-d9014df18141\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:31:30.684879 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.684749    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs774\" (UniqueName: \"kubernetes.io/projected/25da845a-f731-4f0f-87e7-109206a42fba-kube-api-access-vs774\") pod \"payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl\" (UID: \"25da845a-f731-4f0f-87e7-109206a42fba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:31:30.684879 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.684782    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25da845a-f731-4f0f-87e7-109206a42fba-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl\" (UID: \"25da845a-f731-4f0f-87e7-109206a42fba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:31:30.685309 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.685286    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77402ada-99f2-4fad-8365-d9014df18141-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px\" (UID: \"77402ada-99f2-4fad-8365-d9014df18141\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:31:30.699710 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.699672    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2n8n\" (UniqueName: \"kubernetes.io/projected/77402ada-99f2-4fad-8365-d9014df18141-kube-api-access-m2n8n\") pod \"payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px\" (UID: \"77402ada-99f2-4fad-8365-d9014df18141\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:31:30.786164 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.786079    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs774\" (UniqueName: \"kubernetes.io/projected/25da845a-f731-4f0f-87e7-109206a42fba-kube-api-access-vs774\") pod \"payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl\" (UID: \"25da845a-f731-4f0f-87e7-109206a42fba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:31:30.786164 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.786120    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25da845a-f731-4f0f-87e7-109206a42fba-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl\" (UID: \"25da845a-f731-4f0f-87e7-109206a42fba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:31:30.786830 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.786813    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25da845a-f731-4f0f-87e7-109206a42fba-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl\" (UID: \"25da845a-f731-4f0f-87e7-109206a42fba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:31:30.808163 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.808126    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:31:30.814264 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.814232    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs774\" (UniqueName: \"kubernetes.io/projected/25da845a-f731-4f0f-87e7-109206a42fba-kube-api-access-vs774\") pod \"payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl\" (UID: \"25da845a-f731-4f0f-87e7-109206a42fba\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:31:30.888663 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:30.888099    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:31:31.093376 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:31.093349    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"]
Sep 08 15:31:31.094992 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:31:31.094969    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77402ada_99f2_4fad_8365_d9014df18141.slice/crio-817bc7ae0bcd1c1c39b8036917cc1a8e508de5df8b9afeb45923fd5b7ed7c09d WatchSource:0}: Error finding container 817bc7ae0bcd1c1c39b8036917cc1a8e508de5df8b9afeb45923fd5b7ed7c09d: Status 404 returned error can't find the container with id 817bc7ae0bcd1c1c39b8036917cc1a8e508de5df8b9afeb45923fd5b7ed7c09d
Sep 08 15:31:31.111773 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:31.111742    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px" event={"ID":"77402ada-99f2-4fad-8365-d9014df18141","Type":"ContainerStarted","Data":"817bc7ae0bcd1c1c39b8036917cc1a8e508de5df8b9afeb45923fd5b7ed7c09d"}
Sep 08 15:31:31.180421 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:31.180385    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"]
Sep 08 15:31:31.184029 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:31:31.183993    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25da845a_f731_4f0f_87e7_109206a42fba.slice/crio-757e1040259ca69401996f05ae7ddef1f706983636c6f383baa76527db349200 WatchSource:0}: Error finding container 757e1040259ca69401996f05ae7ddef1f706983636c6f383baa76527db349200: Status 404 returned error can't find the container with id 757e1040259ca69401996f05ae7ddef1f706983636c6f383baa76527db349200
Sep 08 15:31:32.120521 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:32.120479    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl" event={"ID":"25da845a-f731-4f0f-87e7-109206a42fba","Type":"ContainerStarted","Data":"d1eb59ad7b5d54e96008cc4b6645a75e5681bcf10fa627ff437b11fae87fd318"}
Sep 08 15:31:32.121059 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:32.120549    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl" event={"ID":"25da845a-f731-4f0f-87e7-109206a42fba","Type":"ContainerStarted","Data":"757e1040259ca69401996f05ae7ddef1f706983636c6f383baa76527db349200"}
Sep 08 15:31:32.121059 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:32.120729    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:31:32.122267 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:32.122238    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px" event={"ID":"77402ada-99f2-4fad-8365-d9014df18141","Type":"ContainerStarted","Data":"e971f884844319125d899b98967ad696620871dfb610510b90d23eab9d4d63d7"}
Sep 08 15:31:32.122380 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:32.122361    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:31:32.157096 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:32.157025    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl" podStartSLOduration=2.157003208 podStartE2EDuration="2.157003208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:31:32.15668116 +0000 UTC m=+1352.728227206" watchObservedRunningTime="2026-09-08 15:31:32.157003208 +0000 UTC m=+1352.728549249"
Sep 08 15:31:32.192128 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:32.192069    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px" podStartSLOduration=2.192050631 podStartE2EDuration="2.192050631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:31:32.18948656 +0000 UTC m=+1352.761032601" watchObservedRunningTime="2026-09-08 15:31:32.192050631 +0000 UTC m=+1352.763596672"
Sep 08 15:31:43.130264 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:43.130229    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:31:43.130760 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:31:43.130309    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:32:10.990842 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:10.990792    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"]
Sep 08 15:32:10.994535 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:10.994515    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:32:10.997491 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:10.997469    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-149fdb\""
Sep 08 15:32:10.997824 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:10.997807    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-149fdb-dockercfg-5rtz8\""
Sep 08 15:32:11.057190 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:11.057154    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"]
Sep 08 15:32:11.074501 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:11.074458    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a84cdd58-23c1-4b67-892a-2a35b371b3e3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25\" (UID: \"a84cdd58-23c1-4b67-892a-2a35b371b3e3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:32:11.074697 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:11.074658    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52svt\" (UniqueName: \"kubernetes.io/projected/a84cdd58-23c1-4b67-892a-2a35b371b3e3-kube-api-access-52svt\") pod \"payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25\" (UID: \"a84cdd58-23c1-4b67-892a-2a35b371b3e3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:32:11.175275 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:11.175236    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52svt\" (UniqueName: \"kubernetes.io/projected/a84cdd58-23c1-4b67-892a-2a35b371b3e3-kube-api-access-52svt\") pod \"payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25\" (UID: \"a84cdd58-23c1-4b67-892a-2a35b371b3e3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:32:11.175464 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:11.175302    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a84cdd58-23c1-4b67-892a-2a35b371b3e3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25\" (UID: \"a84cdd58-23c1-4b67-892a-2a35b371b3e3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:32:11.176026 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:11.176007    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a84cdd58-23c1-4b67-892a-2a35b371b3e3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25\" (UID: \"a84cdd58-23c1-4b67-892a-2a35b371b3e3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:32:11.188464 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:11.188436    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52svt\" (UniqueName: \"kubernetes.io/projected/a84cdd58-23c1-4b67-892a-2a35b371b3e3-kube-api-access-52svt\") pod \"payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25\" (UID: \"a84cdd58-23c1-4b67-892a-2a35b371b3e3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:32:11.306350 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:11.306256    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:32:11.595948 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:11.595919    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"]
Sep 08 15:32:11.597604 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:32:11.597573    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84cdd58_23c1_4b67_892a_2a35b371b3e3.slice/crio-fa2366e0997b81ce2d4e046e865f32f41c8dc6adb11243c48e20468c129eed9c WatchSource:0}: Error finding container fa2366e0997b81ce2d4e046e865f32f41c8dc6adb11243c48e20468c129eed9c: Status 404 returned error can't find the container with id fa2366e0997b81ce2d4e046e865f32f41c8dc6adb11243c48e20468c129eed9c
Sep 08 15:32:12.377134 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:12.377077    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25" event={"ID":"a84cdd58-23c1-4b67-892a-2a35b371b3e3","Type":"ContainerStarted","Data":"d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347"}
Sep 08 15:32:12.377660 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:12.377154    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25" event={"ID":"a84cdd58-23c1-4b67-892a-2a35b371b3e3","Type":"ContainerStarted","Data":"fa2366e0997b81ce2d4e046e865f32f41c8dc6adb11243c48e20468c129eed9c"}
Sep 08 15:32:12.377660 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:12.377184    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:32:12.413335 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:12.413208    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25" podStartSLOduration=2.413190096 podStartE2EDuration="2.413190096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:12.411845236 +0000 UTC m=+1392.983391291" watchObservedRunningTime="2026-09-08 15:32:12.413190096 +0000 UTC m=+1392.984736138"
Sep 08 15:32:23.388613 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:23.388579    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:32:40.324268 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.324232    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"]
Sep 08 15:32:40.327211 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.327191    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:32:40.332381 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.332359    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-04285b\""
Sep 08 15:32:40.332740 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.332718    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-04285b-dockercfg-8mktk\""
Sep 08 15:32:40.346718 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.346689    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"]
Sep 08 15:32:40.447856 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.447815    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5kww\" (UniqueName: \"kubernetes.io/projected/c6b2eb8c-5d42-4f13-9168-645f22350bf2-kube-api-access-j5kww\") pod \"payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz\" (UID: \"c6b2eb8c-5d42-4f13-9168-645f22350bf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:32:40.448071 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.447882    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b2eb8c-5d42-4f13-9168-645f22350bf2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz\" (UID: \"c6b2eb8c-5d42-4f13-9168-645f22350bf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:32:40.549091 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.549042    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5kww\" (UniqueName: \"kubernetes.io/projected/c6b2eb8c-5d42-4f13-9168-645f22350bf2-kube-api-access-j5kww\") pod \"payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz\" (UID: \"c6b2eb8c-5d42-4f13-9168-645f22350bf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:32:40.549285 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.549114    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b2eb8c-5d42-4f13-9168-645f22350bf2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz\" (UID: \"c6b2eb8c-5d42-4f13-9168-645f22350bf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:32:40.549839 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.549819    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b2eb8c-5d42-4f13-9168-645f22350bf2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz\" (UID: \"c6b2eb8c-5d42-4f13-9168-645f22350bf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:32:40.562193 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.562164    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5kww\" (UniqueName: \"kubernetes.io/projected/c6b2eb8c-5d42-4f13-9168-645f22350bf2-kube-api-access-j5kww\") pod \"payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz\" (UID: \"c6b2eb8c-5d42-4f13-9168-645f22350bf2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:32:40.636956 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.636913    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:32:40.921886 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:40.921860    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"]
Sep 08 15:32:40.922903 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:32:40.922881    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b2eb8c_5d42_4f13_9168_645f22350bf2.slice/crio-601da6adb5c61c502f4dae7f491e352fbb81892697c058c51e6e42b7d5de6793 WatchSource:0}: Error finding container 601da6adb5c61c502f4dae7f491e352fbb81892697c058c51e6e42b7d5de6793: Status 404 returned error can't find the container with id 601da6adb5c61c502f4dae7f491e352fbb81892697c058c51e6e42b7d5de6793
Sep 08 15:32:41.566474 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:41.566431    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz" event={"ID":"c6b2eb8c-5d42-4f13-9168-645f22350bf2","Type":"ContainerStarted","Data":"ef02bf96a36e156d2544d73772ffe4952742f73af60789dde42b1884586968fe"}
Sep 08 15:32:41.566940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:41.566508    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:32:41.566940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:41.566533    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz" event={"ID":"c6b2eb8c-5d42-4f13-9168-645f22350bf2","Type":"ContainerStarted","Data":"601da6adb5c61c502f4dae7f491e352fbb81892697c058c51e6e42b7d5de6793"}
Sep 08 15:32:41.586956 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:41.586900    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz" podStartSLOduration=1.586881534 podStartE2EDuration="1.586881534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:41.585257061 +0000 UTC m=+1422.156803105" watchObservedRunningTime="2026-09-08 15:32:41.586881534 +0000 UTC m=+1422.158427576"
Sep 08 15:32:52.575599 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:32:52.575519    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:33:04.074901 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:04.074870    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7849-139928158754256"]
Sep 08 15:33:04.078668 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:04.078646    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:04.081692 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:04.081654    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kvpjx\""
Sep 08 15:33:04.087830 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:04.087803    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-139928158754256"]
Sep 08 15:33:04.180067 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:04.180022    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh7tx\" (UniqueName: \"kubernetes.io/projected/db9454af-41c3-4750-bec2-3f3892fdb4ac-kube-api-access-jh7tx\") pod \"test-curl-7849-139928158754256\" (UID: \"db9454af-41c3-4750-bec2-3f3892fdb4ac\") " pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:04.281073 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:04.281030    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh7tx\" (UniqueName: \"kubernetes.io/projected/db9454af-41c3-4750-bec2-3f3892fdb4ac-kube-api-access-jh7tx\") pod \"test-curl-7849-139928158754256\" (UID: \"db9454af-41c3-4750-bec2-3f3892fdb4ac\") " pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:04.290000 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:04.289971    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh7tx\" (UniqueName: \"kubernetes.io/projected/db9454af-41c3-4750-bec2-3f3892fdb4ac-kube-api-access-jh7tx\") pod \"test-curl-7849-139928158754256\" (UID: \"db9454af-41c3-4750-bec2-3f3892fdb4ac\") " pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:04.389921 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:04.389885    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:04.667141 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:04.667113    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-139928158754256"]
Sep 08 15:33:04.669247 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:33:04.669216    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb9454af_41c3_4750_bec2_3f3892fdb4ac.slice/crio-038f54d99802c080249e392cd92304c4390f68c6861f58dcee240af173d773d6 WatchSource:0}: Error finding container 038f54d99802c080249e392cd92304c4390f68c6861f58dcee240af173d773d6: Status 404 returned error can't find the container with id 038f54d99802c080249e392cd92304c4390f68c6861f58dcee240af173d773d6
Sep 08 15:33:04.670811 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:04.670794    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:33:04.712083 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:04.712044    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-139928158754256" event={"ID":"db9454af-41c3-4750-bec2-3f3892fdb4ac","Type":"ContainerStarted","Data":"038f54d99802c080249e392cd92304c4390f68c6861f58dcee240af173d773d6"}
Sep 08 15:33:05.719276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:05.719184    2566 generic.go:356] "Generic (PLEG): container finished" podID="db9454af-41c3-4750-bec2-3f3892fdb4ac" containerID="a901c1c83803f31c93f4fa13bb1fc14cfa293dd272ad19dbfcded3a7dd1c4595" exitCode=0
Sep 08 15:33:05.719691 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:05.719274    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-139928158754256" event={"ID":"db9454af-41c3-4750-bec2-3f3892fdb4ac","Type":"ContainerDied","Data":"a901c1c83803f31c93f4fa13bb1fc14cfa293dd272ad19dbfcded3a7dd1c4595"}
Sep 08 15:33:06.870475 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:06.870449    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:06.915522 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:06.915491    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7849-139928158754256_db9454af-41c3-4750-bec2-3f3892fdb4ac/test-curl-7849-139928158754256/0.log"
Sep 08 15:33:06.940339 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:06.940299    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7849-139928158754256"]
Sep 08 15:33:06.944410 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:06.944386    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7849-139928158754256"]
Sep 08 15:33:07.007899 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.007812    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh7tx\" (UniqueName: \"kubernetes.io/projected/db9454af-41c3-4750-bec2-3f3892fdb4ac-kube-api-access-jh7tx\") pod \"db9454af-41c3-4750-bec2-3f3892fdb4ac\" (UID: \"db9454af-41c3-4750-bec2-3f3892fdb4ac\") "
Sep 08 15:33:07.010061 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.010035    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db9454af-41c3-4750-bec2-3f3892fdb4ac-kube-api-access-jh7tx" (OuterVolumeSpecName: "kube-api-access-jh7tx") pod "db9454af-41c3-4750-bec2-3f3892fdb4ac" (UID: "db9454af-41c3-4750-bec2-3f3892fdb4ac"). InnerVolumeSpecName "kube-api-access-jh7tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:33:07.075326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.075291    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7849-139928158754256"]
Sep 08 15:33:07.075819 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.075804    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db9454af-41c3-4750-bec2-3f3892fdb4ac" containerName="test-curl-7849-139928158754256"
Sep 08 15:33:07.075862 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.075822    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="db9454af-41c3-4750-bec2-3f3892fdb4ac" containerName="test-curl-7849-139928158754256"
Sep 08 15:33:07.075902 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.075893    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="db9454af-41c3-4750-bec2-3f3892fdb4ac" containerName="test-curl-7849-139928158754256"
Sep 08 15:33:07.079199 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.079183    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:07.085424 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.085392    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-139928158754256"]
Sep 08 15:33:07.108882 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.108851    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh7tx\" (UniqueName: \"kubernetes.io/projected/db9454af-41c3-4750-bec2-3f3892fdb4ac-kube-api-access-jh7tx\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:33:07.209986 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.209948    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mz5c\" (UniqueName: \"kubernetes.io/projected/6b04a68f-8c11-4ddc-b639-98f4176267de-kube-api-access-5mz5c\") pod \"test-curl-7849-139928158754256\" (UID: \"6b04a68f-8c11-4ddc-b639-98f4176267de\") " pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:07.310646 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.310533    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mz5c\" (UniqueName: \"kubernetes.io/projected/6b04a68f-8c11-4ddc-b639-98f4176267de-kube-api-access-5mz5c\") pod \"test-curl-7849-139928158754256\" (UID: \"6b04a68f-8c11-4ddc-b639-98f4176267de\") " pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:07.319800 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.319775    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mz5c\" (UniqueName: \"kubernetes.io/projected/6b04a68f-8c11-4ddc-b639-98f4176267de-kube-api-access-5mz5c\") pod \"test-curl-7849-139928158754256\" (UID: \"6b04a68f-8c11-4ddc-b639-98f4176267de\") " pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:07.392319 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.392280    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:07.669963 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.669939    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-139928158754256"]
Sep 08 15:33:07.672276 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:33:07.672253    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b04a68f_8c11_4ddc_b639_98f4176267de.slice/crio-9163d2d67a42a6f742d64474a5f36d3d82c139af97f99106ba5c14c28b28688c WatchSource:0}: Error finding container 9163d2d67a42a6f742d64474a5f36d3d82c139af97f99106ba5c14c28b28688c: Status 404 returned error can't find the container with id 9163d2d67a42a6f742d64474a5f36d3d82c139af97f99106ba5c14c28b28688c
Sep 08 15:33:07.735373 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.735334    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-139928158754256" event={"ID":"6b04a68f-8c11-4ddc-b639-98f4176267de","Type":"ContainerStarted","Data":"9163d2d67a42a6f742d64474a5f36d3d82c139af97f99106ba5c14c28b28688c"}
Sep 08 15:33:07.736841 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.736816    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:07.736961 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.736823    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="038f54d99802c080249e392cd92304c4390f68c6861f58dcee240af173d773d6"
Sep 08 15:33:07.754331 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.754298    2566 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7849-139928158754256" oldPodUID="db9454af-41c3-4750-bec2-3f3892fdb4ac" podUID="6b04a68f-8c11-4ddc-b639-98f4176267de"
Sep 08 15:33:07.914931 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:07.914898    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db9454af-41c3-4750-bec2-3f3892fdb4ac" path="/var/lib/kubelet/pods/db9454af-41c3-4750-bec2-3f3892fdb4ac/volumes"
Sep 08 15:33:08.744436 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:08.744404    2566 generic.go:356] "Generic (PLEG): container finished" podID="6b04a68f-8c11-4ddc-b639-98f4176267de" containerID="d8d0cf5973f7fd824fcbc47769b1cbaecd08b02907879cee762675e731ce8c5c" exitCode=0
Sep 08 15:33:08.744647 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:08.744480    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-139928158754256" event={"ID":"6b04a68f-8c11-4ddc-b639-98f4176267de","Type":"ContainerDied","Data":"d8d0cf5973f7fd824fcbc47769b1cbaecd08b02907879cee762675e731ce8c5c"}
Sep 08 15:33:09.895577 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:09.895546    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:09.916396 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:09.916364    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7849-139928158754256_6b04a68f-8c11-4ddc-b639-98f4176267de/test-curl-7849-139928158754256/0.log"
Sep 08 15:33:09.944481 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:09.944438    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7849-139928158754256"]
Sep 08 15:33:09.949259 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:09.949221    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7849-139928158754256"]
Sep 08 15:33:10.035216 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.035126    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mz5c\" (UniqueName: \"kubernetes.io/projected/6b04a68f-8c11-4ddc-b639-98f4176267de-kube-api-access-5mz5c\") pod \"6b04a68f-8c11-4ddc-b639-98f4176267de\" (UID: \"6b04a68f-8c11-4ddc-b639-98f4176267de\") "
Sep 08 15:33:10.037434 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.037401    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b04a68f-8c11-4ddc-b639-98f4176267de-kube-api-access-5mz5c" (OuterVolumeSpecName: "kube-api-access-5mz5c") pod "6b04a68f-8c11-4ddc-b639-98f4176267de" (UID: "6b04a68f-8c11-4ddc-b639-98f4176267de"). InnerVolumeSpecName "kube-api-access-5mz5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:33:10.068736 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.068702    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7849-139928158754832"]
Sep 08 15:33:10.069171 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.069157    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b04a68f-8c11-4ddc-b639-98f4176267de" containerName="test-curl-7849-139928158754256"
Sep 08 15:33:10.069209 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.069173    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b04a68f-8c11-4ddc-b639-98f4176267de" containerName="test-curl-7849-139928158754256"
Sep 08 15:33:10.069261 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.069252    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b04a68f-8c11-4ddc-b639-98f4176267de" containerName="test-curl-7849-139928158754256"
Sep 08 15:33:10.072352 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.072333    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:10.080078 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.080013    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-139928158754832"]
Sep 08 15:33:10.136376 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.136336    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92gwj\" (UniqueName: \"kubernetes.io/projected/aae52056-2881-4cda-8e3e-dcedf5cb22a2-kube-api-access-92gwj\") pod \"test-curl-7849-139928158754832\" (UID: \"aae52056-2881-4cda-8e3e-dcedf5cb22a2\") " pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:10.136559 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.136408    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mz5c\" (UniqueName: \"kubernetes.io/projected/6b04a68f-8c11-4ddc-b639-98f4176267de-kube-api-access-5mz5c\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:33:10.237109 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.237063    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92gwj\" (UniqueName: \"kubernetes.io/projected/aae52056-2881-4cda-8e3e-dcedf5cb22a2-kube-api-access-92gwj\") pod \"test-curl-7849-139928158754832\" (UID: \"aae52056-2881-4cda-8e3e-dcedf5cb22a2\") " pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:10.247608 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.247581    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92gwj\" (UniqueName: \"kubernetes.io/projected/aae52056-2881-4cda-8e3e-dcedf5cb22a2-kube-api-access-92gwj\") pod \"test-curl-7849-139928158754832\" (UID: \"aae52056-2881-4cda-8e3e-dcedf5cb22a2\") " pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:10.384126 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.384082    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:10.659598 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.659561    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-139928158754832"]
Sep 08 15:33:10.660834 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:33:10.660800    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaae52056_2881_4cda_8e3e_dcedf5cb22a2.slice/crio-c86bf3e745ba0503c58fb8d329493be4508f61b94c94f0f136736b78d30e947d WatchSource:0}: Error finding container c86bf3e745ba0503c58fb8d329493be4508f61b94c94f0f136736b78d30e947d: Status 404 returned error can't find the container with id c86bf3e745ba0503c58fb8d329493be4508f61b94c94f0f136736b78d30e947d
Sep 08 15:33:10.758530 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.758483    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-139928158754832" event={"ID":"aae52056-2881-4cda-8e3e-dcedf5cb22a2","Type":"ContainerStarted","Data":"c86bf3e745ba0503c58fb8d329493be4508f61b94c94f0f136736b78d30e947d"}
Sep 08 15:33:10.759915 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.759897    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9163d2d67a42a6f742d64474a5f36d3d82c139af97f99106ba5c14c28b28688c"
Sep 08 15:33:10.759915 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:10.759899    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:10.776532 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:33:10.776495    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7849-139928158754256\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="6b04a68f-8c11-4ddc-b639-98f4176267de" pod="opendatahub/test-curl-7849-139928158754256"
Sep 08 15:33:11.915632 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:11.915585    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b04a68f-8c11-4ddc-b639-98f4176267de" path="/var/lib/kubelet/pods/6b04a68f-8c11-4ddc-b639-98f4176267de/volumes"
Sep 08 15:33:12.774084 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:12.774050    2566 generic.go:356] "Generic (PLEG): container finished" podID="aae52056-2881-4cda-8e3e-dcedf5cb22a2" containerID="a638b9f067a4201e4a982f76ceaf31d1587e56ed58bb9354b6dd0910c73a9df1" exitCode=0
Sep 08 15:33:12.774281 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:12.774146    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-139928158754832" event={"ID":"aae52056-2881-4cda-8e3e-dcedf5cb22a2","Type":"ContainerDied","Data":"a638b9f067a4201e4a982f76ceaf31d1587e56ed58bb9354b6dd0910c73a9df1"}
Sep 08 15:33:13.937696 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:13.937659    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:13.959852 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:13.959818    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7849-139928158754832_aae52056-2881-4cda-8e3e-dcedf5cb22a2/test-curl-7849-139928158754832/0.log"
Sep 08 15:33:13.987892 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:13.987863    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7849-139928158754832"]
Sep 08 15:33:13.992261 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:13.992235    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7849-139928158754832"]
Sep 08 15:33:14.073229 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.073137    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92gwj\" (UniqueName: \"kubernetes.io/projected/aae52056-2881-4cda-8e3e-dcedf5cb22a2-kube-api-access-92gwj\") pod \"aae52056-2881-4cda-8e3e-dcedf5cb22a2\" (UID: \"aae52056-2881-4cda-8e3e-dcedf5cb22a2\") "
Sep 08 15:33:14.075487 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.075449    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae52056-2881-4cda-8e3e-dcedf5cb22a2-kube-api-access-92gwj" (OuterVolumeSpecName: "kube-api-access-92gwj") pod "aae52056-2881-4cda-8e3e-dcedf5cb22a2" (UID: "aae52056-2881-4cda-8e3e-dcedf5cb22a2"). InnerVolumeSpecName "kube-api-access-92gwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:33:14.161201 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.161160    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7849-139928158754832"]
Sep 08 15:33:14.161655 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.161608    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae52056-2881-4cda-8e3e-dcedf5cb22a2" containerName="test-curl-7849-139928158754832"
Sep 08 15:33:14.161712 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.161658    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae52056-2881-4cda-8e3e-dcedf5cb22a2" containerName="test-curl-7849-139928158754832"
Sep 08 15:33:14.161756 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.161747    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae52056-2881-4cda-8e3e-dcedf5cb22a2" containerName="test-curl-7849-139928158754832"
Sep 08 15:33:14.165192 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.165176    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:14.174021 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.173995    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92gwj\" (UniqueName: \"kubernetes.io/projected/aae52056-2881-4cda-8e3e-dcedf5cb22a2-kube-api-access-92gwj\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:33:14.183728 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.183692    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-139928158754832"]
Sep 08 15:33:14.274684 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.274646    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdkqc\" (UniqueName: \"kubernetes.io/projected/fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add-kube-api-access-vdkqc\") pod \"test-curl-7849-139928158754832\" (UID: \"fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add\") " pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:14.375727 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.375690    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdkqc\" (UniqueName: \"kubernetes.io/projected/fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add-kube-api-access-vdkqc\") pod \"test-curl-7849-139928158754832\" (UID: \"fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add\") " pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:14.388111 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.388076    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdkqc\" (UniqueName: \"kubernetes.io/projected/fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add-kube-api-access-vdkqc\") pod \"test-curl-7849-139928158754832\" (UID: \"fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add\") " pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:14.474328 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.474294    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:14.761213 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.761179    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-139928158754832"]
Sep 08 15:33:14.763096 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:33:14.763060    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc8ae1e2_b9ad_41bd_950d_f4cbd9ab1add.slice/crio-ee32356f8b6ce2c85a63614c543b586dcf0470a0d53bc18faf237dda051e8ade WatchSource:0}: Error finding container ee32356f8b6ce2c85a63614c543b586dcf0470a0d53bc18faf237dda051e8ade: Status 404 returned error can't find the container with id ee32356f8b6ce2c85a63614c543b586dcf0470a0d53bc18faf237dda051e8ade
Sep 08 15:33:14.788183 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.788132    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-139928158754832" event={"ID":"fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add","Type":"ContainerStarted","Data":"ee32356f8b6ce2c85a63614c543b586dcf0470a0d53bc18faf237dda051e8ade"}
Sep 08 15:33:14.789577 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.789555    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c86bf3e745ba0503c58fb8d329493be4508f61b94c94f0f136736b78d30e947d"
Sep 08 15:33:14.789577 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.789558    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:14.801444 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:14.801412    2566 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7849-139928158754832" oldPodUID="aae52056-2881-4cda-8e3e-dcedf5cb22a2" podUID="fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add"
Sep 08 15:33:15.799030 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:15.798996    2566 generic.go:356] "Generic (PLEG): container finished" podID="fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add" containerID="46988bc6ca6269194743931d4c9193cdbfeecc5204b1b41e4ba5943d0c416cc4" exitCode=0
Sep 08 15:33:15.799420 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:15.799056    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-139928158754832" event={"ID":"fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add","Type":"ContainerDied","Data":"46988bc6ca6269194743931d4c9193cdbfeecc5204b1b41e4ba5943d0c416cc4"}
Sep 08 15:33:15.916287 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:15.916241    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aae52056-2881-4cda-8e3e-dcedf5cb22a2" path="/var/lib/kubelet/pods/aae52056-2881-4cda-8e3e-dcedf5cb22a2/volumes"
Sep 08 15:33:16.948601 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:16.948577    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:16.970137 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:16.970105    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7849-139928158754832_fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add/test-curl-7849-139928158754832/0.log"
Sep 08 15:33:16.996903 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:16.996870    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7849-139928158754832"]
Sep 08 15:33:17.003543 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:17.003513    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7849-139928158754832"]
Sep 08 15:33:17.102416 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:17.102376    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdkqc\" (UniqueName: \"kubernetes.io/projected/fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add-kube-api-access-vdkqc\") pod \"fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add\" (UID: \"fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add\") "
Sep 08 15:33:17.104683 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:17.104652    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add-kube-api-access-vdkqc" (OuterVolumeSpecName: "kube-api-access-vdkqc") pod "fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add" (UID: "fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add"). InnerVolumeSpecName "kube-api-access-vdkqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:33:17.203658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:17.203580    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdkqc\" (UniqueName: \"kubernetes.io/projected/fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add-kube-api-access-vdkqc\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:33:17.813686 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:17.813654    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:17.813888 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:17.813669    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee32356f8b6ce2c85a63614c543b586dcf0470a0d53bc18faf237dda051e8ade"
Sep 08 15:33:17.824005 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:33:17.823976    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7849-139928158754832\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add" pod="opendatahub/test-curl-7849-139928158754832"
Sep 08 15:33:17.916030 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:17.916001    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add" path="/var/lib/kubelet/pods/fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add/volumes"
Sep 08 15:33:23.045192 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.045151    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"]
Sep 08 15:33:23.045654 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.045611    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add" containerName="test-curl-7849-139928158754832"
Sep 08 15:33:23.045654 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.045655    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add" containerName="test-curl-7849-139928158754832"
Sep 08 15:33:23.045753 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.045728    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc8ae1e2-b9ad-41bd-950d-f4cbd9ab1add" containerName="test-curl-7849-139928158754832"
Sep 08 15:33:23.049390 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.049366    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:33:23.052773 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.052753    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ae34c54a-dockercfg-mdqh4\""
Sep 08 15:33:23.053218 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.053198    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ae34c54a\""
Sep 08 15:33:23.077358 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.077277    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"]
Sep 08 15:33:23.163499 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.163458    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94979e36-7e53-4aaa-ba19-c9180304b73b-plugins-config-volume\") pod \"payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt\" (UID: \"94979e36-7e53-4aaa-ba19-c9180304b73b\") " pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:33:23.163738 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.163530    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whgqb\" (UniqueName: \"kubernetes.io/projected/94979e36-7e53-4aaa-ba19-c9180304b73b-kube-api-access-whgqb\") pod \"payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt\" (UID: \"94979e36-7e53-4aaa-ba19-c9180304b73b\") " pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:33:23.264097 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.264060    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94979e36-7e53-4aaa-ba19-c9180304b73b-plugins-config-volume\") pod \"payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt\" (UID: \"94979e36-7e53-4aaa-ba19-c9180304b73b\") " pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:33:23.264276 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.264121    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whgqb\" (UniqueName: \"kubernetes.io/projected/94979e36-7e53-4aaa-ba19-c9180304b73b-kube-api-access-whgqb\") pod \"payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt\" (UID: \"94979e36-7e53-4aaa-ba19-c9180304b73b\") " pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:33:23.264865 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.264845    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94979e36-7e53-4aaa-ba19-c9180304b73b-plugins-config-volume\") pod \"payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt\" (UID: \"94979e36-7e53-4aaa-ba19-c9180304b73b\") " pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:33:23.275723 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.275687    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whgqb\" (UniqueName: \"kubernetes.io/projected/94979e36-7e53-4aaa-ba19-c9180304b73b-kube-api-access-whgqb\") pod \"payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt\" (UID: \"94979e36-7e53-4aaa-ba19-c9180304b73b\") " pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:33:23.359935 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.359894    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:33:23.648372 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.648340    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"]
Sep 08 15:33:23.649919 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:33:23.649879    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94979e36_7e53_4aaa_ba19_c9180304b73b.slice/crio-088297b9f1123af41bdb1335106839a8b5cd3f33001e3691a6f120042341be90 WatchSource:0}: Error finding container 088297b9f1123af41bdb1335106839a8b5cd3f33001e3691a6f120042341be90: Status 404 returned error can't find the container with id 088297b9f1123af41bdb1335106839a8b5cd3f33001e3691a6f120042341be90
Sep 08 15:33:23.857034 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.856992    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt" event={"ID":"94979e36-7e53-4aaa-ba19-c9180304b73b","Type":"ContainerStarted","Data":"6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154"}
Sep 08 15:33:23.857320 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.857065    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt" event={"ID":"94979e36-7e53-4aaa-ba19-c9180304b73b","Type":"ContainerStarted","Data":"088297b9f1123af41bdb1335106839a8b5cd3f33001e3691a6f120042341be90"}
Sep 08 15:33:23.857320 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.857107    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:33:23.883420 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:23.883355    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt" podStartSLOduration=0.88332353 podStartE2EDuration="883.32353ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:33:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:33:23.881292189 +0000 UTC m=+1464.452838231" watchObservedRunningTime="2026-09-08 15:33:23.88332353 +0000 UTC m=+1464.454869575"
Sep 08 15:33:34.865239 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:33:34.865206    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:34:10.531053 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:10.531019    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7852-ea59b1"]
Sep 08 15:34:10.534919 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:10.534900    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-ea59b1"
Sep 08 15:34:10.537885 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:10.537857    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kvpjx\""
Sep 08 15:34:10.541141 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:10.541103    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7852-ea59b1"]
Sep 08 15:34:10.613501 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:10.613456    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brlb9\" (UniqueName: \"kubernetes.io/projected/b8d08a21-6c31-4076-8843-bb2bd5a0d244-kube-api-access-brlb9\") pod \"mt-curl-7852-ea59b1\" (UID: \"b8d08a21-6c31-4076-8843-bb2bd5a0d244\") " pod="opendatahub/mt-curl-7852-ea59b1"
Sep 08 15:34:10.714522 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:10.714481    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brlb9\" (UniqueName: \"kubernetes.io/projected/b8d08a21-6c31-4076-8843-bb2bd5a0d244-kube-api-access-brlb9\") pod \"mt-curl-7852-ea59b1\" (UID: \"b8d08a21-6c31-4076-8843-bb2bd5a0d244\") " pod="opendatahub/mt-curl-7852-ea59b1"
Sep 08 15:34:10.724182 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:10.724156    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brlb9\" (UniqueName: \"kubernetes.io/projected/b8d08a21-6c31-4076-8843-bb2bd5a0d244-kube-api-access-brlb9\") pod \"mt-curl-7852-ea59b1\" (UID: \"b8d08a21-6c31-4076-8843-bb2bd5a0d244\") " pod="opendatahub/mt-curl-7852-ea59b1"
Sep 08 15:34:10.846781 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:10.846749    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-ea59b1"
Sep 08 15:34:11.130696 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:11.130563    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7852-ea59b1"]
Sep 08 15:34:11.137606 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:34:11.137558    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8d08a21_6c31_4076_8843_bb2bd5a0d244.slice/crio-c8a2ed61155fae06dba15c21577da4ca63d131cadc1c7d5c350a05ea13599b29 WatchSource:0}: Error finding container c8a2ed61155fae06dba15c21577da4ca63d131cadc1c7d5c350a05ea13599b29: Status 404 returned error can't find the container with id c8a2ed61155fae06dba15c21577da4ca63d131cadc1c7d5c350a05ea13599b29
Sep 08 15:34:11.162814 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:11.162773    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7852-ea59b1" event={"ID":"b8d08a21-6c31-4076-8843-bb2bd5a0d244","Type":"ContainerStarted","Data":"c8a2ed61155fae06dba15c21577da4ca63d131cadc1c7d5c350a05ea13599b29"}
Sep 08 15:34:12.171761 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:12.171666    2566 generic.go:356] "Generic (PLEG): container finished" podID="b8d08a21-6c31-4076-8843-bb2bd5a0d244" containerID="687ced297bada4026ee5674201a767c1b4b88d55c4c2c8154c8fdfbc809f1bf2" exitCode=0
Sep 08 15:34:12.171761 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:12.171729    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7852-ea59b1" event={"ID":"b8d08a21-6c31-4076-8843-bb2bd5a0d244","Type":"ContainerDied","Data":"687ced297bada4026ee5674201a767c1b4b88d55c4c2c8154c8fdfbc809f1bf2"}
Sep 08 15:34:13.328636 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:13.328594    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-ea59b1"
Sep 08 15:34:13.335078 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:13.335050    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brlb9\" (UniqueName: \"kubernetes.io/projected/b8d08a21-6c31-4076-8843-bb2bd5a0d244-kube-api-access-brlb9\") pod \"b8d08a21-6c31-4076-8843-bb2bd5a0d244\" (UID: \"b8d08a21-6c31-4076-8843-bb2bd5a0d244\") "
Sep 08 15:34:13.337400 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:13.337369    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8d08a21-6c31-4076-8843-bb2bd5a0d244-kube-api-access-brlb9" (OuterVolumeSpecName: "kube-api-access-brlb9") pod "b8d08a21-6c31-4076-8843-bb2bd5a0d244" (UID: "b8d08a21-6c31-4076-8843-bb2bd5a0d244"). InnerVolumeSpecName "kube-api-access-brlb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:34:13.351435 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:13.351371    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7852-ea59b1_b8d08a21-6c31-4076-8843-bb2bd5a0d244/mt-curl-7852-ea59b1/0.log"
Sep 08 15:34:13.378186 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:13.378151    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7852-ea59b1"]
Sep 08 15:34:13.383746 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:13.383715    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7852-ea59b1"]
Sep 08 15:34:13.436245 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:13.436152    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brlb9\" (UniqueName: \"kubernetes.io/projected/b8d08a21-6c31-4076-8843-bb2bd5a0d244-kube-api-access-brlb9\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:34:13.914939 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:13.914894    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8d08a21-6c31-4076-8843-bb2bd5a0d244" path="/var/lib/kubelet/pods/b8d08a21-6c31-4076-8843-bb2bd5a0d244/volumes"
Sep 08 15:34:14.186144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:14.186048    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-ea59b1"
Sep 08 15:34:14.186144 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:14.186110    2566 scope.go:117] "RemoveContainer" containerID="687ced297bada4026ee5674201a767c1b4b88d55c4c2c8154c8fdfbc809f1bf2"
Sep 08 15:34:43.322444 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.322338    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"]
Sep 08 15:34:43.323126 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.323101    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8d08a21-6c31-4076-8843-bb2bd5a0d244" containerName="mt-curl-7852-ea59b1"
Sep 08 15:34:43.323220 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.323129    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8d08a21-6c31-4076-8843-bb2bd5a0d244" containerName="mt-curl-7852-ea59b1"
Sep 08 15:34:43.323310 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.323294    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8d08a21-6c31-4076-8843-bb2bd5a0d244" containerName="mt-curl-7852-ea59b1"
Sep 08 15:34:43.327015 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.326994    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.332194 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.331921    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-2e082e\"/\"openshift-service-ca.crt\""
Sep 08 15:34:43.332194 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.331969    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-2e082e\"/\"default-dockercfg-bq58p\""
Sep 08 15:34:43.332418 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.332241    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-2e082e\"/\"sub-test-model-2e082e-kserve-self-signed-certs\""
Sep 08 15:34:43.332695 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.332673    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-2e082e\"/\"kube-root-ca.crt\""
Sep 08 15:34:43.335865 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.335830    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"]
Sep 08 15:34:43.433882 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.433840    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-model-cache\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.433882 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.433882    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tmp-dir\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.434108 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.433909    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-home\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.434108 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.433965    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-dshm\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.434108 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.434013    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tls-certs\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.434108 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.434040    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7txk\" (UniqueName: \"kubernetes.io/projected/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-kube-api-access-h7txk\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.535479 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.535423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-model-cache\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.535479 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.535485    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tmp-dir\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.535751 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.535521    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-home\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.535751 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.535557    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-dshm\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.535751 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.535651    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tls-certs\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.535751 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.535692    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7txk\" (UniqueName: \"kubernetes.io/projected/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-kube-api-access-h7txk\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.535973 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.535954    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-model-cache\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.536022 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.535997    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tmp-dir\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.536057 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.536031    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-home\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.538168 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.538148    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-dshm\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.538342 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.538325    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tls-certs\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.545236 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.545208    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7txk\" (UniqueName: \"kubernetes.io/projected/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-kube-api-access-h7txk\") pod \"sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") " pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.642260 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.642221    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:43.926115 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:43.926084    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"]
Sep 08 15:34:43.927135 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:34:43.927111    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fa06e1c_61db_4bcf_a628_a8cb43503c7a.slice/crio-34c2d7da8838a4b8b62378a1757e73d98ffbd3fcc6055f922d7b6a4b319ef834 WatchSource:0}: Error finding container 34c2d7da8838a4b8b62378a1757e73d98ffbd3fcc6055f922d7b6a4b319ef834: Status 404 returned error can't find the container with id 34c2d7da8838a4b8b62378a1757e73d98ffbd3fcc6055f922d7b6a4b319ef834
Sep 08 15:34:44.390952 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:44.390903    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp" event={"ID":"6fa06e1c-61db-4bcf-a628-a8cb43503c7a","Type":"ContainerStarted","Data":"502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e"}
Sep 08 15:34:44.391410 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:44.390967    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp" event={"ID":"6fa06e1c-61db-4bcf-a628-a8cb43503c7a","Type":"ContainerStarted","Data":"34c2d7da8838a4b8b62378a1757e73d98ffbd3fcc6055f922d7b6a4b319ef834"}
Sep 08 15:34:44.413063 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:44.412997    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp" podStartSLOduration=1.412978769 podStartE2EDuration="1.412978769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:34:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:34:44.410300854 +0000 UTC m=+1544.981846888" watchObservedRunningTime="2026-09-08 15:34:44.412978769 +0000 UTC m=+1544.984524860"
Sep 08 15:34:53.643393 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:53.643349    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:53.644004 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:53.643417    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:53.656742 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:53.656710    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:54.467378 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:54.467351    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:34:56.891123 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:56.891065    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"]
Sep 08 15:34:56.899772 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:56.899730    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"
Sep 08 15:34:56.903123 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:56.903092    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qqvg\""
Sep 08 15:34:56.906048 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:56.905923    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"]
Sep 08 15:34:56.963027 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:56.962980    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c977be11-1243-4bf3-8d85-6b1f3c29f623-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z\" (UID: \"c977be11-1243-4bf3-8d85-6b1f3c29f623\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"
Sep 08 15:34:57.063828 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:57.063790    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c977be11-1243-4bf3-8d85-6b1f3c29f623-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z\" (UID: \"c977be11-1243-4bf3-8d85-6b1f3c29f623\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"
Sep 08 15:34:57.064439 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:57.064417    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c977be11-1243-4bf3-8d85-6b1f3c29f623-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z\" (UID: \"c977be11-1243-4bf3-8d85-6b1f3c29f623\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"
Sep 08 15:34:57.214722 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:57.214605    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"
Sep 08 15:34:57.494790 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:57.494763    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"]
Sep 08 15:34:57.496964 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:34:57.496940    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc977be11_1243_4bf3_8d85_6b1f3c29f623.slice/crio-623b255a6e9b8b91b8354e83da9c3526fe2f37c443987d09ee9cd47e2376343c WatchSource:0}: Error finding container 623b255a6e9b8b91b8354e83da9c3526fe2f37c443987d09ee9cd47e2376343c: Status 404 returned error can't find the container with id 623b255a6e9b8b91b8354e83da9c3526fe2f37c443987d09ee9cd47e2376343c
Sep 08 15:34:58.488570 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:34:58.488537    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z" event={"ID":"c977be11-1243-4bf3-8d85-6b1f3c29f623","Type":"ContainerStarted","Data":"623b255a6e9b8b91b8354e83da9c3526fe2f37c443987d09ee9cd47e2376343c"}
Sep 08 15:35:01.510679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:01.510611    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z" event={"ID":"c977be11-1243-4bf3-8d85-6b1f3c29f623","Type":"ContainerStarted","Data":"155afe77182bb0271ecfa6a5dd8c698833685667a797fcf931361bd4595215cd"}
Sep 08 15:35:01.529373 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:01.529324    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z" podStartSLOduration=2.079440063 podStartE2EDuration="5.5293094s" totalImagesPullingTime="3.449869337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:35:01.527941084 +0000 UTC m=+1562.099487126" watchObservedRunningTime="2026-09-08 15:35:01.5293094 +0000 UTC m=+1562.100855439"
Sep 08 15:35:02.524914 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:02.524872    2566 generic.go:356] "Generic (PLEG): container finished" podID="c977be11-1243-4bf3-8d85-6b1f3c29f623" containerID="155afe77182bb0271ecfa6a5dd8c698833685667a797fcf931361bd4595215cd" exitCode=0
Sep 08 15:35:02.525313 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:02.524962    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z" event={"ID":"c977be11-1243-4bf3-8d85-6b1f3c29f623","Type":"ContainerDied","Data":"155afe77182bb0271ecfa6a5dd8c698833685667a797fcf931361bd4595215cd"}
Sep 08 15:35:03.679728 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:03.679690    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"
Sep 08 15:35:03.733778 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:03.733727    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c977be11-1243-4bf3-8d85-6b1f3c29f623-maas-api-service-ca\") pod \"c977be11-1243-4bf3-8d85-6b1f3c29f623\" (UID: \"c977be11-1243-4bf3-8d85-6b1f3c29f623\") "
Sep 08 15:35:03.734161 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:03.734136    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c977be11-1243-4bf3-8d85-6b1f3c29f623-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c977be11-1243-4bf3-8d85-6b1f3c29f623" (UID: "c977be11-1243-4bf3-8d85-6b1f3c29f623"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:35:03.835106 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:03.835061    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c977be11-1243-4bf3-8d85-6b1f3c29f623-maas-api-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:35:04.539055 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:04.539028    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"
Sep 08 15:35:04.539285 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:04.539022    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z" event={"ID":"c977be11-1243-4bf3-8d85-6b1f3c29f623","Type":"ContainerDied","Data":"623b255a6e9b8b91b8354e83da9c3526fe2f37c443987d09ee9cd47e2376343c"}
Sep 08 15:35:04.539285 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:04.539157    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="623b255a6e9b8b91b8354e83da9c3526fe2f37c443987d09ee9cd47e2376343c"
Sep 08 15:35:12.556194 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:12.556152    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"]
Sep 08 15:35:12.556697 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:12.556423    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt" podUID="94979e36-7e53-4aaa-ba19-c9180304b73b" containerName="payload-processing" containerID="cri-o://6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154" gracePeriod=30
Sep 08 15:35:12.847283 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:12.847249    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:35:12.874640 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:12.874007    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"]
Sep 08 15:35:12.888426 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:12.888374    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae34c54a-f6g2z"]
Sep 08 15:35:12.923549 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:12.923513    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whgqb\" (UniqueName: \"kubernetes.io/projected/94979e36-7e53-4aaa-ba19-c9180304b73b-kube-api-access-whgqb\") pod \"94979e36-7e53-4aaa-ba19-c9180304b73b\" (UID: \"94979e36-7e53-4aaa-ba19-c9180304b73b\") "
Sep 08 15:35:12.923738 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:12.923602    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94979e36-7e53-4aaa-ba19-c9180304b73b-plugins-config-volume\") pod \"94979e36-7e53-4aaa-ba19-c9180304b73b\" (UID: \"94979e36-7e53-4aaa-ba19-c9180304b73b\") "
Sep 08 15:35:12.923969 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:12.923935    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94979e36-7e53-4aaa-ba19-c9180304b73b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94979e36-7e53-4aaa-ba19-c9180304b73b" (UID: "94979e36-7e53-4aaa-ba19-c9180304b73b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:35:12.924087 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:12.924040    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94979e36-7e53-4aaa-ba19-c9180304b73b-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:35:12.925831 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:12.925807    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94979e36-7e53-4aaa-ba19-c9180304b73b-kube-api-access-whgqb" (OuterVolumeSpecName: "kube-api-access-whgqb") pod "94979e36-7e53-4aaa-ba19-c9180304b73b" (UID: "94979e36-7e53-4aaa-ba19-c9180304b73b"). InnerVolumeSpecName "kube-api-access-whgqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:35:13.024811 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.024772    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whgqb\" (UniqueName: \"kubernetes.io/projected/94979e36-7e53-4aaa-ba19-c9180304b73b-kube-api-access-whgqb\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:35:13.604591 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.604543    2566 generic.go:356] "Generic (PLEG): container finished" podID="94979e36-7e53-4aaa-ba19-c9180304b73b" containerID="6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154" exitCode=0
Sep 08 15:35:13.605101 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.604612    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"
Sep 08 15:35:13.605101 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.604645    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt" event={"ID":"94979e36-7e53-4aaa-ba19-c9180304b73b","Type":"ContainerDied","Data":"6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154"}
Sep 08 15:35:13.605101 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.604709    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt" event={"ID":"94979e36-7e53-4aaa-ba19-c9180304b73b","Type":"ContainerDied","Data":"088297b9f1123af41bdb1335106839a8b5cd3f33001e3691a6f120042341be90"}
Sep 08 15:35:13.605101 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.604736    2566 scope.go:117] "RemoveContainer" containerID="6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154"
Sep 08 15:35:13.616045 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.616020    2566 scope.go:117] "RemoveContainer" containerID="6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154"
Sep 08 15:35:13.616362 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:35:13.616340    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154\": container with ID starting with 6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154 not found: ID does not exist" containerID="6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154"
Sep 08 15:35:13.616417 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.616373    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154"} err="failed to get container status \"6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154\": rpc error: code = NotFound desc = could not find container \"6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154\": container with ID starting with 6de9b42ae9c8bee960cb6383a579cbe226c3395e1695b9b4aa97746b79c4b154 not found: ID does not exist"
Sep 08 15:35:13.631009 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.630970    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"]
Sep 08 15:35:13.640747 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.640716    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ae34c54a-7588ff7777-985vt"]
Sep 08 15:35:13.915559 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.915467    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94979e36-7e53-4aaa-ba19-c9180304b73b" path="/var/lib/kubelet/pods/94979e36-7e53-4aaa-ba19-c9180304b73b/volumes"
Sep 08 15:35:13.915846 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:13.915833    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c977be11-1243-4bf3-8d85-6b1f3c29f623" path="/var/lib/kubelet/pods/c977be11-1243-4bf3-8d85-6b1f3c29f623/volumes"
Sep 08 15:35:45.323239 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.323204    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7852-848c28"]
Sep 08 15:35:45.323803 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.323727    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977be11-1243-4bf3-8d85-6b1f3c29f623" containerName="revoke-keys"
Sep 08 15:35:45.323803 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.323741    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977be11-1243-4bf3-8d85-6b1f3c29f623" containerName="revoke-keys"
Sep 08 15:35:45.323803 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.323758    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94979e36-7e53-4aaa-ba19-c9180304b73b" containerName="payload-processing"
Sep 08 15:35:45.323803 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.323763    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="94979e36-7e53-4aaa-ba19-c9180304b73b" containerName="payload-processing"
Sep 08 15:35:45.323949 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.323844    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="94979e36-7e53-4aaa-ba19-c9180304b73b" containerName="payload-processing"
Sep 08 15:35:45.323949 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.323854    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c977be11-1243-4bf3-8d85-6b1f3c29f623" containerName="revoke-keys"
Sep 08 15:35:45.328301 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.328280    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-848c28"
Sep 08 15:35:45.332598 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.332571    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kvpjx\""
Sep 08 15:35:45.336948 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.336921    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7852-848c28"]
Sep 08 15:35:45.411647 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.411588    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2qlf\" (UniqueName: \"kubernetes.io/projected/8d50a540-5f41-448a-9331-de7042de7c16-kube-api-access-p2qlf\") pod \"mt-curl-7852-848c28\" (UID: \"8d50a540-5f41-448a-9331-de7042de7c16\") " pod="opendatahub/mt-curl-7852-848c28"
Sep 08 15:35:45.512107 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.512066    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2qlf\" (UniqueName: \"kubernetes.io/projected/8d50a540-5f41-448a-9331-de7042de7c16-kube-api-access-p2qlf\") pod \"mt-curl-7852-848c28\" (UID: \"8d50a540-5f41-448a-9331-de7042de7c16\") " pod="opendatahub/mt-curl-7852-848c28"
Sep 08 15:35:45.521415 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.521385    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2qlf\" (UniqueName: \"kubernetes.io/projected/8d50a540-5f41-448a-9331-de7042de7c16-kube-api-access-p2qlf\") pod \"mt-curl-7852-848c28\" (UID: \"8d50a540-5f41-448a-9331-de7042de7c16\") " pod="opendatahub/mt-curl-7852-848c28"
Sep 08 15:35:45.640331 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.640297    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-848c28"
Sep 08 15:35:45.919174 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:45.919147    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7852-848c28"]
Sep 08 15:35:45.919658 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:35:45.919639    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d50a540_5f41_448a_9331_de7042de7c16.slice/crio-4bc6b5d3a63bd34d07267dff26309002fbfbd48c064da621e5d313ac238de81b WatchSource:0}: Error finding container 4bc6b5d3a63bd34d07267dff26309002fbfbd48c064da621e5d313ac238de81b: Status 404 returned error can't find the container with id 4bc6b5d3a63bd34d07267dff26309002fbfbd48c064da621e5d313ac238de81b
Sep 08 15:35:46.831944 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:46.831908    2566 generic.go:356] "Generic (PLEG): container finished" podID="8d50a540-5f41-448a-9331-de7042de7c16" containerID="28d43637a9b92469124077e16abbdd6ce2dfcd922fe84a8e83bb1b7fae997da7" exitCode=0
Sep 08 15:35:46.832303 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:46.831998    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7852-848c28" event={"ID":"8d50a540-5f41-448a-9331-de7042de7c16","Type":"ContainerDied","Data":"28d43637a9b92469124077e16abbdd6ce2dfcd922fe84a8e83bb1b7fae997da7"}
Sep 08 15:35:46.832303 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:46.832040    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7852-848c28" event={"ID":"8d50a540-5f41-448a-9331-de7042de7c16","Type":"ContainerStarted","Data":"4bc6b5d3a63bd34d07267dff26309002fbfbd48c064da621e5d313ac238de81b"}
Sep 08 15:35:47.999791 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:47.999765    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-848c28"
Sep 08 15:35:48.032386 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:48.032354    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2qlf\" (UniqueName: \"kubernetes.io/projected/8d50a540-5f41-448a-9331-de7042de7c16-kube-api-access-p2qlf\") pod \"8d50a540-5f41-448a-9331-de7042de7c16\" (UID: \"8d50a540-5f41-448a-9331-de7042de7c16\") "
Sep 08 15:35:48.034566 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:48.034534    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d50a540-5f41-448a-9331-de7042de7c16-kube-api-access-p2qlf" (OuterVolumeSpecName: "kube-api-access-p2qlf") pod "8d50a540-5f41-448a-9331-de7042de7c16" (UID: "8d50a540-5f41-448a-9331-de7042de7c16"). InnerVolumeSpecName "kube-api-access-p2qlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:35:48.044011 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:48.043979    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7852-848c28_8d50a540-5f41-448a-9331-de7042de7c16/mt-curl-7852-848c28/0.log"
Sep 08 15:35:48.068978 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:48.068933    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7852-848c28"]
Sep 08 15:35:48.071772 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:48.071751    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7852-848c28"]
Sep 08 15:35:48.133518 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:48.133445    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2qlf\" (UniqueName: \"kubernetes.io/projected/8d50a540-5f41-448a-9331-de7042de7c16-kube-api-access-p2qlf\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:35:48.846508 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:48.846478    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-848c28"
Sep 08 15:35:48.846704 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:48.846490    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bc6b5d3a63bd34d07267dff26309002fbfbd48c064da621e5d313ac238de81b"
Sep 08 15:35:48.856844 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:35:48.856816    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7852-848c28\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="8d50a540-5f41-448a-9331-de7042de7c16" pod="opendatahub/mt-curl-7852-848c28"
Sep 08 15:35:49.914314 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:35:49.914269    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7852-848c28\" is forbidden: User \"system:node:ip-10-0-138-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-20.ec2.internal' and this object" podUID="8d50a540-5f41-448a-9331-de7042de7c16" pod="opendatahub/mt-curl-7852-848c28"
Sep 08 15:35:49.915923 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:49.915896    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d50a540-5f41-448a-9331-de7042de7c16" path="/var/lib/kubelet/pods/8d50a540-5f41-448a-9331-de7042de7c16/volumes"
Sep 08 15:35:50.258920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:35:50.258830    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"]
Sep 08 15:36:05.279641 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.279554    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp" podUID="6fa06e1c-61db-4bcf-a628-a8cb43503c7a" containerName="main" containerID="cri-o://502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e" gracePeriod=45
Sep 08 15:36:05.540926 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.540858    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:36:05.600025 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.599986    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tmp-dir\") pod \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") "
Sep 08 15:36:05.600215 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.600042    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7txk\" (UniqueName: \"kubernetes.io/projected/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-kube-api-access-h7txk\") pod \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") "
Sep 08 15:36:05.600215 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.600073    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-model-cache\") pod \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") "
Sep 08 15:36:05.600215 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.600095    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-home\") pod \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") "
Sep 08 15:36:05.600215 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.600182    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tls-certs\") pod \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") "
Sep 08 15:36:05.600215 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.600212    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-dshm\") pod \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\" (UID: \"6fa06e1c-61db-4bcf-a628-a8cb43503c7a\") "
Sep 08 15:36:05.600485 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.600302    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6fa06e1c-61db-4bcf-a628-a8cb43503c7a" (UID: "6fa06e1c-61db-4bcf-a628-a8cb43503c7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:05.600485 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.600351    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-model-cache" (OuterVolumeSpecName: "model-cache") pod "6fa06e1c-61db-4bcf-a628-a8cb43503c7a" (UID: "6fa06e1c-61db-4bcf-a628-a8cb43503c7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:05.600485 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.600419    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-home" (OuterVolumeSpecName: "home") pod "6fa06e1c-61db-4bcf-a628-a8cb43503c7a" (UID: "6fa06e1c-61db-4bcf-a628-a8cb43503c7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:05.600672 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.600532    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tmp-dir\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:36:05.600672 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.600549    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-model-cache\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:36:05.600672 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.600565    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-home\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:36:05.602725 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.602693    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-kube-api-access-h7txk" (OuterVolumeSpecName: "kube-api-access-h7txk") pod "6fa06e1c-61db-4bcf-a628-a8cb43503c7a" (UID: "6fa06e1c-61db-4bcf-a628-a8cb43503c7a"). InnerVolumeSpecName "kube-api-access-h7txk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:36:05.602834 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.602734    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6fa06e1c-61db-4bcf-a628-a8cb43503c7a" (UID: "6fa06e1c-61db-4bcf-a628-a8cb43503c7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:36:05.602834 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.602775    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-dshm" (OuterVolumeSpecName: "dshm") pod "6fa06e1c-61db-4bcf-a628-a8cb43503c7a" (UID: "6fa06e1c-61db-4bcf-a628-a8cb43503c7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:05.701203 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.701159    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-tls-certs\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:36:05.701203 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.701196    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-dshm\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:36:05.701203 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.701205    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7txk\" (UniqueName: \"kubernetes.io/projected/6fa06e1c-61db-4bcf-a628-a8cb43503c7a-kube-api-access-h7txk\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:36:05.959769 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.959734    2566 generic.go:356] "Generic (PLEG): container finished" podID="6fa06e1c-61db-4bcf-a628-a8cb43503c7a" containerID="502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e" exitCode=0
Sep 08 15:36:05.959948 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.959780    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"
Sep 08 15:36:05.959948 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.959813    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp" event={"ID":"6fa06e1c-61db-4bcf-a628-a8cb43503c7a","Type":"ContainerDied","Data":"502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e"}
Sep 08 15:36:05.959948 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.959857    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp" event={"ID":"6fa06e1c-61db-4bcf-a628-a8cb43503c7a","Type":"ContainerDied","Data":"34c2d7da8838a4b8b62378a1757e73d98ffbd3fcc6055f922d7b6a4b319ef834"}
Sep 08 15:36:05.959948 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.959875    2566 scope.go:117] "RemoveContainer" containerID="502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e"
Sep 08 15:36:05.969438 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.969413    2566 scope.go:117] "RemoveContainer" containerID="502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e"
Sep 08 15:36:05.969769 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:36:05.969750    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e\": container with ID starting with 502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e not found: ID does not exist" containerID="502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e"
Sep 08 15:36:05.969834 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.969779    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e"} err="failed to get container status \"502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e\": rpc error: code = NotFound desc = could not find container \"502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e\": container with ID starting with 502323f8f587732eac313be09a05404629b586db4bbb7cfbdf5e2317c5201b2e not found: ID does not exist"
Sep 08 15:36:05.980900 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.980872    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"]
Sep 08 15:36:05.983472 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:05.983445    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2e082e/sub-test-model-2e082e-kserve-6bd4ddf86c-tvncp"]
Sep 08 15:36:07.915088 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:36:07.915051    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fa06e1c-61db-4bcf-a628-a8cb43503c7a" path="/var/lib/kubelet/pods/6fa06e1c-61db-4bcf-a628-a8cb43503c7a/volumes"
Sep 08 15:37:13.285600 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.285558    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"]
Sep 08 15:37:13.286266 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.286245    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d50a540-5f41-448a-9331-de7042de7c16" containerName="mt-curl-7852-848c28"
Sep 08 15:37:13.286314 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.286270    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d50a540-5f41-448a-9331-de7042de7c16" containerName="mt-curl-7852-848c28"
Sep 08 15:37:13.286314 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.286304    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa06e1c-61db-4bcf-a628-a8cb43503c7a" containerName="main"
Sep 08 15:37:13.286314 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.286311    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa06e1c-61db-4bcf-a628-a8cb43503c7a" containerName="main"
Sep 08 15:37:13.286433 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.286421    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d50a540-5f41-448a-9331-de7042de7c16" containerName="mt-curl-7852-848c28"
Sep 08 15:37:13.286467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.286436    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa06e1c-61db-4bcf-a628-a8cb43503c7a" containerName="main"
Sep 08 15:37:13.289581 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.289562    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:37:13.293202 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.293184    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-61a1d6\""
Sep 08 15:37:13.306780 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.306751    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"]
Sep 08 15:37:13.311545 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.311518    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"]
Sep 08 15:37:13.314603 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.314577    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:37:13.319355 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.319332    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-61a1d6-dockercfg-tgjqv\""
Sep 08 15:37:13.345981 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.345948    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"]
Sep 08 15:37:13.366632 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.366583    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssszb\" (UniqueName: \"kubernetes.io/projected/933fbb47-fd85-40f7-8293-ca3dee77a235-kube-api-access-ssszb\") pod \"payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb\" (UID: \"933fbb47-fd85-40f7-8293-ca3dee77a235\") " pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:37:13.366833 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.366703    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxqfh\" (UniqueName: \"kubernetes.io/projected/a182419e-b8f0-406b-b27b-031f3349b405-kube-api-access-jxqfh\") pod \"payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx\" (UID: \"a182419e-b8f0-406b-b27b-031f3349b405\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:37:13.366833 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.366736    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a182419e-b8f0-406b-b27b-031f3349b405-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx\" (UID: \"a182419e-b8f0-406b-b27b-031f3349b405\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:37:13.366833 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.366792    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/933fbb47-fd85-40f7-8293-ca3dee77a235-plugins-config-volume\") pod \"payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb\" (UID: \"933fbb47-fd85-40f7-8293-ca3dee77a235\") " pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:37:13.467880 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.467844    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssszb\" (UniqueName: \"kubernetes.io/projected/933fbb47-fd85-40f7-8293-ca3dee77a235-kube-api-access-ssszb\") pod \"payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb\" (UID: \"933fbb47-fd85-40f7-8293-ca3dee77a235\") " pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:37:13.468056 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.467933    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxqfh\" (UniqueName: \"kubernetes.io/projected/a182419e-b8f0-406b-b27b-031f3349b405-kube-api-access-jxqfh\") pod \"payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx\" (UID: \"a182419e-b8f0-406b-b27b-031f3349b405\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:37:13.468056 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.467968    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a182419e-b8f0-406b-b27b-031f3349b405-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx\" (UID: \"a182419e-b8f0-406b-b27b-031f3349b405\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:37:13.468056 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.468024    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/933fbb47-fd85-40f7-8293-ca3dee77a235-plugins-config-volume\") pod \"payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb\" (UID: \"933fbb47-fd85-40f7-8293-ca3dee77a235\") " pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:37:13.468971 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.468948    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/933fbb47-fd85-40f7-8293-ca3dee77a235-plugins-config-volume\") pod \"payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb\" (UID: \"933fbb47-fd85-40f7-8293-ca3dee77a235\") " pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:37:13.469031 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.468948    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a182419e-b8f0-406b-b27b-031f3349b405-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx\" (UID: \"a182419e-b8f0-406b-b27b-031f3349b405\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:37:13.480714 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.480683    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssszb\" (UniqueName: \"kubernetes.io/projected/933fbb47-fd85-40f7-8293-ca3dee77a235-kube-api-access-ssszb\") pod \"payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb\" (UID: \"933fbb47-fd85-40f7-8293-ca3dee77a235\") " pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:37:13.485721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.485689    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxqfh\" (UniqueName: \"kubernetes.io/projected/a182419e-b8f0-406b-b27b-031f3349b405-kube-api-access-jxqfh\") pod \"payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx\" (UID: \"a182419e-b8f0-406b-b27b-031f3349b405\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:37:13.601270 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.601239    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:37:13.625649 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.625602    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:37:13.903249 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.903220    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"]
Sep 08 15:37:13.923365 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:13.923131    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"]
Sep 08 15:37:13.927548 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:37:13.927502    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933fbb47_fd85_40f7_8293_ca3dee77a235.slice/crio-515785378d8c9f658d4cf76d850d121ea7bd6d9946d9c1b256977867d2e30b78 WatchSource:0}: Error finding container 515785378d8c9f658d4cf76d850d121ea7bd6d9946d9c1b256977867d2e30b78: Status 404 returned error can't find the container with id 515785378d8c9f658d4cf76d850d121ea7bd6d9946d9c1b256977867d2e30b78
Sep 08 15:37:14.419043 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:14.419009    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb" event={"ID":"933fbb47-fd85-40f7-8293-ca3dee77a235","Type":"ContainerStarted","Data":"d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f"}
Sep 08 15:37:14.419558 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:14.419070    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb" event={"ID":"933fbb47-fd85-40f7-8293-ca3dee77a235","Type":"ContainerStarted","Data":"515785378d8c9f658d4cf76d850d121ea7bd6d9946d9c1b256977867d2e30b78"}
Sep 08 15:37:14.419558 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:14.419244    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:37:14.421011 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:14.420905    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx" event={"ID":"a182419e-b8f0-406b-b27b-031f3349b405","Type":"ContainerStarted","Data":"ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22"}
Sep 08 15:37:14.421011 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:14.420957    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:37:14.421011 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:14.420982    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx" event={"ID":"a182419e-b8f0-406b-b27b-031f3349b405","Type":"ContainerStarted","Data":"a616c6a671c4da4600ecdfb195a1c89e34d2003ba5b3be415225376120aab8b9"}
Sep 08 15:37:14.443318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:14.443265    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb" podStartSLOduration=1.443250052 podStartE2EDuration="1.443250052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:14.442437487 +0000 UTC m=+1695.013983540" watchObservedRunningTime="2026-09-08 15:37:14.443250052 +0000 UTC m=+1695.014796093"
Sep 08 15:37:14.462024 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:14.461972    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx" podStartSLOduration=1.461954845 podStartE2EDuration="1.461954845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:14.461243927 +0000 UTC m=+1695.032789969" watchObservedRunningTime="2026-09-08 15:37:14.461954845 +0000 UTC m=+1695.033500888"
Sep 08 15:37:19.342404 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.342364    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"]
Sep 08 15:37:19.345575 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.345558    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:37:19.349360 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.349339    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-4a2c80-dockercfg-jlm6b\""
Sep 08 15:37:19.349722 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.349705    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-4a2c80\""
Sep 08 15:37:19.365305 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.365275    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"]
Sep 08 15:37:19.415238 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.415206    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd\" (UID: \"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:37:19.415421 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.415264    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdg6j\" (UniqueName: \"kubernetes.io/projected/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-kube-api-access-zdg6j\") pod \"payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd\" (UID: \"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:37:19.515800 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.515764    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdg6j\" (UniqueName: \"kubernetes.io/projected/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-kube-api-access-zdg6j\") pod \"payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd\" (UID: \"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:37:19.515984 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.515857    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd\" (UID: \"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:37:19.516507 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.516488    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd\" (UID: \"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:37:19.531152 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.531124    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdg6j\" (UniqueName: \"kubernetes.io/projected/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-kube-api-access-zdg6j\") pod \"payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd\" (UID: \"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:37:19.656696 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.656561    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:37:19.941909 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:19.941882    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"]
Sep 08 15:37:19.944248 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:37:19.944214    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3dda3b_f6c4_4593_ad77_3e711cdc4d38.slice/crio-ebdd25659b072d5ea2fcc78f3ba44b6ff97427b946872abf86599a8a57aa559e WatchSource:0}: Error finding container ebdd25659b072d5ea2fcc78f3ba44b6ff97427b946872abf86599a8a57aa559e: Status 404 returned error can't find the container with id ebdd25659b072d5ea2fcc78f3ba44b6ff97427b946872abf86599a8a57aa559e
Sep 08 15:37:20.467960 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:20.467924    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd" event={"ID":"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38","Type":"ContainerStarted","Data":"09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094"}
Sep 08 15:37:20.468410 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:20.467978    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd" event={"ID":"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38","Type":"ContainerStarted","Data":"ebdd25659b072d5ea2fcc78f3ba44b6ff97427b946872abf86599a8a57aa559e"}
Sep 08 15:37:20.468410 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:20.468094    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:37:20.489855 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:20.489801    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd" podStartSLOduration=1.489783346 podStartE2EDuration="1.489783346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:20.488962346 +0000 UTC m=+1701.060508401" watchObservedRunningTime="2026-09-08 15:37:20.489783346 +0000 UTC m=+1701.061329387"
Sep 08 15:37:25.430259 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:25.430220    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:37:25.430675 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:25.430537    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:37:31.477982 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:31.477944    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:37:43.277320 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.277278    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"]
Sep 08 15:37:43.280931 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.280903    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:37:43.284153 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.284117    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ee0da5\""
Sep 08 15:37:43.284316 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.284265    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-ee0da5-dockercfg-xs289\""
Sep 08 15:37:43.295456 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.295426    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"]
Sep 08 15:37:43.356682 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.356607    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbwdm\" (UniqueName: \"kubernetes.io/projected/d256d90b-1a49-4d99-8e12-8ab5e959fb47-kube-api-access-sbwdm\") pod \"payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49\" (UID: \"d256d90b-1a49-4d99-8e12-8ab5e959fb47\") " pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:37:43.356854 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.356750    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d256d90b-1a49-4d99-8e12-8ab5e959fb47-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49\" (UID: \"d256d90b-1a49-4d99-8e12-8ab5e959fb47\") " pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:37:43.457887 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.457842    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbwdm\" (UniqueName: \"kubernetes.io/projected/d256d90b-1a49-4d99-8e12-8ab5e959fb47-kube-api-access-sbwdm\") pod \"payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49\" (UID: \"d256d90b-1a49-4d99-8e12-8ab5e959fb47\") " pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:37:43.458103 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.457910    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d256d90b-1a49-4d99-8e12-8ab5e959fb47-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49\" (UID: \"d256d90b-1a49-4d99-8e12-8ab5e959fb47\") " pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:37:43.458752 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.458725    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d256d90b-1a49-4d99-8e12-8ab5e959fb47-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49\" (UID: \"d256d90b-1a49-4d99-8e12-8ab5e959fb47\") " pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:37:43.468036 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.467999    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbwdm\" (UniqueName: \"kubernetes.io/projected/d256d90b-1a49-4d99-8e12-8ab5e959fb47-kube-api-access-sbwdm\") pod \"payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49\" (UID: \"d256d90b-1a49-4d99-8e12-8ab5e959fb47\") " pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:37:43.594085 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.594049    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:37:43.886701 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:43.886669    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"]
Sep 08 15:37:43.888722 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:37:43.888693    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd256d90b_1a49_4d99_8e12_8ab5e959fb47.slice/crio-049441b900211b2d3af8e8fc45151c7593be46e2fe1d2c48245a7f8fe3ba511e WatchSource:0}: Error finding container 049441b900211b2d3af8e8fc45151c7593be46e2fe1d2c48245a7f8fe3ba511e: Status 404 returned error can't find the container with id 049441b900211b2d3af8e8fc45151c7593be46e2fe1d2c48245a7f8fe3ba511e
Sep 08 15:37:44.639024 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:44.638989    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49" event={"ID":"d256d90b-1a49-4d99-8e12-8ab5e959fb47","Type":"ContainerStarted","Data":"f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489"}
Sep 08 15:37:44.639522 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:44.639051    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49" event={"ID":"d256d90b-1a49-4d99-8e12-8ab5e959fb47","Type":"ContainerStarted","Data":"049441b900211b2d3af8e8fc45151c7593be46e2fe1d2c48245a7f8fe3ba511e"}
Sep 08 15:37:44.639522 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:44.639096    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:37:44.662636 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:44.662568    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49" podStartSLOduration=1.662551259 podStartE2EDuration="1.662551259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:44.662482359 +0000 UTC m=+1725.234028401" watchObservedRunningTime="2026-09-08 15:37:44.662551259 +0000 UTC m=+1725.234097300"
Sep 08 15:37:49.182502 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.182468    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"]
Sep 08 15:37:49.185984 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.185964    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:37:49.189388 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.189362    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-9dea65\""
Sep 08 15:37:49.201367 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.201336    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"]
Sep 08 15:37:49.257346 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.257311    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"]
Sep 08 15:37:49.260261 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.260245    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:37:49.263538 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.263510    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-9dea65-dockercfg-vg9pb\""
Sep 08 15:37:49.276945 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.276914    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"]
Sep 08 15:37:49.315833 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.315791    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szzl8\" (UniqueName: \"kubernetes.io/projected/40c16fb4-f349-44ad-b9d2-5c333b923bf9-kube-api-access-szzl8\") pod \"payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5\" (UID: \"40c16fb4-f349-44ad-b9d2-5c333b923bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:37:49.316020 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.315879    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40c16fb4-f349-44ad-b9d2-5c333b923bf9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5\" (UID: \"40c16fb4-f349-44ad-b9d2-5c333b923bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:37:49.416611 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.416568    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szzl8\" (UniqueName: \"kubernetes.io/projected/40c16fb4-f349-44ad-b9d2-5c333b923bf9-kube-api-access-szzl8\") pod \"payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5\" (UID: \"40c16fb4-f349-44ad-b9d2-5c333b923bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:37:49.416825 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.416643    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrz7m\" (UniqueName: \"kubernetes.io/projected/49355c3a-2fbc-4192-846e-1aa4204b86b0-kube-api-access-xrz7m\") pod \"payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j\" (UID: \"49355c3a-2fbc-4192-846e-1aa4204b86b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:37:49.416825 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.416706    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40c16fb4-f349-44ad-b9d2-5c333b923bf9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5\" (UID: \"40c16fb4-f349-44ad-b9d2-5c333b923bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:37:49.416825 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.416789    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49355c3a-2fbc-4192-846e-1aa4204b86b0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j\" (UID: \"49355c3a-2fbc-4192-846e-1aa4204b86b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:37:49.417577 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.417552    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40c16fb4-f349-44ad-b9d2-5c333b923bf9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5\" (UID: \"40c16fb4-f349-44ad-b9d2-5c333b923bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:37:49.428585 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.428554    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szzl8\" (UniqueName: \"kubernetes.io/projected/40c16fb4-f349-44ad-b9d2-5c333b923bf9-kube-api-access-szzl8\") pod \"payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5\" (UID: \"40c16fb4-f349-44ad-b9d2-5c333b923bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:37:49.497485 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.497399    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:37:49.517896 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.517863    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49355c3a-2fbc-4192-846e-1aa4204b86b0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j\" (UID: \"49355c3a-2fbc-4192-846e-1aa4204b86b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:37:49.518035 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.517926    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrz7m\" (UniqueName: \"kubernetes.io/projected/49355c3a-2fbc-4192-846e-1aa4204b86b0-kube-api-access-xrz7m\") pod \"payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j\" (UID: \"49355c3a-2fbc-4192-846e-1aa4204b86b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:37:49.518992 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.518968    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49355c3a-2fbc-4192-846e-1aa4204b86b0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j\" (UID: \"49355c3a-2fbc-4192-846e-1aa4204b86b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:37:49.529192 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.529152    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrz7m\" (UniqueName: \"kubernetes.io/projected/49355c3a-2fbc-4192-846e-1aa4204b86b0-kube-api-access-xrz7m\") pod \"payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j\" (UID: \"49355c3a-2fbc-4192-846e-1aa4204b86b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:37:49.571140 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.571107    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:37:49.779351 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.779321    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"]
Sep 08 15:37:49.780200 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:37:49.780179    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c16fb4_f349_44ad_b9d2_5c333b923bf9.slice/crio-164b7f541ba2349f9fb1da41a7037699cf2bfc41790ae265e8513c4e69c53d23 WatchSource:0}: Error finding container 164b7f541ba2349f9fb1da41a7037699cf2bfc41790ae265e8513c4e69c53d23: Status 404 returned error can't find the container with id 164b7f541ba2349f9fb1da41a7037699cf2bfc41790ae265e8513c4e69c53d23
Sep 08 15:37:49.874098 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:37:49.874070    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49355c3a_2fbc_4192_846e_1aa4204b86b0.slice/crio-b8898b3e46e94defb7902922fa6bfcfa2641cc5972c6b85d80cfe8dc927c679b WatchSource:0}: Error finding container b8898b3e46e94defb7902922fa6bfcfa2641cc5972c6b85d80cfe8dc927c679b: Status 404 returned error can't find the container with id b8898b3e46e94defb7902922fa6bfcfa2641cc5972c6b85d80cfe8dc927c679b
Sep 08 15:37:49.874447 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:49.874415    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"]
Sep 08 15:37:50.685866 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:50.685825    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j" event={"ID":"49355c3a-2fbc-4192-846e-1aa4204b86b0","Type":"ContainerStarted","Data":"d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2"}
Sep 08 15:37:50.686318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:50.685898    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j" event={"ID":"49355c3a-2fbc-4192-846e-1aa4204b86b0","Type":"ContainerStarted","Data":"b8898b3e46e94defb7902922fa6bfcfa2641cc5972c6b85d80cfe8dc927c679b"}
Sep 08 15:37:50.686318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:50.685928    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:37:50.687684 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:50.687655    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5" event={"ID":"40c16fb4-f349-44ad-b9d2-5c333b923bf9","Type":"ContainerStarted","Data":"6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e"}
Sep 08 15:37:50.687784 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:50.687711    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5" event={"ID":"40c16fb4-f349-44ad-b9d2-5c333b923bf9","Type":"ContainerStarted","Data":"164b7f541ba2349f9fb1da41a7037699cf2bfc41790ae265e8513c4e69c53d23"}
Sep 08 15:37:50.687784 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:50.687766    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:37:50.736017 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:50.735800    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j" podStartSLOduration=1.735775681 podStartE2EDuration="1.735775681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:50.729275192 +0000 UTC m=+1731.300821234" watchObservedRunningTime="2026-09-08 15:37:50.735775681 +0000 UTC m=+1731.307321723"
Sep 08 15:37:50.776838 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:50.776779    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5" podStartSLOduration=1.776758305 podStartE2EDuration="1.776758305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:50.773920676 +0000 UTC m=+1731.345466718" watchObservedRunningTime="2026-09-08 15:37:50.776758305 +0000 UTC m=+1731.348304397"
Sep 08 15:37:55.649073 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:37:55.649035    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:38:01.696825 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:01.696794    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:38:01.697215 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:01.696874    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:38:08.965553 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:08.965496    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"]
Sep 08 15:38:08.969733 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:08.969708    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"
Sep 08 15:38:08.973050 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:08.973030    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qqvg\""
Sep 08 15:38:08.987365 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:08.987334    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"]
Sep 08 15:38:09.005266 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:09.005223    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a668ed40-27fb-4afb-a1e2-092fc3d1bbc3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr\" (UID: \"a668ed40-27fb-4afb-a1e2-092fc3d1bbc3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"
Sep 08 15:38:09.105937 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:09.105900    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a668ed40-27fb-4afb-a1e2-092fc3d1bbc3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr\" (UID: \"a668ed40-27fb-4afb-a1e2-092fc3d1bbc3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"
Sep 08 15:38:09.106546 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:09.106527    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a668ed40-27fb-4afb-a1e2-092fc3d1bbc3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr\" (UID: \"a668ed40-27fb-4afb-a1e2-092fc3d1bbc3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"
Sep 08 15:38:09.280189 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:09.280097    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"
Sep 08 15:38:09.576117 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:09.576087    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"]
Sep 08 15:38:09.577290 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:38:09.577259    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda668ed40_27fb_4afb_a1e2_092fc3d1bbc3.slice/crio-69e28269162617b1dc12046790814aaafa6113a6c0994a6f8d087c92144b1c67 WatchSource:0}: Error finding container 69e28269162617b1dc12046790814aaafa6113a6c0994a6f8d087c92144b1c67: Status 404 returned error can't find the container with id 69e28269162617b1dc12046790814aaafa6113a6c0994a6f8d087c92144b1c67
Sep 08 15:38:09.833976 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:09.833946    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr" event={"ID":"a668ed40-27fb-4afb-a1e2-092fc3d1bbc3","Type":"ContainerStarted","Data":"69e28269162617b1dc12046790814aaafa6113a6c0994a6f8d087c92144b1c67"}
Sep 08 15:38:10.842160 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:10.842126    2566 generic.go:356] "Generic (PLEG): container finished" podID="a668ed40-27fb-4afb-a1e2-092fc3d1bbc3" containerID="2210d4dc394bca3389a92f4cdc2e70bc97c6694cbed9e8cb993bd35fb9c6e1e4" exitCode=0
Sep 08 15:38:10.842544 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:10.842169    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr" event={"ID":"a668ed40-27fb-4afb-a1e2-092fc3d1bbc3","Type":"ContainerDied","Data":"2210d4dc394bca3389a92f4cdc2e70bc97c6694cbed9e8cb993bd35fb9c6e1e4"}
Sep 08 15:38:12.004679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:12.004650    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"
Sep 08 15:38:12.133157 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:12.133052    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a668ed40-27fb-4afb-a1e2-092fc3d1bbc3-maas-api-service-ca\") pod \"a668ed40-27fb-4afb-a1e2-092fc3d1bbc3\" (UID: \"a668ed40-27fb-4afb-a1e2-092fc3d1bbc3\") "
Sep 08 15:38:12.133457 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:12.133430    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a668ed40-27fb-4afb-a1e2-092fc3d1bbc3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a668ed40-27fb-4afb-a1e2-092fc3d1bbc3" (UID: "a668ed40-27fb-4afb-a1e2-092fc3d1bbc3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:38:12.234774 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:12.234726    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a668ed40-27fb-4afb-a1e2-092fc3d1bbc3-maas-api-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:38:12.856719 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:12.856692    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"
Sep 08 15:38:12.856719 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:12.856698    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr" event={"ID":"a668ed40-27fb-4afb-a1e2-092fc3d1bbc3","Type":"ContainerDied","Data":"69e28269162617b1dc12046790814aaafa6113a6c0994a6f8d087c92144b1c67"}
Sep 08 15:38:12.856936 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:12.856743    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69e28269162617b1dc12046790814aaafa6113a6c0994a6f8d087c92144b1c67"
Sep 08 15:38:22.117299 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:22.117263    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pn2lc_65264b73-4245-42ac-bc84-84b9c2b0dcef/payload-processing/0.log"
Sep 08 15:38:22.257869 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:22.257840    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j_49355c3a-2fbc-4192-846e-1aa4204b86b0/payload-processing/0.log"
Sep 08 15:38:24.848461 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:24.848427    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"]
Sep 08 15:38:24.848988 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:24.848690    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb" podUID="933fbb47-fd85-40f7-8293-ca3dee77a235" containerName="payload-processing" containerID="cri-o://d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f" gracePeriod=30
Sep 08 15:38:24.859116 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:24.859085    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"]
Sep 08 15:38:24.859391 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:24.859340    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx" podUID="a182419e-b8f0-406b-b27b-031f3349b405" containerName="payload-pre-processing" containerID="cri-o://ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22" gracePeriod=30
Sep 08 15:38:25.152818 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.152792    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:38:25.155904 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.155882    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:38:25.160653 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.160612    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"]
Sep 08 15:38:25.166541 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.166512    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-61a1d6-dw9kr"]
Sep 08 15:38:25.270026 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.269991    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssszb\" (UniqueName: \"kubernetes.io/projected/933fbb47-fd85-40f7-8293-ca3dee77a235-kube-api-access-ssszb\") pod \"933fbb47-fd85-40f7-8293-ca3dee77a235\" (UID: \"933fbb47-fd85-40f7-8293-ca3dee77a235\") "
Sep 08 15:38:25.270181 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.270088    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/933fbb47-fd85-40f7-8293-ca3dee77a235-plugins-config-volume\") pod \"933fbb47-fd85-40f7-8293-ca3dee77a235\" (UID: \"933fbb47-fd85-40f7-8293-ca3dee77a235\") "
Sep 08 15:38:25.270181 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.270128    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a182419e-b8f0-406b-b27b-031f3349b405-plugins-config-volume\") pod \"a182419e-b8f0-406b-b27b-031f3349b405\" (UID: \"a182419e-b8f0-406b-b27b-031f3349b405\") "
Sep 08 15:38:25.270181 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.270154    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxqfh\" (UniqueName: \"kubernetes.io/projected/a182419e-b8f0-406b-b27b-031f3349b405-kube-api-access-jxqfh\") pod \"a182419e-b8f0-406b-b27b-031f3349b405\" (UID: \"a182419e-b8f0-406b-b27b-031f3349b405\") "
Sep 08 15:38:25.270510 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.270483    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/933fbb47-fd85-40f7-8293-ca3dee77a235-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "933fbb47-fd85-40f7-8293-ca3dee77a235" (UID: "933fbb47-fd85-40f7-8293-ca3dee77a235"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:38:25.270510 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.270497    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a182419e-b8f0-406b-b27b-031f3349b405-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a182419e-b8f0-406b-b27b-031f3349b405" (UID: "a182419e-b8f0-406b-b27b-031f3349b405"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:38:25.272496 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.272465    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/933fbb47-fd85-40f7-8293-ca3dee77a235-kube-api-access-ssszb" (OuterVolumeSpecName: "kube-api-access-ssszb") pod "933fbb47-fd85-40f7-8293-ca3dee77a235" (UID: "933fbb47-fd85-40f7-8293-ca3dee77a235"). InnerVolumeSpecName "kube-api-access-ssszb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:38:25.272496 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.272476    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a182419e-b8f0-406b-b27b-031f3349b405-kube-api-access-jxqfh" (OuterVolumeSpecName: "kube-api-access-jxqfh") pod "a182419e-b8f0-406b-b27b-031f3349b405" (UID: "a182419e-b8f0-406b-b27b-031f3349b405"). InnerVolumeSpecName "kube-api-access-jxqfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:38:25.371549 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.371514    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a182419e-b8f0-406b-b27b-031f3349b405-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:38:25.371549 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.371543    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxqfh\" (UniqueName: \"kubernetes.io/projected/a182419e-b8f0-406b-b27b-031f3349b405-kube-api-access-jxqfh\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:38:25.371549 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.371553    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssszb\" (UniqueName: \"kubernetes.io/projected/933fbb47-fd85-40f7-8293-ca3dee77a235-kube-api-access-ssszb\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:38:25.371839 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.371562    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/933fbb47-fd85-40f7-8293-ca3dee77a235-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:38:25.915733 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.915702    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a668ed40-27fb-4afb-a1e2-092fc3d1bbc3" path="/var/lib/kubelet/pods/a668ed40-27fb-4afb-a1e2-092fc3d1bbc3/volumes"
Sep 08 15:38:25.945571 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.945535    2566 generic.go:356] "Generic (PLEG): container finished" podID="933fbb47-fd85-40f7-8293-ca3dee77a235" containerID="d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f" exitCode=0
Sep 08 15:38:25.945811 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.945582    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"
Sep 08 15:38:25.945811 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.945638    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb" event={"ID":"933fbb47-fd85-40f7-8293-ca3dee77a235","Type":"ContainerDied","Data":"d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f"}
Sep 08 15:38:25.945811 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.945687    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb" event={"ID":"933fbb47-fd85-40f7-8293-ca3dee77a235","Type":"ContainerDied","Data":"515785378d8c9f658d4cf76d850d121ea7bd6d9946d9c1b256977867d2e30b78"}
Sep 08 15:38:25.945811 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.945716    2566 scope.go:117] "RemoveContainer" containerID="d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f"
Sep 08 15:38:25.947203 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.947184    2566 generic.go:356] "Generic (PLEG): container finished" podID="a182419e-b8f0-406b-b27b-031f3349b405" containerID="ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22" exitCode=0
Sep 08 15:38:25.947316 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.947238    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"
Sep 08 15:38:25.947316 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.947260    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx" event={"ID":"a182419e-b8f0-406b-b27b-031f3349b405","Type":"ContainerDied","Data":"ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22"}
Sep 08 15:38:25.947316 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.947295    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx" event={"ID":"a182419e-b8f0-406b-b27b-031f3349b405","Type":"ContainerDied","Data":"a616c6a671c4da4600ecdfb195a1c89e34d2003ba5b3be415225376120aab8b9"}
Sep 08 15:38:25.956458 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.956434    2566 scope.go:117] "RemoveContainer" containerID="d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f"
Sep 08 15:38:25.956917 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:38:25.956896    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f\": container with ID starting with d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f not found: ID does not exist" containerID="d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f"
Sep 08 15:38:25.956988 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.956930    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f"} err="failed to get container status \"d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f\": rpc error: code = NotFound desc = could not find container \"d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f\": container with ID starting with d3cfc00dceb3af8c337709de9af177dae5e843d640b14f1b42f5b98045dbd74f not found: ID does not exist"
Sep 08 15:38:25.956988 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.956954    2566 scope.go:117] "RemoveContainer" containerID="ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22"
Sep 08 15:38:25.966883 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.966859    2566 scope.go:117] "RemoveContainer" containerID="ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22"
Sep 08 15:38:25.967202 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:38:25.967183    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22\": container with ID starting with ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22 not found: ID does not exist" containerID="ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22"
Sep 08 15:38:25.967249 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.967211    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22"} err="failed to get container status \"ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22\": rpc error: code = NotFound desc = could not find container \"ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22\": container with ID starting with ca2d55ca1885df6d85731a9c0ce8095ea6040355c39eaf4ac44e87a5e4d54c22 not found: ID does not exist"
Sep 08 15:38:25.969398 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.969379    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"]
Sep 08 15:38:25.974708 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.974685    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-61a1d6-7ff49c79d6-5rttx"]
Sep 08 15:38:25.989876 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.989848    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"]
Sep 08 15:38:25.992710 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:25.992687    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61a1d6-988b9f48f-rlwlb"]
Sep 08 15:38:27.915372 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:27.915335    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="933fbb47-fd85-40f7-8293-ca3dee77a235" path="/var/lib/kubelet/pods/933fbb47-fd85-40f7-8293-ca3dee77a235/volumes"
Sep 08 15:38:27.915798 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:27.915726    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a182419e-b8f0-406b-b27b-031f3349b405" path="/var/lib/kubelet/pods/a182419e-b8f0-406b-b27b-031f3349b405/volumes"
Sep 08 15:38:32.957359 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.957326    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"]
Sep 08 15:38:32.957844 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.957829    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933fbb47-fd85-40f7-8293-ca3dee77a235" containerName="payload-processing"
Sep 08 15:38:32.957889 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.957846    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="933fbb47-fd85-40f7-8293-ca3dee77a235" containerName="payload-processing"
Sep 08 15:38:32.957889 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.957873    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a668ed40-27fb-4afb-a1e2-092fc3d1bbc3" containerName="revoke-keys"
Sep 08 15:38:32.957889 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.957879    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a668ed40-27fb-4afb-a1e2-092fc3d1bbc3" containerName="revoke-keys"
Sep 08 15:38:32.957889 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.957888    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a182419e-b8f0-406b-b27b-031f3349b405" containerName="payload-pre-processing"
Sep 08 15:38:32.958064 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.957893    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a182419e-b8f0-406b-b27b-031f3349b405" containerName="payload-pre-processing"
Sep 08 15:38:32.958064 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.957960    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a668ed40-27fb-4afb-a1e2-092fc3d1bbc3" containerName="revoke-keys"
Sep 08 15:38:32.958064 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.957969    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="933fbb47-fd85-40f7-8293-ca3dee77a235" containerName="payload-processing"
Sep 08 15:38:32.958064 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.957978    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a182419e-b8f0-406b-b27b-031f3349b405" containerName="payload-pre-processing"
Sep 08 15:38:32.961434 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.961418    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"
Sep 08 15:38:32.965364 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.965342    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qqvg\""
Sep 08 15:38:32.975068 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:32.975040    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"]
Sep 08 15:38:33.148794 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:33.148762    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/701ccf8f-c3be-47ed-aa62-e905fbb63262-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn\" (UID: \"701ccf8f-c3be-47ed-aa62-e905fbb63262\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"
Sep 08 15:38:33.250154 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:33.250054    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/701ccf8f-c3be-47ed-aa62-e905fbb63262-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn\" (UID: \"701ccf8f-c3be-47ed-aa62-e905fbb63262\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"
Sep 08 15:38:33.250709 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:33.250679    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/701ccf8f-c3be-47ed-aa62-e905fbb63262-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn\" (UID: \"701ccf8f-c3be-47ed-aa62-e905fbb63262\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"
Sep 08 15:38:33.272125 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:33.272089    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"
Sep 08 15:38:33.571899 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:33.571872    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"]
Sep 08 15:38:33.573527 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:38:33.573489    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701ccf8f_c3be_47ed_aa62_e905fbb63262.slice/crio-d446c4eae2537035e8f80abcac4b807ede2bc7543080a5a7693413cc3cdfe970 WatchSource:0}: Error finding container d446c4eae2537035e8f80abcac4b807ede2bc7543080a5a7693413cc3cdfe970: Status 404 returned error can't find the container with id d446c4eae2537035e8f80abcac4b807ede2bc7543080a5a7693413cc3cdfe970
Sep 08 15:38:34.006504 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:34.006472    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn" event={"ID":"701ccf8f-c3be-47ed-aa62-e905fbb63262","Type":"ContainerStarted","Data":"8b0d3d3af1e4c9236ce9685e34c91f37a770f9ce5f808b706d239693beb5f8af"}
Sep 08 15:38:34.006897 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:34.006523    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn" event={"ID":"701ccf8f-c3be-47ed-aa62-e905fbb63262","Type":"ContainerStarted","Data":"d446c4eae2537035e8f80abcac4b807ede2bc7543080a5a7693413cc3cdfe970"}
Sep 08 15:38:34.034935 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:34.034884    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn" podStartSLOduration=2.034866883 podStartE2EDuration="2.034866883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:38:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:38:34.031838335 +0000 UTC m=+1774.603384380" watchObservedRunningTime="2026-09-08 15:38:34.034866883 +0000 UTC m=+1774.606412926"
Sep 08 15:38:35.015081 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:35.015045    2566 generic.go:356] "Generic (PLEG): container finished" podID="701ccf8f-c3be-47ed-aa62-e905fbb63262" containerID="8b0d3d3af1e4c9236ce9685e34c91f37a770f9ce5f808b706d239693beb5f8af" exitCode=0
Sep 08 15:38:35.015477 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:35.015133    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn" event={"ID":"701ccf8f-c3be-47ed-aa62-e905fbb63262","Type":"ContainerDied","Data":"8b0d3d3af1e4c9236ce9685e34c91f37a770f9ce5f808b706d239693beb5f8af"}
Sep 08 15:38:36.171332 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:36.171309    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"
Sep 08 15:38:36.279491 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:36.279397    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/701ccf8f-c3be-47ed-aa62-e905fbb63262-maas-api-service-ca\") pod \"701ccf8f-c3be-47ed-aa62-e905fbb63262\" (UID: \"701ccf8f-c3be-47ed-aa62-e905fbb63262\") "
Sep 08 15:38:36.279862 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:36.279835    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/701ccf8f-c3be-47ed-aa62-e905fbb63262-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "701ccf8f-c3be-47ed-aa62-e905fbb63262" (UID: "701ccf8f-c3be-47ed-aa62-e905fbb63262"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:38:36.381005 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:36.380963    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/701ccf8f-c3be-47ed-aa62-e905fbb63262-maas-api-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:38:37.030793 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:37.030763    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"
Sep 08 15:38:37.030793 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:37.030773    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn" event={"ID":"701ccf8f-c3be-47ed-aa62-e905fbb63262","Type":"ContainerDied","Data":"d446c4eae2537035e8f80abcac4b807ede2bc7543080a5a7693413cc3cdfe970"}
Sep 08 15:38:37.031020 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:37.030831    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d446c4eae2537035e8f80abcac4b807ede2bc7543080a5a7693413cc3cdfe970"
Sep 08 15:38:48.714609 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:48.714573    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"]
Sep 08 15:38:48.715176 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:48.714799    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49" podUID="d256d90b-1a49-4d99-8e12-8ab5e959fb47" containerName="payload-processing" containerID="cri-o://f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489" gracePeriod=30
Sep 08 15:38:48.882894 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:48.882858    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"]
Sep 08 15:38:48.885795 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:48.885767    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ee0da5-brqwn"]
Sep 08 15:38:48.983539 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:48.983496    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:38:49.099501 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.099470    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbwdm\" (UniqueName: \"kubernetes.io/projected/d256d90b-1a49-4d99-8e12-8ab5e959fb47-kube-api-access-sbwdm\") pod \"d256d90b-1a49-4d99-8e12-8ab5e959fb47\" (UID: \"d256d90b-1a49-4d99-8e12-8ab5e959fb47\") "
Sep 08 15:38:49.099696 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.099562    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d256d90b-1a49-4d99-8e12-8ab5e959fb47-plugins-config-volume\") pod \"d256d90b-1a49-4d99-8e12-8ab5e959fb47\" (UID: \"d256d90b-1a49-4d99-8e12-8ab5e959fb47\") "
Sep 08 15:38:49.099929 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.099907    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d256d90b-1a49-4d99-8e12-8ab5e959fb47-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d256d90b-1a49-4d99-8e12-8ab5e959fb47" (UID: "d256d90b-1a49-4d99-8e12-8ab5e959fb47"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:38:49.101676 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.101645    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d256d90b-1a49-4d99-8e12-8ab5e959fb47-kube-api-access-sbwdm" (OuterVolumeSpecName: "kube-api-access-sbwdm") pod "d256d90b-1a49-4d99-8e12-8ab5e959fb47" (UID: "d256d90b-1a49-4d99-8e12-8ab5e959fb47"). InnerVolumeSpecName "kube-api-access-sbwdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:38:49.114395 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.114368    2566 generic.go:356] "Generic (PLEG): container finished" podID="d256d90b-1a49-4d99-8e12-8ab5e959fb47" containerID="f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489" exitCode=0
Sep 08 15:38:49.114500 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.114418    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"
Sep 08 15:38:49.114500 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.114417    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49" event={"ID":"d256d90b-1a49-4d99-8e12-8ab5e959fb47","Type":"ContainerDied","Data":"f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489"}
Sep 08 15:38:49.114500 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.114475    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49" event={"ID":"d256d90b-1a49-4d99-8e12-8ab5e959fb47","Type":"ContainerDied","Data":"049441b900211b2d3af8e8fc45151c7593be46e2fe1d2c48245a7f8fe3ba511e"}
Sep 08 15:38:49.114500 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.114499    2566 scope.go:117] "RemoveContainer" containerID="f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489"
Sep 08 15:38:49.124455 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.124435    2566 scope.go:117] "RemoveContainer" containerID="f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489"
Sep 08 15:38:49.124783 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:38:49.124766    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489\": container with ID starting with f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489 not found: ID does not exist" containerID="f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489"
Sep 08 15:38:49.124839 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.124792    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489"} err="failed to get container status \"f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489\": rpc error: code = NotFound desc = could not find container \"f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489\": container with ID starting with f8a23eba06d904bb4dc533f797feb304377f85651abd719113b2c36199a11489 not found: ID does not exist"
Sep 08 15:38:49.140938 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.140906    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"]
Sep 08 15:38:49.145158 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.145134    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ee0da5-5cbbd8b557-trn49"]
Sep 08 15:38:49.200370 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.200333    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbwdm\" (UniqueName: \"kubernetes.io/projected/d256d90b-1a49-4d99-8e12-8ab5e959fb47-kube-api-access-sbwdm\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:38:49.200370 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.200363    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d256d90b-1a49-4d99-8e12-8ab5e959fb47-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:38:49.915967 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.915932    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="701ccf8f-c3be-47ed-aa62-e905fbb63262" path="/var/lib/kubelet/pods/701ccf8f-c3be-47ed-aa62-e905fbb63262/volumes"
Sep 08 15:38:49.916349 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:49.916289    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d256d90b-1a49-4d99-8e12-8ab5e959fb47" path="/var/lib/kubelet/pods/d256d90b-1a49-4d99-8e12-8ab5e959fb47/volumes"
Sep 08 15:38:56.863418 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:56.863332    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"]
Sep 08 15:38:56.864152 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:56.864130    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="701ccf8f-c3be-47ed-aa62-e905fbb63262" containerName="revoke-keys"
Sep 08 15:38:56.864197 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:56.864157    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="701ccf8f-c3be-47ed-aa62-e905fbb63262" containerName="revoke-keys"
Sep 08 15:38:56.864197 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:56.864183    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d256d90b-1a49-4d99-8e12-8ab5e959fb47" containerName="payload-processing"
Sep 08 15:38:56.864197 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:56.864193    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d256d90b-1a49-4d99-8e12-8ab5e959fb47" containerName="payload-processing"
Sep 08 15:38:56.864332 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:56.864321    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="701ccf8f-c3be-47ed-aa62-e905fbb63262" containerName="revoke-keys"
Sep 08 15:38:56.864368 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:56.864339    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d256d90b-1a49-4d99-8e12-8ab5e959fb47" containerName="payload-processing"
Sep 08 15:38:56.869818 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:56.869796    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"
Sep 08 15:38:56.874467 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:56.874444    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qqvg\""
Sep 08 15:38:56.878080 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:56.878054    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"]
Sep 08 15:38:56.979997 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:56.979951    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1fb569-fbcf-4270-b171-e0a3e59c2cc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9\" (UID: \"6c1fb569-fbcf-4270-b171-e0a3e59c2cc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"
Sep 08 15:38:57.080529 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:57.080490    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1fb569-fbcf-4270-b171-e0a3e59c2cc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9\" (UID: \"6c1fb569-fbcf-4270-b171-e0a3e59c2cc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"
Sep 08 15:38:57.081170 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:57.081144    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1fb569-fbcf-4270-b171-e0a3e59c2cc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9\" (UID: \"6c1fb569-fbcf-4270-b171-e0a3e59c2cc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"
Sep 08 15:38:57.184646 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:57.184541    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"
Sep 08 15:38:57.479935 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:57.479909    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"]
Sep 08 15:38:57.481788 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:38:57.481758    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1fb569_fbcf_4270_b171_e0a3e59c2cc5.slice/crio-92a2164aed2fd0e741edad0a08b86d90096819506b4f6b65424b67a6ff67c02f WatchSource:0}: Error finding container 92a2164aed2fd0e741edad0a08b86d90096819506b4f6b65424b67a6ff67c02f: Status 404 returned error can't find the container with id 92a2164aed2fd0e741edad0a08b86d90096819506b4f6b65424b67a6ff67c02f
Sep 08 15:38:58.177167 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:58.177120    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9" event={"ID":"6c1fb569-fbcf-4270-b171-e0a3e59c2cc5","Type":"ContainerStarted","Data":"971c051af5c9acbc2e9a40ce0b85eb94e36d856c9cbc44e9ffe9ee340d72e17c"}
Sep 08 15:38:58.177741 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:58.177193    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9" event={"ID":"6c1fb569-fbcf-4270-b171-e0a3e59c2cc5","Type":"ContainerStarted","Data":"92a2164aed2fd0e741edad0a08b86d90096819506b4f6b65424b67a6ff67c02f"}
Sep 08 15:38:58.198135 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:58.198076    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9" podStartSLOduration=2.198057678 podStartE2EDuration="2.198057678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:38:58.195080318 +0000 UTC m=+1798.766626360" watchObservedRunningTime="2026-09-08 15:38:58.198057678 +0000 UTC m=+1798.769603719"
Sep 08 15:38:59.187186 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:59.187152    2566 generic.go:356] "Generic (PLEG): container finished" podID="6c1fb569-fbcf-4270-b171-e0a3e59c2cc5" containerID="971c051af5c9acbc2e9a40ce0b85eb94e36d856c9cbc44e9ffe9ee340d72e17c" exitCode=0
Sep 08 15:38:59.187611 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:38:59.187206    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9" event={"ID":"6c1fb569-fbcf-4270-b171-e0a3e59c2cc5","Type":"ContainerDied","Data":"971c051af5c9acbc2e9a40ce0b85eb94e36d856c9cbc44e9ffe9ee340d72e17c"}
Sep 08 15:39:00.344330 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:00.344300    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"
Sep 08 15:39:00.413874 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:00.413823    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1fb569-fbcf-4270-b171-e0a3e59c2cc5-maas-api-service-ca\") pod \"6c1fb569-fbcf-4270-b171-e0a3e59c2cc5\" (UID: \"6c1fb569-fbcf-4270-b171-e0a3e59c2cc5\") "
Sep 08 15:39:00.414230 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:00.414201    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c1fb569-fbcf-4270-b171-e0a3e59c2cc5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6c1fb569-fbcf-4270-b171-e0a3e59c2cc5" (UID: "6c1fb569-fbcf-4270-b171-e0a3e59c2cc5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:39:00.515815 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:00.515722    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1fb569-fbcf-4270-b171-e0a3e59c2cc5-maas-api-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:39:01.203361 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:01.203332    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"
Sep 08 15:39:01.203558 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:01.203368    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9" event={"ID":"6c1fb569-fbcf-4270-b171-e0a3e59c2cc5","Type":"ContainerDied","Data":"92a2164aed2fd0e741edad0a08b86d90096819506b4f6b65424b67a6ff67c02f"}
Sep 08 15:39:01.203558 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:01.203418    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92a2164aed2fd0e741edad0a08b86d90096819506b4f6b65424b67a6ff67c02f"
Sep 08 15:39:07.534359 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.534321    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"]
Sep 08 15:39:07.534920 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.534588    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25" podUID="a84cdd58-23c1-4b67-892a-2a35b371b3e3" containerName="payload-processing" containerID="cri-o://d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347" gracePeriod=30
Sep 08 15:39:07.795155 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.795060    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"]
Sep 08 15:39:07.797863 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.797833    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-149fdb-28qd9"]
Sep 08 15:39:07.803719 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.803699    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:39:07.893853 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.893818    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52svt\" (UniqueName: \"kubernetes.io/projected/a84cdd58-23c1-4b67-892a-2a35b371b3e3-kube-api-access-52svt\") pod \"a84cdd58-23c1-4b67-892a-2a35b371b3e3\" (UID: \"a84cdd58-23c1-4b67-892a-2a35b371b3e3\") "
Sep 08 15:39:07.894059 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.893892    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a84cdd58-23c1-4b67-892a-2a35b371b3e3-plugins-config-volume\") pod \"a84cdd58-23c1-4b67-892a-2a35b371b3e3\" (UID: \"a84cdd58-23c1-4b67-892a-2a35b371b3e3\") "
Sep 08 15:39:07.894264 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.894239    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a84cdd58-23c1-4b67-892a-2a35b371b3e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a84cdd58-23c1-4b67-892a-2a35b371b3e3" (UID: "a84cdd58-23c1-4b67-892a-2a35b371b3e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:39:07.896236 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.896210    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a84cdd58-23c1-4b67-892a-2a35b371b3e3-kube-api-access-52svt" (OuterVolumeSpecName: "kube-api-access-52svt") pod "a84cdd58-23c1-4b67-892a-2a35b371b3e3" (UID: "a84cdd58-23c1-4b67-892a-2a35b371b3e3"). InnerVolumeSpecName "kube-api-access-52svt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:39:07.917226 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.917198    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c1fb569-fbcf-4270-b171-e0a3e59c2cc5" path="/var/lib/kubelet/pods/6c1fb569-fbcf-4270-b171-e0a3e59c2cc5/volumes"
Sep 08 15:39:07.995532 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.995500    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a84cdd58-23c1-4b67-892a-2a35b371b3e3-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:39:07.995532 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:07.995529    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52svt\" (UniqueName: \"kubernetes.io/projected/a84cdd58-23c1-4b67-892a-2a35b371b3e3-kube-api-access-52svt\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:39:08.256072 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:08.256030    2566 generic.go:356] "Generic (PLEG): container finished" podID="a84cdd58-23c1-4b67-892a-2a35b371b3e3" containerID="d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347" exitCode=0
Sep 08 15:39:08.256248 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:08.256077    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"
Sep 08 15:39:08.256248 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:08.256116    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25" event={"ID":"a84cdd58-23c1-4b67-892a-2a35b371b3e3","Type":"ContainerDied","Data":"d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347"}
Sep 08 15:39:08.256248 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:08.256176    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25" event={"ID":"a84cdd58-23c1-4b67-892a-2a35b371b3e3","Type":"ContainerDied","Data":"fa2366e0997b81ce2d4e046e865f32f41c8dc6adb11243c48e20468c129eed9c"}
Sep 08 15:39:08.256248 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:08.256234    2566 scope.go:117] "RemoveContainer" containerID="d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347"
Sep 08 15:39:08.266550 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:08.266526    2566 scope.go:117] "RemoveContainer" containerID="d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347"
Sep 08 15:39:08.266965 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:39:08.266934    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347\": container with ID starting with d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347 not found: ID does not exist" containerID="d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347"
Sep 08 15:39:08.267062 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:08.266973    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347"} err="failed to get container status \"d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347\": rpc error: code = NotFound desc = could not find container \"d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347\": container with ID starting with d0be741790a66eddd9bc3605b15b7f77c17ef9fdf15afd0f9fe998b9f7958347 not found: ID does not exist"
Sep 08 15:39:08.281195 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:08.281151    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"]
Sep 08 15:39:08.283896 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:08.283873    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-149fdb-7fbb5c8f-5bh25"]
Sep 08 15:39:09.922232 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:09.922200    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a84cdd58-23c1-4b67-892a-2a35b371b3e3" path="/var/lib/kubelet/pods/a84cdd58-23c1-4b67-892a-2a35b371b3e3/volumes"
Sep 08 15:39:24.835168 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.835135    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"]
Sep 08 15:39:24.835653 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.835635    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84cdd58-23c1-4b67-892a-2a35b371b3e3" containerName="payload-processing"
Sep 08 15:39:24.835653 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.835648    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84cdd58-23c1-4b67-892a-2a35b371b3e3" containerName="payload-processing"
Sep 08 15:39:24.835732 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.835663    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1fb569-fbcf-4270-b171-e0a3e59c2cc5" containerName="revoke-keys"
Sep 08 15:39:24.835732 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.835669    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1fb569-fbcf-4270-b171-e0a3e59c2cc5" containerName="revoke-keys"
Sep 08 15:39:24.835796 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.835753    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1fb569-fbcf-4270-b171-e0a3e59c2cc5" containerName="revoke-keys"
Sep 08 15:39:24.835796 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.835761    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a84cdd58-23c1-4b67-892a-2a35b371b3e3" containerName="payload-processing"
Sep 08 15:39:24.840586 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.840566    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"
Sep 08 15:39:24.844643 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.844608    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qqvg\""
Sep 08 15:39:24.849875 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.849850    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"]
Sep 08 15:39:24.861121 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.861090    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4\" (UID: \"00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"
Sep 08 15:39:24.961922 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.961881    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4\" (UID: \"00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"
Sep 08 15:39:24.962599 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:24.962572    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4\" (UID: \"00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"
Sep 08 15:39:25.153876 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:25.153775    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"
Sep 08 15:39:25.429678 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:25.429648    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"]
Sep 08 15:39:25.431232 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:39:25.431208    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e28c2b_dc59_4aea_b174_a6e2d5e1d3e3.slice/crio-bb7309669224ab85baf8a2c2adfe6c2705da4f44109c4f1f39751da1463432ea WatchSource:0}: Error finding container bb7309669224ab85baf8a2c2adfe6c2705da4f44109c4f1f39751da1463432ea: Status 404 returned error can't find the container with id bb7309669224ab85baf8a2c2adfe6c2705da4f44109c4f1f39751da1463432ea
Sep 08 15:39:26.376762 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:26.376719    2566 generic.go:356] "Generic (PLEG): container finished" podID="00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3" containerID="4918db179320d8c1e6d7f4abe7b4019c3cbb7014bd843a3161d0509d16ae4890" exitCode=0
Sep 08 15:39:26.377219 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:26.376809    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4" event={"ID":"00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3","Type":"ContainerDied","Data":"4918db179320d8c1e6d7f4abe7b4019c3cbb7014bd843a3161d0509d16ae4890"}
Sep 08 15:39:26.377219 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:26.376865    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4" event={"ID":"00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3","Type":"ContainerStarted","Data":"bb7309669224ab85baf8a2c2adfe6c2705da4f44109c4f1f39751da1463432ea"}
Sep 08 15:39:27.536333 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:27.536307    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"
Sep 08 15:39:27.587752 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:27.587711    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3-maas-api-service-ca\") pod \"00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3\" (UID: \"00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3\") "
Sep 08 15:39:27.588114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:27.588090    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3" (UID: "00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:39:27.588211 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:27.588184    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3-maas-api-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:39:28.332998 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:28.332964    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pn2lc_65264b73-4245-42ac-bc84-84b9c2b0dcef/payload-processing/0.log"
Sep 08 15:39:28.391428 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:28.391396    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"
Sep 08 15:39:28.391657 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:28.391431    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4" event={"ID":"00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3","Type":"ContainerDied","Data":"bb7309669224ab85baf8a2c2adfe6c2705da4f44109c4f1f39751da1463432ea"}
Sep 08 15:39:28.391657 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:28.391501    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb7309669224ab85baf8a2c2adfe6c2705da4f44109c4f1f39751da1463432ea"
Sep 08 15:39:28.456279 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:28.456249    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j_49355c3a-2fbc-4192-846e-1aa4204b86b0/payload-processing/0.log"
Sep 08 15:39:34.359682 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.359641    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"]
Sep 08 15:39:34.360156 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.360142    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3" containerName="revoke-keys"
Sep 08 15:39:34.360201 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.360158    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3" containerName="revoke-keys"
Sep 08 15:39:34.360248 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.360239    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3" containerName="revoke-keys"
Sep 08 15:39:34.363383 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.363365    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:39:34.367065 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.367042    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-d97358\""
Sep 08 15:39:34.375057 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.375030    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"]
Sep 08 15:39:34.422918 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.422884    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"]
Sep 08 15:39:34.426506 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.426484    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:39:34.429666 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.429644    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-d97358-dockercfg-sfk76\""
Sep 08 15:39:34.436717 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.436692    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"]
Sep 08 15:39:34.456059 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.456017    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fab09e4-d8de-4ac1-8776-59ea2ebab639-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr\" (UID: \"5fab09e4-d8de-4ac1-8776-59ea2ebab639\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:39:34.456243 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.456084    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqnzm\" (UniqueName: \"kubernetes.io/projected/5fab09e4-d8de-4ac1-8776-59ea2ebab639-kube-api-access-sqnzm\") pod \"payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr\" (UID: \"5fab09e4-d8de-4ac1-8776-59ea2ebab639\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:39:34.557146 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.557114    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqnzm\" (UniqueName: \"kubernetes.io/projected/5fab09e4-d8de-4ac1-8776-59ea2ebab639-kube-api-access-sqnzm\") pod \"payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr\" (UID: \"5fab09e4-d8de-4ac1-8776-59ea2ebab639\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:39:34.557371 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.557164    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b259r\" (UniqueName: \"kubernetes.io/projected/fea021f2-c6c8-4bff-909d-4a1c97f114fa-kube-api-access-b259r\") pod \"payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg\" (UID: \"fea021f2-c6c8-4bff-909d-4a1c97f114fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:39:34.557371 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.557219    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fab09e4-d8de-4ac1-8776-59ea2ebab639-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr\" (UID: \"5fab09e4-d8de-4ac1-8776-59ea2ebab639\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:39:34.557371 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.557240    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fea021f2-c6c8-4bff-909d-4a1c97f114fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg\" (UID: \"fea021f2-c6c8-4bff-909d-4a1c97f114fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:39:34.557941 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.557919    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fab09e4-d8de-4ac1-8776-59ea2ebab639-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr\" (UID: \"5fab09e4-d8de-4ac1-8776-59ea2ebab639\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:39:34.566212 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.566187    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqnzm\" (UniqueName: \"kubernetes.io/projected/5fab09e4-d8de-4ac1-8776-59ea2ebab639-kube-api-access-sqnzm\") pod \"payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr\" (UID: \"5fab09e4-d8de-4ac1-8776-59ea2ebab639\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:39:34.657952 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.657860    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fea021f2-c6c8-4bff-909d-4a1c97f114fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg\" (UID: \"fea021f2-c6c8-4bff-909d-4a1c97f114fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:39:34.657952 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.657930    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b259r\" (UniqueName: \"kubernetes.io/projected/fea021f2-c6c8-4bff-909d-4a1c97f114fa-kube-api-access-b259r\") pod \"payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg\" (UID: \"fea021f2-c6c8-4bff-909d-4a1c97f114fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:39:34.658582 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.658560    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fea021f2-c6c8-4bff-909d-4a1c97f114fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg\" (UID: \"fea021f2-c6c8-4bff-909d-4a1c97f114fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:39:34.668484 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.668452    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b259r\" (UniqueName: \"kubernetes.io/projected/fea021f2-c6c8-4bff-909d-4a1c97f114fa-kube-api-access-b259r\") pod \"payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg\" (UID: \"fea021f2-c6c8-4bff-909d-4a1c97f114fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:39:34.675255 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.675225    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:39:34.739087 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.738867    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:39:34.964840 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:34.964816    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"]
Sep 08 15:39:34.965797 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:39:34.965772    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fab09e4_d8de_4ac1_8776_59ea2ebab639.slice/crio-01f8f44c9d438fd1d6d503d823f47ee0ccb632c1ea3a755800cdb3c57a1ba0a5 WatchSource:0}: Error finding container 01f8f44c9d438fd1d6d503d823f47ee0ccb632c1ea3a755800cdb3c57a1ba0a5: Status 404 returned error can't find the container with id 01f8f44c9d438fd1d6d503d823f47ee0ccb632c1ea3a755800cdb3c57a1ba0a5
Sep 08 15:39:35.033059 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.033027    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"]
Sep 08 15:39:35.033743 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:39:35.033715    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea021f2_c6c8_4bff_909d_4a1c97f114fa.slice/crio-e134d514ab790f5cf55722da7c693861634343296b52dcf573beb5b11e462749 WatchSource:0}: Error finding container e134d514ab790f5cf55722da7c693861634343296b52dcf573beb5b11e462749: Status 404 returned error can't find the container with id e134d514ab790f5cf55722da7c693861634343296b52dcf573beb5b11e462749
Sep 08 15:39:35.212609 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.212573    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"]
Sep 08 15:39:35.212845 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.212802    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz" podUID="c6b2eb8c-5d42-4f13-9168-645f22350bf2" containerName="payload-pre-processing" containerID="cri-o://ef02bf96a36e156d2544d73772ffe4952742f73af60789dde42b1884586968fe" gracePeriod=30
Sep 08 15:39:35.439135 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.439093    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"]
Sep 08 15:39:35.442534 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.442504    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-04285b-qgkw4"]
Sep 08 15:39:35.444114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.444084    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr" event={"ID":"5fab09e4-d8de-4ac1-8776-59ea2ebab639","Type":"ContainerStarted","Data":"1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9"}
Sep 08 15:39:35.444275 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.444144    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr" event={"ID":"5fab09e4-d8de-4ac1-8776-59ea2ebab639","Type":"ContainerStarted","Data":"01f8f44c9d438fd1d6d503d823f47ee0ccb632c1ea3a755800cdb3c57a1ba0a5"}
Sep 08 15:39:35.444275 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.444259    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:39:35.446274 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.446251    2566 generic.go:356] "Generic (PLEG): container finished" podID="c6b2eb8c-5d42-4f13-9168-645f22350bf2" containerID="ef02bf96a36e156d2544d73772ffe4952742f73af60789dde42b1884586968fe" exitCode=0
Sep 08 15:39:35.446390 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.446345    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz" event={"ID":"c6b2eb8c-5d42-4f13-9168-645f22350bf2","Type":"ContainerDied","Data":"ef02bf96a36e156d2544d73772ffe4952742f73af60789dde42b1884586968fe"}
Sep 08 15:39:35.448281 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.448256    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg" event={"ID":"fea021f2-c6c8-4bff-909d-4a1c97f114fa","Type":"ContainerStarted","Data":"91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf"}
Sep 08 15:39:35.448382 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.448302    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg" event={"ID":"fea021f2-c6c8-4bff-909d-4a1c97f114fa","Type":"ContainerStarted","Data":"e134d514ab790f5cf55722da7c693861634343296b52dcf573beb5b11e462749"}
Sep 08 15:39:35.448596 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.448574    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:39:35.465032 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.464924    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr" podStartSLOduration=1.464908254 podStartE2EDuration="1.464908254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:39:35.462454751 +0000 UTC m=+1836.034000793" watchObservedRunningTime="2026-09-08 15:39:35.464908254 +0000 UTC m=+1836.036454296"
Sep 08 15:39:35.481861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.481732    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg" podStartSLOduration=1.481708493 podStartE2EDuration="1.481708493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:39:35.480654798 +0000 UTC m=+1836.052200843" watchObservedRunningTime="2026-09-08 15:39:35.481708493 +0000 UTC m=+1836.053254538"
Sep 08 15:39:35.492832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.492806    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:39:35.567226 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.567189    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5kww\" (UniqueName: \"kubernetes.io/projected/c6b2eb8c-5d42-4f13-9168-645f22350bf2-kube-api-access-j5kww\") pod \"c6b2eb8c-5d42-4f13-9168-645f22350bf2\" (UID: \"c6b2eb8c-5d42-4f13-9168-645f22350bf2\") "
Sep 08 15:39:35.567397 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.567346    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b2eb8c-5d42-4f13-9168-645f22350bf2-plugins-config-volume\") pod \"c6b2eb8c-5d42-4f13-9168-645f22350bf2\" (UID: \"c6b2eb8c-5d42-4f13-9168-645f22350bf2\") "
Sep 08 15:39:35.567807 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.567779    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6b2eb8c-5d42-4f13-9168-645f22350bf2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c6b2eb8c-5d42-4f13-9168-645f22350bf2" (UID: "c6b2eb8c-5d42-4f13-9168-645f22350bf2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:39:35.569537 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.569514    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b2eb8c-5d42-4f13-9168-645f22350bf2-kube-api-access-j5kww" (OuterVolumeSpecName: "kube-api-access-j5kww") pod "c6b2eb8c-5d42-4f13-9168-645f22350bf2" (UID: "c6b2eb8c-5d42-4f13-9168-645f22350bf2"). InnerVolumeSpecName "kube-api-access-j5kww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:39:35.668769 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.668732    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b2eb8c-5d42-4f13-9168-645f22350bf2-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:39:35.668769 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.668763    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5kww\" (UniqueName: \"kubernetes.io/projected/c6b2eb8c-5d42-4f13-9168-645f22350bf2-kube-api-access-j5kww\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:39:35.916095 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:35.916050    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3" path="/var/lib/kubelet/pods/00e28c2b-dc59-4aea-b174-a6e2d5e1d3e3/volumes"
Sep 08 15:39:36.456550 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:36.456512    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz" event={"ID":"c6b2eb8c-5d42-4f13-9168-645f22350bf2","Type":"ContainerDied","Data":"601da6adb5c61c502f4dae7f491e352fbb81892697c058c51e6e42b7d5de6793"}
Sep 08 15:39:36.456550 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:36.456541    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"
Sep 08 15:39:36.457135 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:36.456583    2566 scope.go:117] "RemoveContainer" containerID="ef02bf96a36e156d2544d73772ffe4952742f73af60789dde42b1884586968fe"
Sep 08 15:39:36.476509 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:36.476479    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"]
Sep 08 15:39:36.483819 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:36.483783    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-04285b-5f4f5755c4-nqczz"]
Sep 08 15:39:37.915552 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:37.915510    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6b2eb8c-5d42-4f13-9168-645f22350bf2" path="/var/lib/kubelet/pods/c6b2eb8c-5d42-4f13-9168-645f22350bf2/volumes"
Sep 08 15:39:46.458456 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:46.458425    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:39:46.458908 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:46.458748    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:39:57.991110 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:57.991072    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"]
Sep 08 15:39:57.991763 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:57.991613    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6b2eb8c-5d42-4f13-9168-645f22350bf2" containerName="payload-pre-processing"
Sep 08 15:39:57.991763 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:57.991645    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b2eb8c-5d42-4f13-9168-645f22350bf2" containerName="payload-pre-processing"
Sep 08 15:39:57.991763 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:57.991733    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6b2eb8c-5d42-4f13-9168-645f22350bf2" containerName="payload-pre-processing"
Sep 08 15:39:57.996328 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:57.996309    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"
Sep 08 15:39:57.999868 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:57.999837    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qqvg\""
Sep 08 15:39:58.005549 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:58.005519    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"]
Sep 08 15:39:58.094103 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:58.094062    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9cdbd4-4284-4eba-b1b0-bb5838ab5647-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc\" (UID: \"eb9cdbd4-4284-4eba-b1b0-bb5838ab5647\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"
Sep 08 15:39:58.195454 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:58.195409    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9cdbd4-4284-4eba-b1b0-bb5838ab5647-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc\" (UID: \"eb9cdbd4-4284-4eba-b1b0-bb5838ab5647\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"
Sep 08 15:39:58.196148 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:58.196116    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9cdbd4-4284-4eba-b1b0-bb5838ab5647-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc\" (UID: \"eb9cdbd4-4284-4eba-b1b0-bb5838ab5647\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"
Sep 08 15:39:58.309546 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:58.309428    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"
Sep 08 15:39:58.590840 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:58.590815    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"]
Sep 08 15:39:58.592718 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:39:58.592681    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9cdbd4_4284_4eba_b1b0_bb5838ab5647.slice/crio-9c58864063c6e4aae092a4fda783df18d2e8c9a94002c6de56406924dbd5ab82 WatchSource:0}: Error finding container 9c58864063c6e4aae092a4fda783df18d2e8c9a94002c6de56406924dbd5ab82: Status 404 returned error can't find the container with id 9c58864063c6e4aae092a4fda783df18d2e8c9a94002c6de56406924dbd5ab82
Sep 08 15:39:58.612260 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:58.612128    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc" event={"ID":"eb9cdbd4-4284-4eba-b1b0-bb5838ab5647","Type":"ContainerStarted","Data":"9c58864063c6e4aae092a4fda783df18d2e8c9a94002c6de56406924dbd5ab82"}
Sep 08 15:39:59.621465 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:59.621426    2566 generic.go:356] "Generic (PLEG): container finished" podID="eb9cdbd4-4284-4eba-b1b0-bb5838ab5647" containerID="9bdf96c9f80e5d615f86789a140b1648b0222da24e2079ca4ac4c0a422dece72" exitCode=0
Sep 08 15:39:59.621915 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:39:59.621512    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc" event={"ID":"eb9cdbd4-4284-4eba-b1b0-bb5838ab5647","Type":"ContainerDied","Data":"9bdf96c9f80e5d615f86789a140b1648b0222da24e2079ca4ac4c0a422dece72"}
Sep 08 15:40:00.774663 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:00.774608    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"
Sep 08 15:40:00.916512 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:00.916419    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9cdbd4-4284-4eba-b1b0-bb5838ab5647-maas-api-service-ca\") pod \"eb9cdbd4-4284-4eba-b1b0-bb5838ab5647\" (UID: \"eb9cdbd4-4284-4eba-b1b0-bb5838ab5647\") "
Sep 08 15:40:00.916798 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:00.916773    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb9cdbd4-4284-4eba-b1b0-bb5838ab5647-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eb9cdbd4-4284-4eba-b1b0-bb5838ab5647" (UID: "eb9cdbd4-4284-4eba-b1b0-bb5838ab5647"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:40:01.017274 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:01.017221    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9cdbd4-4284-4eba-b1b0-bb5838ab5647-maas-api-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:40:01.636543 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:01.636506    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"
Sep 08 15:40:01.636543 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:01.636533    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc" event={"ID":"eb9cdbd4-4284-4eba-b1b0-bb5838ab5647","Type":"ContainerDied","Data":"9c58864063c6e4aae092a4fda783df18d2e8c9a94002c6de56406924dbd5ab82"}
Sep 08 15:40:01.636774 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:01.636584    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c58864063c6e4aae092a4fda783df18d2e8c9a94002c6de56406924dbd5ab82"
Sep 08 15:40:04.109506 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.109476    2566 scope.go:117] "RemoveContainer" containerID="a638b9f067a4201e4a982f76ceaf31d1587e56ed58bb9354b6dd0910c73a9df1"
Sep 08 15:40:04.119404 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.119381    2566 scope.go:117] "RemoveContainer" containerID="d8d0cf5973f7fd824fcbc47769b1cbaecd08b02907879cee762675e731ce8c5c"
Sep 08 15:40:04.129565 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.129543    2566 scope.go:117] "RemoveContainer" containerID="46988bc6ca6269194743931d4c9193cdbfeecc5204b1b41e4ba5943d0c416cc4"
Sep 08 15:40:04.138841 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.138820    2566 scope.go:117] "RemoveContainer" containerID="a901c1c83803f31c93f4fa13bb1fc14cfa293dd272ad19dbfcded3a7dd1c4595"
Sep 08 15:40:04.265259 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.265221    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"]
Sep 08 15:40:04.265502 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.265474    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr" podUID="5fab09e4-d8de-4ac1-8776-59ea2ebab639" containerName="payload-processing" containerID="cri-o://1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9" gracePeriod=30
Sep 08 15:40:04.272271 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.272239    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"]
Sep 08 15:40:04.272508 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.272484    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg" podUID="fea021f2-c6c8-4bff-909d-4a1c97f114fa" containerName="payload-pre-processing" containerID="cri-o://91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf" gracePeriod=30
Sep 08 15:40:04.462031 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.462003    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"]
Sep 08 15:40:04.466253 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.466225    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d97358-rg9xc"]
Sep 08 15:40:04.561337 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.561306    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:40:04.601365 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.601337    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:40:04.651608 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.651513    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fea021f2-c6c8-4bff-909d-4a1c97f114fa-plugins-config-volume\") pod \"fea021f2-c6c8-4bff-909d-4a1c97f114fa\" (UID: \"fea021f2-c6c8-4bff-909d-4a1c97f114fa\") "
Sep 08 15:40:04.651608 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.651564    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fab09e4-d8de-4ac1-8776-59ea2ebab639-plugins-config-volume\") pod \"5fab09e4-d8de-4ac1-8776-59ea2ebab639\" (UID: \"5fab09e4-d8de-4ac1-8776-59ea2ebab639\") "
Sep 08 15:40:04.651872 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.651635    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b259r\" (UniqueName: \"kubernetes.io/projected/fea021f2-c6c8-4bff-909d-4a1c97f114fa-kube-api-access-b259r\") pod \"fea021f2-c6c8-4bff-909d-4a1c97f114fa\" (UID: \"fea021f2-c6c8-4bff-909d-4a1c97f114fa\") "
Sep 08 15:40:04.651872 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.651662    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqnzm\" (UniqueName: \"kubernetes.io/projected/5fab09e4-d8de-4ac1-8776-59ea2ebab639-kube-api-access-sqnzm\") pod \"5fab09e4-d8de-4ac1-8776-59ea2ebab639\" (UID: \"5fab09e4-d8de-4ac1-8776-59ea2ebab639\") "
Sep 08 15:40:04.651987 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.651956    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fea021f2-c6c8-4bff-909d-4a1c97f114fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fea021f2-c6c8-4bff-909d-4a1c97f114fa" (UID: "fea021f2-c6c8-4bff-909d-4a1c97f114fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:40:04.651987 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.651968    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fab09e4-d8de-4ac1-8776-59ea2ebab639-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5fab09e4-d8de-4ac1-8776-59ea2ebab639" (UID: "5fab09e4-d8de-4ac1-8776-59ea2ebab639"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:40:04.654061 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.654025    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fab09e4-d8de-4ac1-8776-59ea2ebab639-kube-api-access-sqnzm" (OuterVolumeSpecName: "kube-api-access-sqnzm") pod "5fab09e4-d8de-4ac1-8776-59ea2ebab639" (UID: "5fab09e4-d8de-4ac1-8776-59ea2ebab639"). InnerVolumeSpecName "kube-api-access-sqnzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:04.654198 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.654104    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fea021f2-c6c8-4bff-909d-4a1c97f114fa-kube-api-access-b259r" (OuterVolumeSpecName: "kube-api-access-b259r") pod "fea021f2-c6c8-4bff-909d-4a1c97f114fa" (UID: "fea021f2-c6c8-4bff-909d-4a1c97f114fa"). InnerVolumeSpecName "kube-api-access-b259r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:04.657298 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.657272    2566 generic.go:356] "Generic (PLEG): container finished" podID="fea021f2-c6c8-4bff-909d-4a1c97f114fa" containerID="91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf" exitCode=0
Sep 08 15:40:04.657431 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.657324    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"
Sep 08 15:40:04.657431 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.657368    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg" event={"ID":"fea021f2-c6c8-4bff-909d-4a1c97f114fa","Type":"ContainerDied","Data":"91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf"}
Sep 08 15:40:04.657431 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.657418    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg" event={"ID":"fea021f2-c6c8-4bff-909d-4a1c97f114fa","Type":"ContainerDied","Data":"e134d514ab790f5cf55722da7c693861634343296b52dcf573beb5b11e462749"}
Sep 08 15:40:04.657594 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.657451    2566 scope.go:117] "RemoveContainer" containerID="91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf"
Sep 08 15:40:04.659061 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.659035    2566 generic.go:356] "Generic (PLEG): container finished" podID="5fab09e4-d8de-4ac1-8776-59ea2ebab639" containerID="1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9" exitCode=0
Sep 08 15:40:04.659183 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.659085    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr" event={"ID":"5fab09e4-d8de-4ac1-8776-59ea2ebab639","Type":"ContainerDied","Data":"1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9"}
Sep 08 15:40:04.659183 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.659124    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr" event={"ID":"5fab09e4-d8de-4ac1-8776-59ea2ebab639","Type":"ContainerDied","Data":"01f8f44c9d438fd1d6d503d823f47ee0ccb632c1ea3a755800cdb3c57a1ba0a5"}
Sep 08 15:40:04.659306 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.659247    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"
Sep 08 15:40:04.668667 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.668647    2566 scope.go:117] "RemoveContainer" containerID="91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf"
Sep 08 15:40:04.669087 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:40:04.669008    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf\": container with ID starting with 91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf not found: ID does not exist" containerID="91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf"
Sep 08 15:40:04.669087 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.669038    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf"} err="failed to get container status \"91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf\": rpc error: code = NotFound desc = could not find container \"91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf\": container with ID starting with 91d19a00c1677adbc553e20e85d20700fc4ff058041ace0fdd652dfb5913c5cf not found: ID does not exist"
Sep 08 15:40:04.669087 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.669055    2566 scope.go:117] "RemoveContainer" containerID="1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9"
Sep 08 15:40:04.681143 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.681110    2566 scope.go:117] "RemoveContainer" containerID="1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9"
Sep 08 15:40:04.681556 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:40:04.681534    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9\": container with ID starting with 1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9 not found: ID does not exist" containerID="1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9"
Sep 08 15:40:04.681658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.681570    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9"} err="failed to get container status \"1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9\": rpc error: code = NotFound desc = could not find container \"1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9\": container with ID starting with 1f607baa8db15f0e4cb3530e39a31a63f942c73c06810d66f09121d7f1ce67b9 not found: ID does not exist"
Sep 08 15:40:04.688562 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.688527    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"]
Sep 08 15:40:04.693739 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.693703    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d97358-7d75d4b94-hpfkg"]
Sep 08 15:40:04.699014 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.698984    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"]
Sep 08 15:40:04.704148 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.704122    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-d97358-5cc65458ff-26qrr"]
Sep 08 15:40:04.752574 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.752534    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fea021f2-c6c8-4bff-909d-4a1c97f114fa-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:40:04.752574 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.752566    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fab09e4-d8de-4ac1-8776-59ea2ebab639-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:40:04.752574 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.752577    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b259r\" (UniqueName: \"kubernetes.io/projected/fea021f2-c6c8-4bff-909d-4a1c97f114fa-kube-api-access-b259r\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:40:04.752574 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:04.752586    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqnzm\" (UniqueName: \"kubernetes.io/projected/5fab09e4-d8de-4ac1-8776-59ea2ebab639-kube-api-access-sqnzm\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:40:05.915817 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:05.915779    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fab09e4-d8de-4ac1-8776-59ea2ebab639" path="/var/lib/kubelet/pods/5fab09e4-d8de-4ac1-8776-59ea2ebab639/volumes"
Sep 08 15:40:05.916210 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:05.916115    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9cdbd4-4284-4eba-b1b0-bb5838ab5647" path="/var/lib/kubelet/pods/eb9cdbd4-4284-4eba-b1b0-bb5838ab5647/volumes"
Sep 08 15:40:05.916422 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:05.916409    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fea021f2-c6c8-4bff-909d-4a1c97f114fa" path="/var/lib/kubelet/pods/fea021f2-c6c8-4bff-909d-4a1c97f114fa/volumes"
Sep 08 15:40:14.999478 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:14.999432    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"]
Sep 08 15:40:14.999972 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:14.999942    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9cdbd4-4284-4eba-b1b0-bb5838ab5647" containerName="revoke-keys"
Sep 08 15:40:14.999972 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:14.999957    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9cdbd4-4284-4eba-b1b0-bb5838ab5647" containerName="revoke-keys"
Sep 08 15:40:15.000050 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:14.999979    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fab09e4-d8de-4ac1-8776-59ea2ebab639" containerName="payload-processing"
Sep 08 15:40:15.000050 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:14.999988    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fab09e4-d8de-4ac1-8776-59ea2ebab639" containerName="payload-processing"
Sep 08 15:40:15.000050 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.000007    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fea021f2-c6c8-4bff-909d-4a1c97f114fa" containerName="payload-pre-processing"
Sep 08 15:40:15.000050 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.000013    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fea021f2-c6c8-4bff-909d-4a1c97f114fa" containerName="payload-pre-processing"
Sep 08 15:40:15.000178 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.000093    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fea021f2-c6c8-4bff-909d-4a1c97f114fa" containerName="payload-pre-processing"
Sep 08 15:40:15.000178 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.000104    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fab09e4-d8de-4ac1-8776-59ea2ebab639" containerName="payload-processing"
Sep 08 15:40:15.000178 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.000111    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9cdbd4-4284-4eba-b1b0-bb5838ab5647" containerName="revoke-keys"
Sep 08 15:40:15.004734 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.004718    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"
Sep 08 15:40:15.008704 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.008677    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qqvg\""
Sep 08 15:40:15.013579 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.013555    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"]
Sep 08 15:40:15.037719 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.037685    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed7995f-61c2-450c-9a6c-9d331f7d1cdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z\" (UID: \"2ed7995f-61c2-450c-9a6c-9d331f7d1cdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"
Sep 08 15:40:15.139021 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.138984    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed7995f-61c2-450c-9a6c-9d331f7d1cdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z\" (UID: \"2ed7995f-61c2-450c-9a6c-9d331f7d1cdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"
Sep 08 15:40:15.139729 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.139705    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed7995f-61c2-450c-9a6c-9d331f7d1cdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z\" (UID: \"2ed7995f-61c2-450c-9a6c-9d331f7d1cdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"
Sep 08 15:40:15.317391 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.317284    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"
Sep 08 15:40:15.593546 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.593512    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"]
Sep 08 15:40:15.595258 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:40:15.595236    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed7995f_61c2_450c_9a6c_9d331f7d1cdd.slice/crio-8c863ebf117bddc826052ba07272fe086aeeea1cd083f387cd5e975b437d7e16 WatchSource:0}: Error finding container 8c863ebf117bddc826052ba07272fe086aeeea1cd083f387cd5e975b437d7e16: Status 404 returned error can't find the container with id 8c863ebf117bddc826052ba07272fe086aeeea1cd083f387cd5e975b437d7e16
Sep 08 15:40:15.736310 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:15.736265    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z" event={"ID":"2ed7995f-61c2-450c-9a6c-9d331f7d1cdd","Type":"ContainerStarted","Data":"8c863ebf117bddc826052ba07272fe086aeeea1cd083f387cd5e975b437d7e16"}
Sep 08 15:40:16.745300 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:16.745205    2566 generic.go:356] "Generic (PLEG): container finished" podID="2ed7995f-61c2-450c-9a6c-9d331f7d1cdd" containerID="57387b32107ef776e23ed15602e8bdfb41345fc3caf9c1c34d3b5ad9b57fac39" exitCode=0
Sep 08 15:40:16.745693 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:16.745294    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z" event={"ID":"2ed7995f-61c2-450c-9a6c-9d331f7d1cdd","Type":"ContainerDied","Data":"57387b32107ef776e23ed15602e8bdfb41345fc3caf9c1c34d3b5ad9b57fac39"}
Sep 08 15:40:17.906740 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:17.906714    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"
Sep 08 15:40:17.964140 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:17.964099    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed7995f-61c2-450c-9a6c-9d331f7d1cdd-maas-api-service-ca\") pod \"2ed7995f-61c2-450c-9a6c-9d331f7d1cdd\" (UID: \"2ed7995f-61c2-450c-9a6c-9d331f7d1cdd\") "
Sep 08 15:40:17.964505 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:17.964479    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed7995f-61c2-450c-9a6c-9d331f7d1cdd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2ed7995f-61c2-450c-9a6c-9d331f7d1cdd" (UID: "2ed7995f-61c2-450c-9a6c-9d331f7d1cdd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:40:18.065688 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:18.065555    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed7995f-61c2-450c-9a6c-9d331f7d1cdd-maas-api-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:40:18.760883 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:18.760851    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"
Sep 08 15:40:18.761073 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:18.760890    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z" event={"ID":"2ed7995f-61c2-450c-9a6c-9d331f7d1cdd","Type":"ContainerDied","Data":"8c863ebf117bddc826052ba07272fe086aeeea1cd083f387cd5e975b437d7e16"}
Sep 08 15:40:18.761073 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:18.760949    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c863ebf117bddc826052ba07272fe086aeeea1cd083f387cd5e975b437d7e16"
Sep 08 15:40:30.788284 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:30.788184    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"]
Sep 08 15:40:30.788817 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:30.788459    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd" podUID="dc3dda3b-f6c4-4593-ad77-3e711cdc4d38" containerName="payload-pre-processing" containerID="cri-o://09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094" gracePeriod=30
Sep 08 15:40:31.015054 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.015016    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"]
Sep 08 15:40:31.018386 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.018358    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-4a2c80-qgn5z"]
Sep 08 15:40:31.050893 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.050814    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:40:31.189803 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.189765    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-plugins-config-volume\") pod \"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38\" (UID: \"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38\") "
Sep 08 15:40:31.189981 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.189897    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdg6j\" (UniqueName: \"kubernetes.io/projected/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-kube-api-access-zdg6j\") pod \"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38\" (UID: \"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38\") "
Sep 08 15:40:31.190235 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.190207    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dc3dda3b-f6c4-4593-ad77-3e711cdc4d38" (UID: "dc3dda3b-f6c4-4593-ad77-3e711cdc4d38"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:40:31.192121 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.192095    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-kube-api-access-zdg6j" (OuterVolumeSpecName: "kube-api-access-zdg6j") pod "dc3dda3b-f6c4-4593-ad77-3e711cdc4d38" (UID: "dc3dda3b-f6c4-4593-ad77-3e711cdc4d38"). InnerVolumeSpecName "kube-api-access-zdg6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:31.290727 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.290694    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdg6j\" (UniqueName: \"kubernetes.io/projected/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-kube-api-access-zdg6j\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:40:31.290727 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.290720    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:40:31.849996 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.849953    2566 generic.go:356] "Generic (PLEG): container finished" podID="dc3dda3b-f6c4-4593-ad77-3e711cdc4d38" containerID="09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094" exitCode=0
Sep 08 15:40:31.849996 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.849999    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"
Sep 08 15:40:31.850543 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.850035    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd" event={"ID":"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38","Type":"ContainerDied","Data":"09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094"}
Sep 08 15:40:31.850543 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.850082    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd" event={"ID":"dc3dda3b-f6c4-4593-ad77-3e711cdc4d38","Type":"ContainerDied","Data":"ebdd25659b072d5ea2fcc78f3ba44b6ff97427b946872abf86599a8a57aa559e"}
Sep 08 15:40:31.850543 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.850104    2566 scope.go:117] "RemoveContainer" containerID="09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094"
Sep 08 15:40:31.860279 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.860257    2566 scope.go:117] "RemoveContainer" containerID="09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094"
Sep 08 15:40:31.860583 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:40:31.860563    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094\": container with ID starting with 09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094 not found: ID does not exist" containerID="09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094"
Sep 08 15:40:31.860664 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.860594    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094"} err="failed to get container status \"09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094\": rpc error: code = NotFound desc = could not find container \"09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094\": container with ID starting with 09f732731f3d33d69ed6f31d738b11f9054325d41beac5d9c3027d1e35825094 not found: ID does not exist"
Sep 08 15:40:31.875175 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.875147    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"]
Sep 08 15:40:31.877852 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.877825    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4a2c80-577f46b6b6-lf4hd"]
Sep 08 15:40:31.915938 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.915894    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ed7995f-61c2-450c-9a6c-9d331f7d1cdd" path="/var/lib/kubelet/pods/2ed7995f-61c2-450c-9a6c-9d331f7d1cdd/volumes"
Sep 08 15:40:31.916348 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:40:31.916330    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc3dda3b-f6c4-4593-ad77-3e711cdc4d38" path="/var/lib/kubelet/pods/dc3dda3b-f6c4-4593-ad77-3e711cdc4d38/volumes"
Sep 08 15:41:04.187109 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:04.187074    2566 scope.go:117] "RemoveContainer" containerID="155afe77182bb0271ecfa6a5dd8c698833685667a797fcf931361bd4595215cd"
Sep 08 15:41:46.602238 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:46.602198    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"]
Sep 08 15:41:46.602823 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:46.602476    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5" podUID="40c16fb4-f349-44ad-b9d2-5c333b923bf9" containerName="payload-pre-processing" containerID="cri-o://6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e" gracePeriod=30
Sep 08 15:41:46.606383 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:46.606351    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"]
Sep 08 15:41:46.608117 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:46.608078    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j" podUID="49355c3a-2fbc-4192-846e-1aa4204b86b0" containerName="payload-processing" containerID="cri-o://d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2" gracePeriod=30
Sep 08 15:41:46.908156 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:46.908128    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:41:46.915608 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:46.915580    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:41:47.097288 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.097254    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szzl8\" (UniqueName: \"kubernetes.io/projected/40c16fb4-f349-44ad-b9d2-5c333b923bf9-kube-api-access-szzl8\") pod \"40c16fb4-f349-44ad-b9d2-5c333b923bf9\" (UID: \"40c16fb4-f349-44ad-b9d2-5c333b923bf9\") "
Sep 08 15:41:47.097512 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.097317    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49355c3a-2fbc-4192-846e-1aa4204b86b0-plugins-config-volume\") pod \"49355c3a-2fbc-4192-846e-1aa4204b86b0\" (UID: \"49355c3a-2fbc-4192-846e-1aa4204b86b0\") "
Sep 08 15:41:47.097512 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.097355    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40c16fb4-f349-44ad-b9d2-5c333b923bf9-plugins-config-volume\") pod \"40c16fb4-f349-44ad-b9d2-5c333b923bf9\" (UID: \"40c16fb4-f349-44ad-b9d2-5c333b923bf9\") "
Sep 08 15:41:47.097682 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.097529    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrz7m\" (UniqueName: \"kubernetes.io/projected/49355c3a-2fbc-4192-846e-1aa4204b86b0-kube-api-access-xrz7m\") pod \"49355c3a-2fbc-4192-846e-1aa4204b86b0\" (UID: \"49355c3a-2fbc-4192-846e-1aa4204b86b0\") "
Sep 08 15:41:47.097746 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.097715    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40c16fb4-f349-44ad-b9d2-5c333b923bf9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "40c16fb4-f349-44ad-b9d2-5c333b923bf9" (UID: "40c16fb4-f349-44ad-b9d2-5c333b923bf9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:41:47.097802 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.097732    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49355c3a-2fbc-4192-846e-1aa4204b86b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49355c3a-2fbc-4192-846e-1aa4204b86b0" (UID: "49355c3a-2fbc-4192-846e-1aa4204b86b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:41:47.098051 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.098028    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49355c3a-2fbc-4192-846e-1aa4204b86b0-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:41:47.098051 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.098056    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40c16fb4-f349-44ad-b9d2-5c333b923bf9-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:41:47.099771 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.099739    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49355c3a-2fbc-4192-846e-1aa4204b86b0-kube-api-access-xrz7m" (OuterVolumeSpecName: "kube-api-access-xrz7m") pod "49355c3a-2fbc-4192-846e-1aa4204b86b0" (UID: "49355c3a-2fbc-4192-846e-1aa4204b86b0"). InnerVolumeSpecName "kube-api-access-xrz7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:47.100094 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.100074    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40c16fb4-f349-44ad-b9d2-5c333b923bf9-kube-api-access-szzl8" (OuterVolumeSpecName: "kube-api-access-szzl8") pod "40c16fb4-f349-44ad-b9d2-5c333b923bf9" (UID: "40c16fb4-f349-44ad-b9d2-5c333b923bf9"). InnerVolumeSpecName "kube-api-access-szzl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:47.198681 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.198553    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szzl8\" (UniqueName: \"kubernetes.io/projected/40c16fb4-f349-44ad-b9d2-5c333b923bf9-kube-api-access-szzl8\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:41:47.198681 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.198587    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrz7m\" (UniqueName: \"kubernetes.io/projected/49355c3a-2fbc-4192-846e-1aa4204b86b0-kube-api-access-xrz7m\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:41:47.350705 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.350667    2566 generic.go:356] "Generic (PLEG): container finished" podID="40c16fb4-f349-44ad-b9d2-5c333b923bf9" containerID="6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e" exitCode=0
Sep 08 15:41:47.350910 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.350721    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"
Sep 08 15:41:47.350910 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.350743    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5" event={"ID":"40c16fb4-f349-44ad-b9d2-5c333b923bf9","Type":"ContainerDied","Data":"6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e"}
Sep 08 15:41:47.350910 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.350794    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5" event={"ID":"40c16fb4-f349-44ad-b9d2-5c333b923bf9","Type":"ContainerDied","Data":"164b7f541ba2349f9fb1da41a7037699cf2bfc41790ae265e8513c4e69c53d23"}
Sep 08 15:41:47.350910 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.350820    2566 scope.go:117] "RemoveContainer" containerID="6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e"
Sep 08 15:41:47.352240 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.352217    2566 generic.go:356] "Generic (PLEG): container finished" podID="49355c3a-2fbc-4192-846e-1aa4204b86b0" containerID="d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2" exitCode=0
Sep 08 15:41:47.352340 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.352241    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j" event={"ID":"49355c3a-2fbc-4192-846e-1aa4204b86b0","Type":"ContainerDied","Data":"d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2"}
Sep 08 15:41:47.352340 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.352264    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"
Sep 08 15:41:47.352340 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.352283    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j" event={"ID":"49355c3a-2fbc-4192-846e-1aa4204b86b0","Type":"ContainerDied","Data":"b8898b3e46e94defb7902922fa6bfcfa2641cc5972c6b85d80cfe8dc927c679b"}
Sep 08 15:41:47.361539 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.361514    2566 scope.go:117] "RemoveContainer" containerID="6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e"
Sep 08 15:41:47.361957 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:41:47.361930    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e\": container with ID starting with 6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e not found: ID does not exist" containerID="6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e"
Sep 08 15:41:47.362055 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.361971    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e"} err="failed to get container status \"6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e\": rpc error: code = NotFound desc = could not find container \"6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e\": container with ID starting with 6430c3a56da9e7cf2ad3073442af1cd68bb1034d45fd97119f2e536b698f601e not found: ID does not exist"
Sep 08 15:41:47.362055 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.361997    2566 scope.go:117] "RemoveContainer" containerID="d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2"
Sep 08 15:41:47.371385 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.371358    2566 scope.go:117] "RemoveContainer" containerID="d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2"
Sep 08 15:41:47.371736 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:41:47.371713    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2\": container with ID starting with d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2 not found: ID does not exist" containerID="d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2"
Sep 08 15:41:47.371811 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.371745    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2"} err="failed to get container status \"d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2\": rpc error: code = NotFound desc = could not find container \"d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2\": container with ID starting with d3260fcd585e8c74bff001bb86e6f673b6999d27fb36c91bf5e8da2893d35fb2 not found: ID does not exist"
Sep 08 15:41:47.389327 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.389293    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"]
Sep 08 15:41:47.393441 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.393413    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9dea65-6c96c478f4-hnth5"]
Sep 08 15:41:47.413230 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.413197    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"]
Sep 08 15:41:47.419845 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.419813    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9dea65-6f76b679f5-hhv8j"]
Sep 08 15:41:47.914916 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.914884    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40c16fb4-f349-44ad-b9d2-5c333b923bf9" path="/var/lib/kubelet/pods/40c16fb4-f349-44ad-b9d2-5c333b923bf9/volumes"
Sep 08 15:41:47.915280 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:41:47.915241    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49355c3a-2fbc-4192-846e-1aa4204b86b0" path="/var/lib/kubelet/pods/49355c3a-2fbc-4192-846e-1aa4204b86b0/volumes"
Sep 08 15:42:04.223345 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:04.223308    2566 scope.go:117] "RemoveContainer" containerID="28d43637a9b92469124077e16abbdd6ce2dfcd922fe84a8e83bb1b7fae997da7"
Sep 08 15:42:05.240931 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:05.240890    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"]
Sep 08 15:42:05.241424 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:05.241171    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn" podUID="d8496b06-e2d3-44cc-b5a5-ef968a2d79a3" containerName="payload-pre-processing" containerID="cri-o://8b421de474786afe5bb2da130d1aa41bc4f1433d405c60b76e8dc4fd47749b47" gracePeriod=30
Sep 08 15:42:05.477806 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:05.477763    2566 generic.go:356] "Generic (PLEG): container finished" podID="d8496b06-e2d3-44cc-b5a5-ef968a2d79a3" containerID="8b421de474786afe5bb2da130d1aa41bc4f1433d405c60b76e8dc4fd47749b47" exitCode=0
Sep 08 15:42:05.478014 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:05.477926    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn" event={"ID":"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3","Type":"ContainerDied","Data":"8b421de474786afe5bb2da130d1aa41bc4f1433d405c60b76e8dc4fd47749b47"}
Sep 08 15:42:05.512864 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:05.512838    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:42:05.577031 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:05.576987    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-plugins-config-volume\") pod \"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3\" (UID: \"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3\") "
Sep 08 15:42:05.577031 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:05.577034    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqgp4\" (UniqueName: \"kubernetes.io/projected/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-kube-api-access-kqgp4\") pod \"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3\" (UID: \"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3\") "
Sep 08 15:42:05.577491 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:05.577441    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8496b06-e2d3-44cc-b5a5-ef968a2d79a3" (UID: "d8496b06-e2d3-44cc-b5a5-ef968a2d79a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:42:05.579608 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:05.579570    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-kube-api-access-kqgp4" (OuterVolumeSpecName: "kube-api-access-kqgp4") pod "d8496b06-e2d3-44cc-b5a5-ef968a2d79a3" (UID: "d8496b06-e2d3-44cc-b5a5-ef968a2d79a3"). InnerVolumeSpecName "kube-api-access-kqgp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:42:05.678007 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:05.677969    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:42:05.678007 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:05.678004    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqgp4\" (UniqueName: \"kubernetes.io/projected/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3-kube-api-access-kqgp4\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:42:06.487823 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:06.487786    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"
Sep 08 15:42:06.488317 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:06.487826    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn" event={"ID":"d8496b06-e2d3-44cc-b5a5-ef968a2d79a3","Type":"ContainerDied","Data":"27e24077701a17a2cf02a2ecff85c329e979a0fff8e5a690326472e4733082ba"}
Sep 08 15:42:06.488317 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:06.487898    2566 scope.go:117] "RemoveContainer" containerID="8b421de474786afe5bb2da130d1aa41bc4f1433d405c60b76e8dc4fd47749b47"
Sep 08 15:42:06.507910 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:06.507875    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"]
Sep 08 15:42:06.512642 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:06.512598    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2e082e-f757ffd58-x6qhn"]
Sep 08 15:42:07.914834 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:07.914797    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8496b06-e2d3-44cc-b5a5-ef968a2d79a3" path="/var/lib/kubelet/pods/d8496b06-e2d3-44cc-b5a5-ef968a2d79a3/volumes"
Sep 08 15:42:23.440112 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.440073    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"]
Sep 08 15:42:23.440730 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.440310    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl" podUID="25da845a-f731-4f0f-87e7-109206a42fba" containerName="payload-processing" containerID="cri-o://d1eb59ad7b5d54e96008cc4b6645a75e5681bcf10fa627ff437b11fae87fd318" gracePeriod=30
Sep 08 15:42:23.447731 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.447696    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"]
Sep 08 15:42:23.448274 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.447915    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px" podUID="77402ada-99f2-4fad-8365-d9014df18141" containerName="payload-pre-processing" containerID="cri-o://e971f884844319125d899b98967ad696620871dfb610510b90d23eab9d4d63d7" gracePeriod=30
Sep 08 15:42:23.602926 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.602809    2566 generic.go:356] "Generic (PLEG): container finished" podID="25da845a-f731-4f0f-87e7-109206a42fba" containerID="d1eb59ad7b5d54e96008cc4b6645a75e5681bcf10fa627ff437b11fae87fd318" exitCode=0
Sep 08 15:42:23.602926 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.602894    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl" event={"ID":"25da845a-f731-4f0f-87e7-109206a42fba","Type":"ContainerDied","Data":"d1eb59ad7b5d54e96008cc4b6645a75e5681bcf10fa627ff437b11fae87fd318"}
Sep 08 15:42:23.605371 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.605307    2566 generic.go:356] "Generic (PLEG): container finished" podID="77402ada-99f2-4fad-8365-d9014df18141" containerID="e971f884844319125d899b98967ad696620871dfb610510b90d23eab9d4d63d7" exitCode=0
Sep 08 15:42:23.605547 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.605382    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px" event={"ID":"77402ada-99f2-4fad-8365-d9014df18141","Type":"ContainerDied","Data":"e971f884844319125d899b98967ad696620871dfb610510b90d23eab9d4d63d7"}
Sep 08 15:42:23.712497 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.712474    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:42:23.738668 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.738611    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:42:23.849072 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.849034    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs774\" (UniqueName: \"kubernetes.io/projected/25da845a-f731-4f0f-87e7-109206a42fba-kube-api-access-vs774\") pod \"25da845a-f731-4f0f-87e7-109206a42fba\" (UID: \"25da845a-f731-4f0f-87e7-109206a42fba\") "
Sep 08 15:42:23.849265 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.849122    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2n8n\" (UniqueName: \"kubernetes.io/projected/77402ada-99f2-4fad-8365-d9014df18141-kube-api-access-m2n8n\") pod \"77402ada-99f2-4fad-8365-d9014df18141\" (UID: \"77402ada-99f2-4fad-8365-d9014df18141\") "
Sep 08 15:42:23.849265 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.849233    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77402ada-99f2-4fad-8365-d9014df18141-plugins-config-volume\") pod \"77402ada-99f2-4fad-8365-d9014df18141\" (UID: \"77402ada-99f2-4fad-8365-d9014df18141\") "
Sep 08 15:42:23.849406 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.849288    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25da845a-f731-4f0f-87e7-109206a42fba-plugins-config-volume\") pod \"25da845a-f731-4f0f-87e7-109206a42fba\" (UID: \"25da845a-f731-4f0f-87e7-109206a42fba\") "
Sep 08 15:42:23.849664 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.849603    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77402ada-99f2-4fad-8365-d9014df18141-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "77402ada-99f2-4fad-8365-d9014df18141" (UID: "77402ada-99f2-4fad-8365-d9014df18141"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:42:23.849761 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.849679    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25da845a-f731-4f0f-87e7-109206a42fba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "25da845a-f731-4f0f-87e7-109206a42fba" (UID: "25da845a-f731-4f0f-87e7-109206a42fba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:42:23.851488 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.851467    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25da845a-f731-4f0f-87e7-109206a42fba-kube-api-access-vs774" (OuterVolumeSpecName: "kube-api-access-vs774") pod "25da845a-f731-4f0f-87e7-109206a42fba" (UID: "25da845a-f731-4f0f-87e7-109206a42fba"). InnerVolumeSpecName "kube-api-access-vs774". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:42:23.851571 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.851528    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77402ada-99f2-4fad-8365-d9014df18141-kube-api-access-m2n8n" (OuterVolumeSpecName: "kube-api-access-m2n8n") pod "77402ada-99f2-4fad-8365-d9014df18141" (UID: "77402ada-99f2-4fad-8365-d9014df18141"). InnerVolumeSpecName "kube-api-access-m2n8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:42:23.950872 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.950779    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25da845a-f731-4f0f-87e7-109206a42fba-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:42:23.950872 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.950813    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs774\" (UniqueName: \"kubernetes.io/projected/25da845a-f731-4f0f-87e7-109206a42fba-kube-api-access-vs774\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:42:23.950872 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.950824    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2n8n\" (UniqueName: \"kubernetes.io/projected/77402ada-99f2-4fad-8365-d9014df18141-kube-api-access-m2n8n\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:42:23.950872 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:23.950832    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77402ada-99f2-4fad-8365-d9014df18141-plugins-config-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:42:24.613208 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:24.613176    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"
Sep 08 15:42:24.613694 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:24.613175    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl" event={"ID":"25da845a-f731-4f0f-87e7-109206a42fba","Type":"ContainerDied","Data":"757e1040259ca69401996f05ae7ddef1f706983636c6f383baa76527db349200"}
Sep 08 15:42:24.613694 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:24.613317    2566 scope.go:117] "RemoveContainer" containerID="d1eb59ad7b5d54e96008cc4b6645a75e5681bcf10fa627ff437b11fae87fd318"
Sep 08 15:42:24.614826 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:24.614684    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"
Sep 08 15:42:24.614826 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:24.614736    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px" event={"ID":"77402ada-99f2-4fad-8365-d9014df18141","Type":"ContainerDied","Data":"817bc7ae0bcd1c1c39b8036917cc1a8e508de5df8b9afeb45923fd5b7ed7c09d"}
Sep 08 15:42:24.625759 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:24.625734    2566 scope.go:117] "RemoveContainer" containerID="e971f884844319125d899b98967ad696620871dfb610510b90d23eab9d4d63d7"
Sep 08 15:42:24.636895 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:24.636847    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"]
Sep 08 15:42:24.641135 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:24.641111    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bc9cdf-67fc65b6db-m99px"]
Sep 08 15:42:24.653336 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:24.653305    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"]
Sep 08 15:42:24.659783 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:24.659758    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-bc9cdf-d954d7c7f-g79sl"]
Sep 08 15:42:25.914908 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:25.914871    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25da845a-f731-4f0f-87e7-109206a42fba" path="/var/lib/kubelet/pods/25da845a-f731-4f0f-87e7-109206a42fba/volumes"
Sep 08 15:42:25.915300 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:25.915233    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77402ada-99f2-4fad-8365-d9014df18141" path="/var/lib/kubelet/pods/77402ada-99f2-4fad-8365-d9014df18141/volumes"
Sep 08 15:42:33.789653 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:33.789591    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7578c8977-bdmfs"]
Sep 08 15:42:33.790166 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:33.789868    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7578c8977-bdmfs" podUID="0dd42584-40c4-4477-8ef0-83a8cf80b570" containerName="manager" containerID="cri-o://a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05" gracePeriod=30
Sep 08 15:42:34.044657 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.044570    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:42:34.144765 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.144732    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-metrics-certs\") pod \"0dd42584-40c4-4477-8ef0-83a8cf80b570\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") "
Sep 08 15:42:34.144952 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.144825    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-webhook-cert\") pod \"0dd42584-40c4-4477-8ef0-83a8cf80b570\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") "
Sep 08 15:42:34.144952 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.144858    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm8tw\" (UniqueName: \"kubernetes.io/projected/0dd42584-40c4-4477-8ef0-83a8cf80b570-kube-api-access-sm8tw\") pod \"0dd42584-40c4-4477-8ef0-83a8cf80b570\" (UID: \"0dd42584-40c4-4477-8ef0-83a8cf80b570\") "
Sep 08 15:42:34.147184 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.147146    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0dd42584-40c4-4477-8ef0-83a8cf80b570" (UID: "0dd42584-40c4-4477-8ef0-83a8cf80b570"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:42:34.147184 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.147171    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0dd42584-40c4-4477-8ef0-83a8cf80b570" (UID: "0dd42584-40c4-4477-8ef0-83a8cf80b570"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:42:34.147357 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.147216    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd42584-40c4-4477-8ef0-83a8cf80b570-kube-api-access-sm8tw" (OuterVolumeSpecName: "kube-api-access-sm8tw") pod "0dd42584-40c4-4477-8ef0-83a8cf80b570" (UID: "0dd42584-40c4-4477-8ef0-83a8cf80b570"). InnerVolumeSpecName "kube-api-access-sm8tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:42:34.245870 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.245827    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-webhook-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:42:34.245870 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.245866    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm8tw\" (UniqueName: \"kubernetes.io/projected/0dd42584-40c4-4477-8ef0-83a8cf80b570-kube-api-access-sm8tw\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:42:34.245870 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.245880    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dd42584-40c4-4477-8ef0-83a8cf80b570-metrics-certs\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:42:34.681739 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.681701    2566 generic.go:356] "Generic (PLEG): container finished" podID="0dd42584-40c4-4477-8ef0-83a8cf80b570" containerID="a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05" exitCode=0
Sep 08 15:42:34.681962 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.681748    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7578c8977-bdmfs"
Sep 08 15:42:34.681962 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.681793    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7578c8977-bdmfs" event={"ID":"0dd42584-40c4-4477-8ef0-83a8cf80b570","Type":"ContainerDied","Data":"a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05"}
Sep 08 15:42:34.681962 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.681848    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7578c8977-bdmfs" event={"ID":"0dd42584-40c4-4477-8ef0-83a8cf80b570","Type":"ContainerDied","Data":"06eb4d499de4deeb482e8657482dee13daf85f2fb60068b14d02854a9ad660e8"}
Sep 08 15:42:34.681962 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.681880    2566 scope.go:117] "RemoveContainer" containerID="a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05"
Sep 08 15:42:34.693218 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.693190    2566 scope.go:117] "RemoveContainer" containerID="a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05"
Sep 08 15:42:34.693610 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:42:34.693588    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05\": container with ID starting with a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05 not found: ID does not exist" containerID="a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05"
Sep 08 15:42:34.693738 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.693633    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05"} err="failed to get container status \"a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05\": rpc error: code = NotFound desc = could not find container \"a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05\": container with ID starting with a23978a566e1720ac0bbada49c007cd84a4c7541c3d78ea5eea6a4dc5afcbb05 not found: ID does not exist"
Sep 08 15:42:34.705506 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.705473    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7578c8977-bdmfs"]
Sep 08 15:42:34.710859 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:34.710829    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7578c8977-bdmfs"]
Sep 08 15:42:35.915373 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:42:35.915333    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dd42584-40c4-4477-8ef0-83a8cf80b570" path="/var/lib/kubelet/pods/0dd42584-40c4-4477-8ef0-83a8cf80b570/volumes"
Sep 08 15:43:35.513856 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.513770    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7578c8977-dnkzq"]
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514211    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8496b06-e2d3-44cc-b5a5-ef968a2d79a3" containerName="payload-pre-processing"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514223    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8496b06-e2d3-44cc-b5a5-ef968a2d79a3" containerName="payload-pre-processing"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514234    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc3dda3b-f6c4-4593-ad77-3e711cdc4d38" containerName="payload-pre-processing"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514240    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc3dda3b-f6c4-4593-ad77-3e711cdc4d38" containerName="payload-pre-processing"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514249    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ed7995f-61c2-450c-9a6c-9d331f7d1cdd" containerName="revoke-keys"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514255    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ed7995f-61c2-450c-9a6c-9d331f7d1cdd" containerName="revoke-keys"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514263    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40c16fb4-f349-44ad-b9d2-5c333b923bf9" containerName="payload-pre-processing"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514269    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="40c16fb4-f349-44ad-b9d2-5c333b923bf9" containerName="payload-pre-processing"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514278    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd42584-40c4-4477-8ef0-83a8cf80b570" containerName="manager"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514283    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd42584-40c4-4477-8ef0-83a8cf80b570" containerName="manager"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514296    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77402ada-99f2-4fad-8365-d9014df18141" containerName="payload-pre-processing"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514301    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="77402ada-99f2-4fad-8365-d9014df18141" containerName="payload-pre-processing"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514308    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25da845a-f731-4f0f-87e7-109206a42fba" containerName="payload-processing"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514313    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="25da845a-f731-4f0f-87e7-109206a42fba" containerName="payload-processing"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514319    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49355c3a-2fbc-4192-846e-1aa4204b86b0" containerName="payload-processing"
Sep 08 15:43:35.514318 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514324    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="49355c3a-2fbc-4192-846e-1aa4204b86b0" containerName="payload-processing"
Sep 08 15:43:35.514829 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514378    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="40c16fb4-f349-44ad-b9d2-5c333b923bf9" containerName="payload-pre-processing"
Sep 08 15:43:35.514829 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514386    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8496b06-e2d3-44cc-b5a5-ef968a2d79a3" containerName="payload-pre-processing"
Sep 08 15:43:35.514829 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514393    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd42584-40c4-4477-8ef0-83a8cf80b570" containerName="manager"
Sep 08 15:43:35.514829 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514399    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="77402ada-99f2-4fad-8365-d9014df18141" containerName="payload-pre-processing"
Sep 08 15:43:35.514829 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514405    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="25da845a-f731-4f0f-87e7-109206a42fba" containerName="payload-processing"
Sep 08 15:43:35.514829 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514410    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc3dda3b-f6c4-4593-ad77-3e711cdc4d38" containerName="payload-pre-processing"
Sep 08 15:43:35.514829 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514417    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="49355c3a-2fbc-4192-846e-1aa4204b86b0" containerName="payload-processing"
Sep 08 15:43:35.514829 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.514424    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ed7995f-61c2-450c-9a6c-9d331f7d1cdd" containerName="revoke-keys"
Sep 08 15:43:35.517703 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.517675    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:35.521636 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.521601    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 15:43:35.521770 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.521633    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 15:43:35.521770 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.521678    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:43:35.521857 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.521792    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6lwn5\""
Sep 08 15:43:35.528606 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.528579    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7578c8977-dnkzq"]
Sep 08 15:43:35.619148 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.619110    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9ct6\" (UniqueName: \"kubernetes.io/projected/c40b48f0-a2fd-4890-a133-c456d458b1c8-kube-api-access-c9ct6\") pod \"maas-controller-7578c8977-dnkzq\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") " pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:35.619349 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.619166    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-webhook-cert\") pod \"maas-controller-7578c8977-dnkzq\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") " pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:35.619349 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.619249    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-metrics-certs\") pod \"maas-controller-7578c8977-dnkzq\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") " pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:35.719654 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.719583    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9ct6\" (UniqueName: \"kubernetes.io/projected/c40b48f0-a2fd-4890-a133-c456d458b1c8-kube-api-access-c9ct6\") pod \"maas-controller-7578c8977-dnkzq\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") " pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:35.719863 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.719670    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-webhook-cert\") pod \"maas-controller-7578c8977-dnkzq\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") " pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:35.719863 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.719705    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-metrics-certs\") pod \"maas-controller-7578c8977-dnkzq\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") " pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:35.722417 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.722391    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-webhook-cert\") pod \"maas-controller-7578c8977-dnkzq\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") " pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:35.722534 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.722398    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-metrics-certs\") pod \"maas-controller-7578c8977-dnkzq\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") " pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:35.728830 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.728801    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9ct6\" (UniqueName: \"kubernetes.io/projected/c40b48f0-a2fd-4890-a133-c456d458b1c8-kube-api-access-c9ct6\") pod \"maas-controller-7578c8977-dnkzq\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") " pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:35.829924 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:35.829893    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:36.108281 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:36.108254    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7578c8977-dnkzq"]
Sep 08 15:43:36.109812 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:43:36.109788    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40b48f0_a2fd_4890_a133_c456d458b1c8.slice/crio-4faa7ada92a09abd184a99356a779017d5cadc8a6824b5a9f03187cc2b25012f WatchSource:0}: Error finding container 4faa7ada92a09abd184a99356a779017d5cadc8a6824b5a9f03187cc2b25012f: Status 404 returned error can't find the container with id 4faa7ada92a09abd184a99356a779017d5cadc8a6824b5a9f03187cc2b25012f
Sep 08 15:43:36.111485 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:36.111467    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:43:37.098157 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:37.098120    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7578c8977-dnkzq" event={"ID":"c40b48f0-a2fd-4890-a133-c456d458b1c8","Type":"ContainerStarted","Data":"4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac"}
Sep 08 15:43:37.098591 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:37.098172    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7578c8977-dnkzq" event={"ID":"c40b48f0-a2fd-4890-a133-c456d458b1c8","Type":"ContainerStarted","Data":"4faa7ada92a09abd184a99356a779017d5cadc8a6824b5a9f03187cc2b25012f"}
Sep 08 15:43:37.098591 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:37.098233    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:37.117583 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:37.117532    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7578c8977-dnkzq" podStartSLOduration=1.675434308 podStartE2EDuration="2.11751492s" totalImagesPullingTime="442.080612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:43:37.116887321 +0000 UTC m=+2077.688433364" watchObservedRunningTime="2026-09-08 15:43:37.11751492 +0000 UTC m=+2077.689060989"
Sep 08 15:43:48.107107 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:48.107076    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:57.478637 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.478591    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7578c8977-dnkzq"]
Sep 08 15:43:57.479195 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.478804    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7578c8977-dnkzq" podUID="c40b48f0-a2fd-4890-a133-c456d458b1c8" containerName="manager" containerID="cri-o://4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac" gracePeriod=30
Sep 08 15:43:57.740125 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.740059    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:57.833090 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.833060    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-metrics-certs\") pod \"c40b48f0-a2fd-4890-a133-c456d458b1c8\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") "
Sep 08 15:43:57.833263 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.833103    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-webhook-cert\") pod \"c40b48f0-a2fd-4890-a133-c456d458b1c8\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") "
Sep 08 15:43:57.833263 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.833172    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9ct6\" (UniqueName: \"kubernetes.io/projected/c40b48f0-a2fd-4890-a133-c456d458b1c8-kube-api-access-c9ct6\") pod \"c40b48f0-a2fd-4890-a133-c456d458b1c8\" (UID: \"c40b48f0-a2fd-4890-a133-c456d458b1c8\") "
Sep 08 15:43:57.835420 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.835385    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c40b48f0-a2fd-4890-a133-c456d458b1c8" (UID: "c40b48f0-a2fd-4890-a133-c456d458b1c8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:43:57.835568 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.835444    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c40b48f0-a2fd-4890-a133-c456d458b1c8" (UID: "c40b48f0-a2fd-4890-a133-c456d458b1c8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:43:57.835568 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.835463    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c40b48f0-a2fd-4890-a133-c456d458b1c8-kube-api-access-c9ct6" (OuterVolumeSpecName: "kube-api-access-c9ct6") pod "c40b48f0-a2fd-4890-a133-c456d458b1c8" (UID: "c40b48f0-a2fd-4890-a133-c456d458b1c8"). InnerVolumeSpecName "kube-api-access-c9ct6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:43:57.934540 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.934504    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9ct6\" (UniqueName: \"kubernetes.io/projected/c40b48f0-a2fd-4890-a133-c456d458b1c8-kube-api-access-c9ct6\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:43:57.934540 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.934536    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-metrics-certs\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:43:57.934540 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:57.934546    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c40b48f0-a2fd-4890-a133-c456d458b1c8-webhook-cert\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:43:58.240476 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:58.240439    2566 generic.go:356] "Generic (PLEG): container finished" podID="c40b48f0-a2fd-4890-a133-c456d458b1c8" containerID="4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac" exitCode=0
Sep 08 15:43:58.240721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:58.240490    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7578c8977-dnkzq"
Sep 08 15:43:58.240721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:58.240527    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7578c8977-dnkzq" event={"ID":"c40b48f0-a2fd-4890-a133-c456d458b1c8","Type":"ContainerDied","Data":"4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac"}
Sep 08 15:43:58.240721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:58.240580    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7578c8977-dnkzq" event={"ID":"c40b48f0-a2fd-4890-a133-c456d458b1c8","Type":"ContainerDied","Data":"4faa7ada92a09abd184a99356a779017d5cadc8a6824b5a9f03187cc2b25012f"}
Sep 08 15:43:58.240721 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:58.240601    2566 scope.go:117] "RemoveContainer" containerID="4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac"
Sep 08 15:43:58.250199 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:58.250174    2566 scope.go:117] "RemoveContainer" containerID="4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac"
Sep 08 15:43:58.250605 ip-10-0-138-20 kubenswrapper[2566]: E0908 15:43:58.250579    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac\": container with ID starting with 4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac not found: ID does not exist" containerID="4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac"
Sep 08 15:43:58.250693 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:58.250655    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac"} err="failed to get container status \"4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac\": rpc error: code = NotFound desc = could not find container \"4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac\": container with ID starting with 4d53d9f93530ce3bc7179f79f277f6d94a83e3b01dc7c0c487acdfac69a4b7ac not found: ID does not exist"
Sep 08 15:43:58.274712 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:58.274672    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7578c8977-dnkzq"]
Sep 08 15:43:58.279478 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:58.279451    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7578c8977-dnkzq"]
Sep 08 15:43:59.034940 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.034904    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7578c8977-5tzms"]
Sep 08 15:43:59.035379 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.035363    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40b48f0-a2fd-4890-a133-c456d458b1c8" containerName="manager"
Sep 08 15:43:59.035423 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.035381    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40b48f0-a2fd-4890-a133-c456d458b1c8" containerName="manager"
Sep 08 15:43:59.035486 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.035476    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c40b48f0-a2fd-4890-a133-c456d458b1c8" containerName="manager"
Sep 08 15:43:59.039971 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.039948    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:43:59.043767 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.043746    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:43:59.043893 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.043784    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6lwn5\""
Sep 08 15:43:59.043893 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.043796    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 15:43:59.043893 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.043796    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 15:43:59.050131 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.050102    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7578c8977-5tzms"]
Sep 08 15:43:59.145282 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.145242    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56sjr\" (UniqueName: \"kubernetes.io/projected/22917f42-b71e-41f2-804b-5c959c60d3d2-kube-api-access-56sjr\") pod \"maas-controller-7578c8977-5tzms\" (UID: \"22917f42-b71e-41f2-804b-5c959c60d3d2\") " pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:43:59.145469 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.145321    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22917f42-b71e-41f2-804b-5c959c60d3d2-metrics-certs\") pod \"maas-controller-7578c8977-5tzms\" (UID: \"22917f42-b71e-41f2-804b-5c959c60d3d2\") " pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:43:59.145469 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.145338    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22917f42-b71e-41f2-804b-5c959c60d3d2-webhook-cert\") pod \"maas-controller-7578c8977-5tzms\" (UID: \"22917f42-b71e-41f2-804b-5c959c60d3d2\") " pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:43:59.246733 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.246694    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56sjr\" (UniqueName: \"kubernetes.io/projected/22917f42-b71e-41f2-804b-5c959c60d3d2-kube-api-access-56sjr\") pod \"maas-controller-7578c8977-5tzms\" (UID: \"22917f42-b71e-41f2-804b-5c959c60d3d2\") " pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:43:59.246927 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.246801    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22917f42-b71e-41f2-804b-5c959c60d3d2-metrics-certs\") pod \"maas-controller-7578c8977-5tzms\" (UID: \"22917f42-b71e-41f2-804b-5c959c60d3d2\") " pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:43:59.246927 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.246828    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22917f42-b71e-41f2-804b-5c959c60d3d2-webhook-cert\") pod \"maas-controller-7578c8977-5tzms\" (UID: \"22917f42-b71e-41f2-804b-5c959c60d3d2\") " pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:43:59.249517 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.249492    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22917f42-b71e-41f2-804b-5c959c60d3d2-webhook-cert\") pod \"maas-controller-7578c8977-5tzms\" (UID: \"22917f42-b71e-41f2-804b-5c959c60d3d2\") " pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:43:59.249673 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.249651    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22917f42-b71e-41f2-804b-5c959c60d3d2-metrics-certs\") pod \"maas-controller-7578c8977-5tzms\" (UID: \"22917f42-b71e-41f2-804b-5c959c60d3d2\") " pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:43:59.256463 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.256438    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56sjr\" (UniqueName: \"kubernetes.io/projected/22917f42-b71e-41f2-804b-5c959c60d3d2-kube-api-access-56sjr\") pod \"maas-controller-7578c8977-5tzms\" (UID: \"22917f42-b71e-41f2-804b-5c959c60d3d2\") " pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:43:59.351599 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.351548    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:43:59.631499 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.631470    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7578c8977-5tzms"]
Sep 08 15:43:59.633248 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:43:59.633220    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22917f42_b71e_41f2_804b_5c959c60d3d2.slice/crio-f760646498447270b574782cc787b2e0746e31de3c2aba8a797fadadac35d849 WatchSource:0}: Error finding container f760646498447270b574782cc787b2e0746e31de3c2aba8a797fadadac35d849: Status 404 returned error can't find the container with id f760646498447270b574782cc787b2e0746e31de3c2aba8a797fadadac35d849
Sep 08 15:43:59.916582 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.916500    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c40b48f0-a2fd-4890-a133-c456d458b1c8" path="/var/lib/kubelet/pods/c40b48f0-a2fd-4890-a133-c456d458b1c8/volumes"
Sep 08 15:43:59.975679 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:43:59.975655    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:44:00.261967 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:44:00.261867    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7578c8977-5tzms" event={"ID":"22917f42-b71e-41f2-804b-5c959c60d3d2","Type":"ContainerStarted","Data":"c6d19d9fcc0856b700ac0d6e674efdec61e767a9b750556b750d1895149f2cd4"}
Sep 08 15:44:00.262387 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:44:00.262045    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:44:00.262387 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:44:00.262083    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7578c8977-5tzms" event={"ID":"22917f42-b71e-41f2-804b-5c959c60d3d2","Type":"ContainerStarted","Data":"f760646498447270b574782cc787b2e0746e31de3c2aba8a797fadadac35d849"}
Sep 08 15:44:00.287895 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:44:00.287822    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7578c8977-5tzms" podStartSLOduration=0.949948218 podStartE2EDuration="1.287798514s" totalImagesPullingTime="337.850296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:44:00.282721591 +0000 UTC m=+2100.854267635" watchObservedRunningTime="2026-09-08 15:44:00.287798514 +0000 UTC m=+2100.859344590"
Sep 08 15:44:11.270942 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:44:11.270900    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7578c8977-5tzms"
Sep 08 15:45:00.444347 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:00.444304    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"]
Sep 08 15:45:00.445112 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:00.444515    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv" podUID="dc7214ea-b338-4d53-b382-6ddddb48cc86" containerName="manager" containerID="cri-o://2aa3e74f92f860b44975037f0e6016554cdd41639bb9c15e747beb0bd3e179c4" gracePeriod=10
Sep 08 15:45:01.667054 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:01.667015    2566 generic.go:356] "Generic (PLEG): container finished" podID="dc7214ea-b338-4d53-b382-6ddddb48cc86" containerID="2aa3e74f92f860b44975037f0e6016554cdd41639bb9c15e747beb0bd3e179c4" exitCode=0
Sep 08 15:45:01.667454 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:01.667076    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv" event={"ID":"dc7214ea-b338-4d53-b382-6ddddb48cc86","Type":"ContainerDied","Data":"2aa3e74f92f860b44975037f0e6016554cdd41639bb9c15e747beb0bd3e179c4"}
Sep 08 15:45:01.697393 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:01.697366    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:45:01.723866 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:01.723838    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfcfk\" (UniqueName: \"kubernetes.io/projected/dc7214ea-b338-4d53-b382-6ddddb48cc86-kube-api-access-nfcfk\") pod \"dc7214ea-b338-4d53-b382-6ddddb48cc86\" (UID: \"dc7214ea-b338-4d53-b382-6ddddb48cc86\") "
Sep 08 15:45:01.724042 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:01.723877    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc7214ea-b338-4d53-b382-6ddddb48cc86-extensions-socket-volume\") pod \"dc7214ea-b338-4d53-b382-6ddddb48cc86\" (UID: \"dc7214ea-b338-4d53-b382-6ddddb48cc86\") "
Sep 08 15:45:01.724290 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:01.724261    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc7214ea-b338-4d53-b382-6ddddb48cc86-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dc7214ea-b338-4d53-b382-6ddddb48cc86" (UID: "dc7214ea-b338-4d53-b382-6ddddb48cc86"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:45:01.726782 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:01.726742    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7214ea-b338-4d53-b382-6ddddb48cc86-kube-api-access-nfcfk" (OuterVolumeSpecName: "kube-api-access-nfcfk") pod "dc7214ea-b338-4d53-b382-6ddddb48cc86" (UID: "dc7214ea-b338-4d53-b382-6ddddb48cc86"). InnerVolumeSpecName "kube-api-access-nfcfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:45:01.825589 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:01.825562    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfcfk\" (UniqueName: \"kubernetes.io/projected/dc7214ea-b338-4d53-b382-6ddddb48cc86-kube-api-access-nfcfk\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:45:01.825774 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:01.825594    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc7214ea-b338-4d53-b382-6ddddb48cc86-extensions-socket-volume\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:45:02.674906 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:02.674874    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"
Sep 08 15:45:02.674906 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:02.674893    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv" event={"ID":"dc7214ea-b338-4d53-b382-6ddddb48cc86","Type":"ContainerDied","Data":"8c8e61e6e29556ce26945ca21905c4ae3d3a3b0eb82750eac35c6700bdec7cd5"}
Sep 08 15:45:02.675415 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:02.674958    2566 scope.go:117] "RemoveContainer" containerID="2aa3e74f92f860b44975037f0e6016554cdd41639bb9c15e747beb0bd3e179c4"
Sep 08 15:45:02.697305 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:02.697269    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"]
Sep 08 15:45:02.702265 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:02.702226    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rrnvv"]
Sep 08 15:45:03.915760 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:03.915600    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc7214ea-b338-4d53-b382-6ddddb48cc86" path="/var/lib/kubelet/pods/dc7214ea-b338-4d53-b382-6ddddb48cc86/volumes"
Sep 08 15:45:04.298337 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:04.298161    2566 scope.go:117] "RemoveContainer" containerID="8b0d3d3af1e4c9236ce9685e34c91f37a770f9ce5f808b706d239693beb5f8af"
Sep 08 15:45:04.314660 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:04.307837    2566 scope.go:117] "RemoveContainer" containerID="2210d4dc394bca3389a92f4cdc2e70bc97c6694cbed9e8cb993bd35fb9c6e1e4"
Sep 08 15:45:04.317305 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:45:04.317283    2566 scope.go:117] "RemoveContainer" containerID="971c051af5c9acbc2e9a40ce0b85eb94e36d856c9cbc44e9ffe9ee340d72e17c"
Sep 08 15:46:01.143158 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.143110    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"]
Sep 08 15:46:01.143819 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.143777    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7214ea-b338-4d53-b382-6ddddb48cc86" containerName="manager"
Sep 08 15:46:01.143819 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.143796    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7214ea-b338-4d53-b382-6ddddb48cc86" containerName="manager"
Sep 08 15:46:01.143945 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.143913    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc7214ea-b338-4d53-b382-6ddddb48cc86" containerName="manager"
Sep 08 15:46:01.147089 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.147070    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"
Sep 08 15:46:01.150029 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.150010    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4g7sh\""
Sep 08 15:46:01.162687 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.162652    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"]
Sep 08 15:46:01.278833 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.278793    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhz7g\" (UniqueName: \"kubernetes.io/projected/79d975fd-3371-41da-9d87-d273369408c0-kube-api-access-zhz7g\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqs4l\" (UID: \"79d975fd-3371-41da-9d87-d273369408c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"
Sep 08 15:46:01.279019 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.278857    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79d975fd-3371-41da-9d87-d273369408c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqs4l\" (UID: \"79d975fd-3371-41da-9d87-d273369408c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"
Sep 08 15:46:01.380379 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.380340    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79d975fd-3371-41da-9d87-d273369408c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqs4l\" (UID: \"79d975fd-3371-41da-9d87-d273369408c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"
Sep 08 15:46:01.380562 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.380426    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhz7g\" (UniqueName: \"kubernetes.io/projected/79d975fd-3371-41da-9d87-d273369408c0-kube-api-access-zhz7g\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqs4l\" (UID: \"79d975fd-3371-41da-9d87-d273369408c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"
Sep 08 15:46:01.380775 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.380745    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79d975fd-3371-41da-9d87-d273369408c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqs4l\" (UID: \"79d975fd-3371-41da-9d87-d273369408c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"
Sep 08 15:46:01.391331 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.391303    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhz7g\" (UniqueName: \"kubernetes.io/projected/79d975fd-3371-41da-9d87-d273369408c0-kube-api-access-zhz7g\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqs4l\" (UID: \"79d975fd-3371-41da-9d87-d273369408c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"
Sep 08 15:46:01.457553 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.457456    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"
Sep 08 15:46:01.744335 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:01.744306    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"]
Sep 08 15:46:01.745456 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:46:01.745423    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d975fd_3371_41da_9d87_d273369408c0.slice/crio-441e80ab87482efda98e229a2efe8d09cf9dbae9b9e5e768f8102dbb146afa77 WatchSource:0}: Error finding container 441e80ab87482efda98e229a2efe8d09cf9dbae9b9e5e768f8102dbb146afa77: Status 404 returned error can't find the container with id 441e80ab87482efda98e229a2efe8d09cf9dbae9b9e5e768f8102dbb146afa77
Sep 08 15:46:02.043673 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:02.043544    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l" event={"ID":"79d975fd-3371-41da-9d87-d273369408c0","Type":"ContainerStarted","Data":"d0389dbd71c945c68fcc7946ba9ca5bd2b08d45a73ff6161d41623e63b50832a"}
Sep 08 15:46:02.043673 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:02.043610    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l" event={"ID":"79d975fd-3371-41da-9d87-d273369408c0","Type":"ContainerStarted","Data":"441e80ab87482efda98e229a2efe8d09cf9dbae9b9e5e768f8102dbb146afa77"}
Sep 08 15:46:02.043673 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:02.043671    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"
Sep 08 15:46:02.067698 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:02.067646    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l" podStartSLOduration=1.067628659 podStartE2EDuration="1.067628659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:46:02.06466881 +0000 UTC m=+2222.636214852" watchObservedRunningTime="2026-09-08 15:46:02.067628659 +0000 UTC m=+2222.639174693"
Sep 08 15:46:04.354058 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:04.354015    2566 scope.go:117] "RemoveContainer" containerID="9bdf96c9f80e5d615f86789a140b1648b0222da24e2079ca4ac4c0a422dece72"
Sep 08 15:46:04.363112 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:04.363090    2566 scope.go:117] "RemoveContainer" containerID="4918db179320d8c1e6d7f4abe7b4019c3cbb7014bd843a3161d0509d16ae4890"
Sep 08 15:46:13.051648 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:46:13.051598    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqs4l"
Sep 08 15:47:04.389287 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:47:04.389246    2566 scope.go:117] "RemoveContainer" containerID="57387b32107ef776e23ed15602e8bdfb41345fc3caf9c1c34d3b5ad9b57fac39"
Sep 08 15:48:09.616125 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:09.616092    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"]
Sep 08 15:48:09.616604 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:09.616294    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz" podUID="43b64c86-a349-4414-a003-bb41f3c562da" containerName="maas-api" containerID="cri-o://d062fb3715041db2a727eb7b626cc5b2a8b9007a2c5df6b6f70c4dae998d15e4" gracePeriod=30
Sep 08 15:48:09.829252 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:09.829208    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz" podUID="43b64c86-a349-4414-a003-bb41f3c562da" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.59:8443/health\": dial tcp 10.133.0.59:8443: connect: connection refused"
Sep 08 15:48:10.832427 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:10.832389    2566 generic.go:356] "Generic (PLEG): container finished" podID="43b64c86-a349-4414-a003-bb41f3c562da" containerID="d062fb3715041db2a727eb7b626cc5b2a8b9007a2c5df6b6f70c4dae998d15e4" exitCode=0
Sep 08 15:48:10.832867 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:10.832460    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz" event={"ID":"43b64c86-a349-4414-a003-bb41f3c562da","Type":"ContainerDied","Data":"d062fb3715041db2a727eb7b626cc5b2a8b9007a2c5df6b6f70c4dae998d15e4"}
Sep 08 15:48:10.870114 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:10.870088    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:48:10.953404 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:10.953302    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6xs8\" (UniqueName: \"kubernetes.io/projected/43b64c86-a349-4414-a003-bb41f3c562da-kube-api-access-w6xs8\") pod \"43b64c86-a349-4414-a003-bb41f3c562da\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") "
Sep 08 15:48:10.953404 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:10.953395    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls\") pod \"43b64c86-a349-4414-a003-bb41f3c562da\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") "
Sep 08 15:48:10.953675 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:10.953438    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b64c86-a349-4414-a003-bb41f3c562da-openshift-service-ca\") pod \"43b64c86-a349-4414-a003-bb41f3c562da\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") "
Sep 08 15:48:10.953675 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:10.953519    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-metrics-certs\") pod \"43b64c86-a349-4414-a003-bb41f3c562da\" (UID: \"43b64c86-a349-4414-a003-bb41f3c562da\") "
Sep 08 15:48:10.953902 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:10.953876    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43b64c86-a349-4414-a003-bb41f3c562da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "43b64c86-a349-4414-a003-bb41f3c562da" (UID: "43b64c86-a349-4414-a003-bb41f3c562da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:48:10.955605 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:10.955580    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "43b64c86-a349-4414-a003-bb41f3c562da" (UID: "43b64c86-a349-4414-a003-bb41f3c562da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:48:10.955723 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:10.955599    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43b64c86-a349-4414-a003-bb41f3c562da-kube-api-access-w6xs8" (OuterVolumeSpecName: "kube-api-access-w6xs8") pod "43b64c86-a349-4414-a003-bb41f3c562da" (UID: "43b64c86-a349-4414-a003-bb41f3c562da"). InnerVolumeSpecName "kube-api-access-w6xs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:48:10.955723 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:10.955605    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "43b64c86-a349-4414-a003-bb41f3c562da" (UID: "43b64c86-a349-4414-a003-bb41f3c562da"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:48:11.054476 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:11.054439    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-maas-api-tls\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:48:11.054476 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:11.054471    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b64c86-a349-4414-a003-bb41f3c562da-openshift-service-ca\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:48:11.054476 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:11.054480    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43b64c86-a349-4414-a003-bb41f3c562da-metrics-certs\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:48:11.054767 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:11.054488    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6xs8\" (UniqueName: \"kubernetes.io/projected/43b64c86-a349-4414-a003-bb41f3c562da-kube-api-access-w6xs8\") on node \"ip-10-0-138-20.ec2.internal\" DevicePath \"\""
Sep 08 15:48:11.839647 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:11.839603    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"
Sep 08 15:48:11.840061 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:11.839652    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b858864dd-ttlnz" event={"ID":"43b64c86-a349-4414-a003-bb41f3c562da","Type":"ContainerDied","Data":"23044067c5f709c2ec174335394ad594db0229a33ac59483632a78c1b0061289"}
Sep 08 15:48:11.840061 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:11.839712    2566 scope.go:117] "RemoveContainer" containerID="d062fb3715041db2a727eb7b626cc5b2a8b9007a2c5df6b6f70c4dae998d15e4"
Sep 08 15:48:11.863478 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:11.863447    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"]
Sep 08 15:48:11.867494 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:11.867470    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-b858864dd-ttlnz"]
Sep 08 15:48:11.915763 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:11.915734    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43b64c86-a349-4414-a003-bb41f3c562da" path="/var/lib/kubelet/pods/43b64c86-a349-4414-a003-bb41f3c562da/volumes"
Sep 08 15:48:30.414121 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:30.414087    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cdf6bbbfd-rxv7k_fb7a9884-f97c-41e6-86bc-12bf8f08f2f3/authorino/0.log"
Sep 08 15:48:35.845202 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:35.845169    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pz4mm_e5967258-0d46-48e1-b8d3-6e24e145ccb6/manager/0.log"
Sep 08 15:48:35.966538 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:35.966501    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6h7xx_f29a6c8c-bcd9-4791-9629-95a151f1b466/manager/0.log"
Sep 08 15:48:36.091066 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:36.091012    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7578c8977-5tzms_22917f42-b71e-41f2-804b-5c959c60d3d2/manager/0.log"
Sep 08 15:48:36.685855 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:36.685822    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66db8bdb84-zhnrd_bc99bdb1-db34-4ecf-a42d-917d47343fca/copy-manifests/0.log"
Sep 08 15:48:36.703869 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:36.703832    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66db8bdb84-zhnrd_bc99bdb1-db34-4ecf-a42d-917d47343fca/manager/0.log"
Sep 08 15:48:37.448929 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:37.448900    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-gspnn_7d7fa11e-8cd4-4202-b497-c1e4ebd75441/postgres/0.log"
Sep 08 15:48:38.217833 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:38.217795    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cdf6bbbfd-rxv7k_fb7a9884-f97c-41e6-86bc-12bf8f08f2f3/authorino/0.log"
Sep 08 15:48:38.330613 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:38.330583    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-l9sgm_e5a11ab6-c0a4-4b4b-9518-d4a18ef1a6e5/manager/0.log"
Sep 08 15:48:38.441113 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:38.441085    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-xn5ds_475e98a1-3ac3-4d42-b27f-fde2eba59d0a/manager/0.log"
Sep 08 15:48:38.550737 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:38.550663    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-z46t4_dfc288d2-0faf-41df-be9a-2f935b7ebc06/kuadrant-console-plugin/0.log"
Sep 08 15:48:38.672366 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:38.672333    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-sqs4l_79d975fd-3371-41da-9d87-d273369408c0/manager/0.log"
Sep 08 15:48:38.920751 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:38.920717    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-dwkkv_5fb78bc4-ff01-4644-91bf-8b66b91f6c57/manager/0.log"
Sep 08 15:48:39.472947 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:39.472916    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5674d6d4b5-7cl4j_03b5fb31-aec9-4e2b-b51d-3778645cd8b6/kube-auth-proxy/0.log"
Sep 08 15:48:39.824539 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:39.824459    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-fpwbv_5d4b81ea-762e-4271-98d0-741c8f0ed744/payload-pre-processing/0.log"
Sep 08 15:48:39.943228 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:39.943200    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pn2lc_65264b73-4245-42ac-bc84-84b9c2b0dcef/payload-processing/0.log"
Sep 08 15:48:40.057580 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:40.057547    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d7c5f44b-s56g9_cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58/router/0.log"
Sep 08 15:48:40.624408 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:40.624378    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-s7l96_2d5b1b36-30ed-4c26-b8d1-dc616be91d10/main/0.log"
Sep 08 15:48:46.613258 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.613220    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lskt4/must-gather-54q6x"]
Sep 08 15:48:46.613883 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.613865    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43b64c86-a349-4414-a003-bb41f3c562da" containerName="maas-api"
Sep 08 15:48:46.613966 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.613886    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="43b64c86-a349-4414-a003-bb41f3c562da" containerName="maas-api"
Sep 08 15:48:46.614022 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.614015    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="43b64c86-a349-4414-a003-bb41f3c562da" containerName="maas-api"
Sep 08 15:48:46.617512 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.617492    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lskt4/must-gather-54q6x"
Sep 08 15:48:46.620517 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.620494    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lskt4\"/\"default-dockercfg-psrfj\""
Sep 08 15:48:46.620659 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.620502    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lskt4\"/\"kube-root-ca.crt\""
Sep 08 15:48:46.620659 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.620545    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lskt4\"/\"openshift-service-ca.crt\""
Sep 08 15:48:46.627482 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.627457    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lskt4/must-gather-54q6x"]
Sep 08 15:48:46.677053 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.677015    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mbng\" (UniqueName: \"kubernetes.io/projected/56827e7d-13d9-49d0-ab2c-7023a194a218-kube-api-access-9mbng\") pod \"must-gather-54q6x\" (UID: \"56827e7d-13d9-49d0-ab2c-7023a194a218\") " pod="openshift-must-gather-lskt4/must-gather-54q6x"
Sep 08 15:48:46.677241 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.677126    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/56827e7d-13d9-49d0-ab2c-7023a194a218-must-gather-output\") pod \"must-gather-54q6x\" (UID: \"56827e7d-13d9-49d0-ab2c-7023a194a218\") " pod="openshift-must-gather-lskt4/must-gather-54q6x"
Sep 08 15:48:46.778003 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.777963    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mbng\" (UniqueName: \"kubernetes.io/projected/56827e7d-13d9-49d0-ab2c-7023a194a218-kube-api-access-9mbng\") pod \"must-gather-54q6x\" (UID: \"56827e7d-13d9-49d0-ab2c-7023a194a218\") " pod="openshift-must-gather-lskt4/must-gather-54q6x"
Sep 08 15:48:46.778182 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.778026    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/56827e7d-13d9-49d0-ab2c-7023a194a218-must-gather-output\") pod \"must-gather-54q6x\" (UID: \"56827e7d-13d9-49d0-ab2c-7023a194a218\") " pod="openshift-must-gather-lskt4/must-gather-54q6x"
Sep 08 15:48:46.778342 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.778327    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/56827e7d-13d9-49d0-ab2c-7023a194a218-must-gather-output\") pod \"must-gather-54q6x\" (UID: \"56827e7d-13d9-49d0-ab2c-7023a194a218\") " pod="openshift-must-gather-lskt4/must-gather-54q6x"
Sep 08 15:48:46.788455 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.788432    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mbng\" (UniqueName: \"kubernetes.io/projected/56827e7d-13d9-49d0-ab2c-7023a194a218-kube-api-access-9mbng\") pod \"must-gather-54q6x\" (UID: \"56827e7d-13d9-49d0-ab2c-7023a194a218\") " pod="openshift-must-gather-lskt4/must-gather-54q6x"
Sep 08 15:48:46.927556 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:46.927472    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lskt4/must-gather-54q6x"
Sep 08 15:48:47.217543 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:47.217517    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lskt4/must-gather-54q6x"]
Sep 08 15:48:47.218935 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:48:47.218910    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56827e7d_13d9_49d0_ab2c_7023a194a218.slice/crio-ff40a76862891bd3c28fb08d5269af9a4692a04076492f297af35af1be8832c9 WatchSource:0}: Error finding container ff40a76862891bd3c28fb08d5269af9a4692a04076492f297af35af1be8832c9: Status 404 returned error can't find the container with id ff40a76862891bd3c28fb08d5269af9a4692a04076492f297af35af1be8832c9
Sep 08 15:48:47.220703 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:47.220688    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:48:48.054800 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:48.054763    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lskt4/must-gather-54q6x" event={"ID":"56827e7d-13d9-49d0-ab2c-7023a194a218","Type":"ContainerStarted","Data":"ff40a76862891bd3c28fb08d5269af9a4692a04076492f297af35af1be8832c9"}
Sep 08 15:48:50.071485 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:50.071446    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lskt4/must-gather-54q6x" event={"ID":"56827e7d-13d9-49d0-ab2c-7023a194a218","Type":"ContainerStarted","Data":"98672db07cc0c7cc71665bd0fe3e39232eb87658c85ec905c4c0803943774d00"}
Sep 08 15:48:50.072016 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:50.071995    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lskt4/must-gather-54q6x" event={"ID":"56827e7d-13d9-49d0-ab2c-7023a194a218","Type":"ContainerStarted","Data":"698d8b9c543879bec82ccad5336169b373d652154cfff624b798f7673ee07533"}
Sep 08 15:48:50.093523 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:50.093459    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lskt4/must-gather-54q6x" podStartSLOduration=1.8949574089999999 podStartE2EDuration="4.093435705s" totalImagesPullingTime="2.198478296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:48:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:48:50.091564082 +0000 UTC m=+2390.663110122" watchObservedRunningTime="2026-09-08 15:48:50.093435705 +0000 UTC m=+2390.664981746"
Sep 08 15:48:51.079897 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:51.079865    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lpf2t_bfcec937-90de-47bc-a648-6144b1c324fd/global-pull-secret-syncer/0.log"
Sep 08 15:48:51.191533 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:51.191495    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xtwsp_a0981c28-3980-47f7-a24d-52f31707a907/konnectivity-agent/0.log"
Sep 08 15:48:51.264707 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:51.264671    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-20.ec2.internal_c7e569458af07a6378339a74ece7e2b0/haproxy/0.log"
Sep 08 15:48:56.028949 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:56.028917    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cdf6bbbfd-rxv7k_fb7a9884-f97c-41e6-86bc-12bf8f08f2f3/authorino/0.log"
Sep 08 15:48:56.067490 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:56.067462    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-l9sgm_e5a11ab6-c0a4-4b4b-9518-d4a18ef1a6e5/manager/0.log"
Sep 08 15:48:56.098071 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:56.098037    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-xn5ds_475e98a1-3ac3-4d42-b27f-fde2eba59d0a/manager/0.log"
Sep 08 15:48:56.124732 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:56.124653    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-z46t4_dfc288d2-0faf-41df-be9a-2f935b7ebc06/kuadrant-console-plugin/0.log"
Sep 08 15:48:56.171923 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:56.171891    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-sqs4l_79d975fd-3371-41da-9d87-d273369408c0/manager/0.log"
Sep 08 15:48:56.263551 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:56.263514    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-dwkkv_5fb78bc4-ff01-4644-91bf-8b66b91f6c57/manager/0.log"
Sep 08 15:48:57.626669 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:57.626638    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a545d7a4-a6b5-4329-af4e-9bf3a6064d8d/alertmanager/0.log"
Sep 08 15:48:57.654787 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:57.654588    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a545d7a4-a6b5-4329-af4e-9bf3a6064d8d/config-reloader/0.log"
Sep 08 15:48:57.685818 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:57.685788    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a545d7a4-a6b5-4329-af4e-9bf3a6064d8d/kube-rbac-proxy-web/0.log"
Sep 08 15:48:57.713671 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:57.713637    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a545d7a4-a6b5-4329-af4e-9bf3a6064d8d/kube-rbac-proxy/0.log"
Sep 08 15:48:57.742810 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:57.742771    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a545d7a4-a6b5-4329-af4e-9bf3a6064d8d/kube-rbac-proxy-metric/0.log"
Sep 08 15:48:57.769412 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:57.769386    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a545d7a4-a6b5-4329-af4e-9bf3a6064d8d/prom-label-proxy/0.log"
Sep 08 15:48:57.798326 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:57.798293    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a545d7a4-a6b5-4329-af4e-9bf3a6064d8d/init-config-reloader/0.log"
Sep 08 15:48:57.996758 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:57.996669    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-kf4st_8042fb04-b8de-4bd9-9704-c3763f426e01/monitoring-plugin/0.log"
Sep 08 15:48:58.092319 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:58.092284    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8z8gs_dbf022f8-6ab7-452d-bcac-6fb2a237d6f9/node-exporter/0.log"
Sep 08 15:48:58.115738 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:58.115696    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8z8gs_dbf022f8-6ab7-452d-bcac-6fb2a237d6f9/kube-rbac-proxy/0.log"
Sep 08 15:48:58.136938 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:58.136896    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8z8gs_dbf022f8-6ab7-452d-bcac-6fb2a237d6f9/init-textfile/0.log"
Sep 08 15:48:58.621813 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:58.621775    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-dtb22_55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e/prometheus-operator/0.log"
Sep 08 15:48:58.645680 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:58.645645    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-dtb22_55e1ad4d-bdb7-4a7d-87df-ffb10b82b28e/kube-rbac-proxy/0.log"
Sep 08 15:48:58.673254 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:58.673217    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-gsr2l_84b6b9b8-8c2a-4f1b-be26-728e852f1564/prometheus-operator-admission-webhook/0.log"
Sep 08 15:48:58.711796 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:58.711765    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5669fb68ff-2n5rc_e7d784e1-8a27-49b9-93c3-11675720c306/telemeter-client/0.log"
Sep 08 15:48:58.737528 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:58.737488    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5669fb68ff-2n5rc_e7d784e1-8a27-49b9-93c3-11675720c306/reload/0.log"
Sep 08 15:48:58.758654 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:48:58.758605    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5669fb68ff-2n5rc_e7d784e1-8a27-49b9-93c3-11675720c306/kube-rbac-proxy/0.log"
Sep 08 15:49:01.395418 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:01.395386    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-856b6897b7-fn6bl_13e6d01f-2b60-45c7-80f9-dd1923232dea/console/0.log"
Sep 08 15:49:01.434876 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:01.434838    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-fvn57_9f7ab5a3-dbbb-4130-8d68-c499e9c8c93a/download-server/0.log"
Sep 08 15:49:01.959832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:01.959796    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"]
Sep 08 15:49:01.969186 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:01.969159    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:01.974232 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:01.974153    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"]
Sep 08 15:49:02.160921 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.160891    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-sys\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.161118 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.160960    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-lib-modules\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.161118 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.161001    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5d8m\" (UniqueName: \"kubernetes.io/projected/76a9b5db-7754-49b7-90e7-b98b902acab4-kube-api-access-l5d8m\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.161118 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.161044    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-proc\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.161118 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.161095    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-podres\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.261890 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.261805    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-lib-modules\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.261890 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.261845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5d8m\" (UniqueName: \"kubernetes.io/projected/76a9b5db-7754-49b7-90e7-b98b902acab4-kube-api-access-l5d8m\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.262130 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.261901    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-proc\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.262130 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.261990    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-proc\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.262130 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.262010    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-lib-modules\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.262130 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.262102    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-podres\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.262333 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.262157    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-sys\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.262333 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.262256    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-podres\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.262333 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.262293    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a9b5db-7754-49b7-90e7-b98b902acab4-sys\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.271907 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.271875    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5d8m\" (UniqueName: \"kubernetes.io/projected/76a9b5db-7754-49b7-90e7-b98b902acab4-kube-api-access-l5d8m\") pod \"perf-node-gather-daemonset-fdrvp\" (UID: \"76a9b5db-7754-49b7-90e7-b98b902acab4\") " pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.285786 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.285755    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:02.589106 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:02.589071    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"]
Sep 08 15:49:02.594890 ip-10-0-138-20 kubenswrapper[2566]: W0908 15:49:02.594850    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod76a9b5db_7754_49b7_90e7_b98b902acab4.slice/crio-5acf9b664aea579d0562216500b3130290cbf8288e945004beb267b8d3b1488d WatchSource:0}: Error finding container 5acf9b664aea579d0562216500b3130290cbf8288e945004beb267b8d3b1488d: Status 404 returned error can't find the container with id 5acf9b664aea579d0562216500b3130290cbf8288e945004beb267b8d3b1488d
Sep 08 15:49:03.219213 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:03.219170    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp" event={"ID":"76a9b5db-7754-49b7-90e7-b98b902acab4","Type":"ContainerStarted","Data":"de479a45213d9df943f502c84cec3c677d3bb93f8712e2cf3d4ecbf87d1975d2"}
Sep 08 15:49:03.219516 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:03.219491    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp" event={"ID":"76a9b5db-7754-49b7-90e7-b98b902acab4","Type":"ContainerStarted","Data":"5acf9b664aea579d0562216500b3130290cbf8288e945004beb267b8d3b1488d"}
Sep 08 15:49:03.219736 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:03.219712    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:03.246688 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:03.246637    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp" podStartSLOduration=2.246602044 podStartE2EDuration="2.246602044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:49:03.242448508 +0000 UTC m=+2403.813994559" watchObservedRunningTime="2026-09-08 15:49:03.246602044 +0000 UTC m=+2403.818148106"
Sep 08 15:49:03.432236 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:03.432207    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xxtfv_ee258efd-c7f8-422c-8b15-8cb6e9a7b87b/dns/0.log"
Sep 08 15:49:03.459669 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:03.459639    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xxtfv_ee258efd-c7f8-422c-8b15-8cb6e9a7b87b/kube-rbac-proxy/0.log"
Sep 08 15:49:03.519037 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:03.518942    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qt79p_8ad071ef-333f-4eb3-a211-690a174bf23f/dns-node-resolver/0.log"
Sep 08 15:49:04.079331 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:04.079282    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bdl5b_d1932344-9198-44d7-a765-aa52cd8d5a6f/node-ca/0.log"
Sep 08 15:49:05.357934 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:05.357903    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5674d6d4b5-7cl4j_03b5fb31-aec9-4e2b-b51d-3778645cd8b6/kube-auth-proxy/0.log"
Sep 08 15:49:05.466178 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:05.466146    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-fpwbv_5d4b81ea-762e-4271-98d0-741c8f0ed744/payload-pre-processing/0.log"
Sep 08 15:49:05.515658 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:05.515600    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pn2lc_65264b73-4245-42ac-bc84-84b9c2b0dcef/payload-processing/0.log"
Sep 08 15:49:05.539228 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:05.539186    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d7c5f44b-s56g9_cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58/router/0.log"
Sep 08 15:49:06.370818 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:06.370783    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7vqck_efc545de-6c87-4145-9400-ea98638bd54f/serve-healthcheck-canary/0.log"
Sep 08 15:49:07.078507 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:07.078477    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v2gv7_2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4/kube-rbac-proxy/0.log"
Sep 08 15:49:07.105815 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:07.105784    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v2gv7_2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4/exporter/0.log"
Sep 08 15:49:07.132548 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:07.132520    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v2gv7_2a8a14d0-e4a6-4b9e-980b-bbc9c940b0e4/extractor/0.log"
Sep 08 15:49:09.246153 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:09.246019    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lskt4/perf-node-gather-daemonset-fdrvp"
Sep 08 15:49:09.247726 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:09.247688    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pz4mm_e5967258-0d46-48e1-b8d3-6e24e145ccb6/manager/0.log"
Sep 08 15:49:09.569568 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:09.569488    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6h7xx_f29a6c8c-bcd9-4791-9629-95a151f1b466/manager/0.log"
Sep 08 15:49:09.638353 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:09.638311    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7578c8977-5tzms_22917f42-b71e-41f2-804b-5c959c60d3d2/manager/0.log"
Sep 08 15:49:09.966148 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:09.966108    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66db8bdb84-zhnrd_bc99bdb1-db34-4ecf-a42d-917d47343fca/manager/0.log"
Sep 08 15:49:09.984550 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:09.984523    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66db8bdb84-zhnrd_bc99bdb1-db34-4ecf-a42d-917d47343fca/copy-manifests/0.log"
Sep 08 15:49:11.376314 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:11.376287    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5674d6d4b5-7cl4j_03b5fb31-aec9-4e2b-b51d-3778645cd8b6/kube-auth-proxy/0.log"
Sep 08 15:49:11.467743 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:11.467697    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-fpwbv_5d4b81ea-762e-4271-98d0-741c8f0ed744/payload-pre-processing/0.log"
Sep 08 15:49:11.475443 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:11.475414    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-kwm2v_07119d1e-7cf9-4d11-b5ed-6e42d7a1e430/openshift-lws-operator/0.log"
Sep 08 15:49:11.507909 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:11.507879    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pn2lc_65264b73-4245-42ac-bc84-84b9c2b0dcef/payload-processing/0.log"
Sep 08 15:49:11.534216 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:11.534185    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d7c5f44b-s56g9_cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58/router/0.log"
Sep 08 15:49:13.376049 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:13.376017    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5674d6d4b5-7cl4j_03b5fb31-aec9-4e2b-b51d-3778645cd8b6/kube-auth-proxy/0.log"
Sep 08 15:49:13.463845 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:13.463818    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-fpwbv_5d4b81ea-762e-4271-98d0-741c8f0ed744/payload-pre-processing/0.log"
Sep 08 15:49:13.507650 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:13.505327    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pn2lc_65264b73-4245-42ac-bc84-84b9c2b0dcef/payload-processing/0.log"
Sep 08 15:49:13.525642 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:13.524819    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d7c5f44b-s56g9_cb7f0cb8-0c66-4124-8bc4-60f2b3cfaa58/router/0.log"
Sep 08 15:49:18.107788 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:18.107760    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8984m_42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745/kube-multus-additional-cni-plugins/0.log"
Sep 08 15:49:18.126861 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:18.126841    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8984m_42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745/egress-router-binary-copy/0.log"
Sep 08 15:49:18.146420 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:18.146398    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8984m_42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745/cni-plugins/0.log"
Sep 08 15:49:18.165552 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:18.165527    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8984m_42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745/bond-cni-plugin/0.log"
Sep 08 15:49:18.185473 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:18.185444    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8984m_42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745/routeoverride-cni/0.log"
Sep 08 15:49:18.204571 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:18.204550    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8984m_42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745/whereabouts-cni-bincopy/0.log"
Sep 08 15:49:18.223832 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:18.223811    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8984m_42e9e6c7-8a07-4f8a-b81e-f28d3c8ae745/whereabouts-cni/0.log"
Sep 08 15:49:18.455521 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:18.455446    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mp72c_e6164d09-c086-489d-9020-0b035e79d421/kube-multus/0.log"
Sep 08 15:49:18.591982 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:18.591947    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fn4w2_9dfe2db7-aff1-41b8-a3c0-36575eee0515/network-metrics-daemon/0.log"
Sep 08 15:49:18.607350 ip-10-0-138-20 kubenswrapper[2566]: I0908 15:49:18.607305    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fn4w2_9dfe2db7-aff1-41b8-a3c0-36575eee0515/kube-rbac-proxy/0.log"